← Back to results

medallion-architecture jobs in San Diego

$169,200 – $253,800 · Posted 6 days ago

Lead large-scale enterprise data transformation programs at Qualcomm, managing multi-year initiatives across data modernization, cloud migration, and analytics platforms. Coordinate work across distributed data engineering, architecture, governance, security, and analytics teams while managing multi-million-dollar budgets and vendor relationships.… Drive adoption of modern data architectures (data lakehouse, data mesh, medallion patterns) and cloud platforms (Databricks, AWS, Azure, GCP), and establish federated data governance frameworks. Influence executives and technical stakeholders to deliver measurable business outcomes while handling legacy system retirement and enterprise data integration from CRM, ERP, HCM, and supply-chain systems.

San DiegoLast seen 4 days ago
$130,000 – $150,000 · Posted 10 days ago

Lead hands-on modernization of legacy SSIS/SSRS ETL workloads into cloud-native Lakehouse pipelines using Databricks, dbt, Fivetran, and Airflow. Design and enforce standardized data frameworks (ingestion, transformation, curation, consumption), drive CI/CD and observability practices, and mentor engineers on modern data engineering patterns.… Evaluate emerging technologies (Delta Live Tables, Iceberg, streaming, AI-driven observability) through POCs and POVs, and leverage AI-assisted tools (Databricks Assistant, GitHub Copilot, Cursor AI) to accelerate development and reduce technical debt. Optimize Spark workloads and orchestration across Azure and GCP environments while partnering with architects, platform engineers, and business stakeholders.

San DiegoLast seen 9 days ago
$175,000 – $185,000 · Posted 13 days ago

Principal Engineer leading the design, build, and operation of an enterprise data platform serving 50+ source systems across R&D, manufacturing, supply chain, and business functions. Responsible for hands-on architecture of medallion-layer pipelines using Microsoft Fabric, technical leadership and mentorship of data engineers, vendor management, data governance implementation, and platform reliability—balancing feature delivery with security, compliance (GxP), and operational excellence in a regulated biopharmaceutical environment.

San DiegoLast seen 11 days ago
$146,000 – $190,000 · Posted 18 days ago

Senior Data Engineer responsible for designing and implementing cloud data platforms (Databricks, Snowflake, BigQuery) and enterprise-scale data warehouses using Medallion Architecture. Will develop scalable ETL pipelines, optimize Spark jobs, integrate ML models into data workflows, and implement data governance and lineage tracking.… The role requires hands-on expertise in Python, PySpark, SQL, and AWS services, plus experience with AI/ML integration, DevOps practices (Terraform, CI/CD), and mentoring junior engineers and analysts.

San DiegoLast seen 16 days ago
$130,000 – $150,000 · Posted 23 days ago

Lead the modernization of legacy SSIS/SSRS data systems into cloud-native Lakehouse pipelines using Databricks, dbt, Fivetran, and Airflow. Design standardized frameworks for ingestion, transformation, and consumption layers while driving CI/CD, observability, and engineering best practices across Azure and GCP.… Evaluate emerging technologies (Delta Live Tables, Iceberg, streaming ingestion) through POCs and POVs, and leverage AI-assisted tools (Databricks Assistant, Cursor AI, GitHub Copilot) to accelerate development and reduce technical debt. Provide technical guidance to the team and translate business requirements into scalable data solutions.

San DiegoLast seen 21 days ago
$187,000 – $187,000 · Posted 27 days ago

Lead a data engineering team responsible for building scalable data pipelines, trusted datasets, and reusable data products powering analytics, experimentation, and AI across Scribd. This role blends technical leadership with hands-on architecture guidance; you'll establish engineering standards, drive design reviews, mentor engineers, and partner cross-functionally to translate business needs into production-grade data solutions.… Requires 10+ years in data engineering or data platforms, 3+ years leading engineering teams, deep expertise in dimensional modeling and scalable data architectures, and strong SQL plus Python/Scala skills. You'll work with modern cloud data platforms like Databricks, Snowflake, and BigQuery, and distributed processing frameworks like Spark.

San DiegoLast seen 25 days ago
$175,000 – $185,000 · Posted 1 month ago

Principal Engineer leading the design, build, and operation of an enterprise data platform serving 50+ source systems across R&D, Commercial, Manufacturing, and other business functions. The role combines hands-on data engineering (PySpark, T-SQL, Python, Data Factory, medallion architecture) with technical leadership of data engineers, vendor management, platform standards enforcement, and cross-functional stakeholder partnership.… Responsibilities span CI/CD pipeline design, data quality and reliability instrumentation, semantic layer development, data governance implementation, and delivery of new source-system integrations at scale.

San DiegoLast seen 1 month ago
$128,100 – $192,100 · Posted 1 month ago

Staff-level data engineer who designs, develops, and maintains scalable ETL/ELT pipelines using Databricks, PySpark, and Python for enterprise analytics and AI use cases. Builds curated data layers following Lakehouse Medallion architecture, develops Databricks-native applications (notebooks, dashboards, APIs), and optimizes Apache Spark workloads for performance and cost efficiency.… Owns production data pipelines end-to-end, ensures data quality and reliability, and acts as a technical leader mentoring teams on data engineering best practices and modern Databricks capabilities.

San DiegoLast seen 1 day ago
$110,000 – $130,000 · Posted 1 month ago

Design, build, and maintain enterprise data pipelines using Microsoft Fabric and Azure Synapse, handling ingestion, transformation, and orchestration from ERP and supply chain systems. Develop and manage Fabric Lakehouse and Warehouse architectures, apply data modeling best practices, and ensure data quality and reliability.… Collaborate with analytics, BI, and IT teams to create governed, scalable analytical data assets that support Power BI and downstream consumers. Requires a bachelor's degree in a quantitative field, strong SQL and Python skills, and hands-on experience with Microsoft Fabric and Azure Synapse.

San DiegoLast seen 1 month ago