data-observability jobs in San Diego

Staff Data Engineer at Illumina seeking a senior individual contributor with 10+ years building and scaling data products on Databricks and Snowflake. The role spans end-to-end ownership of data pipelines across Supply Chain, Manufacturing, and Quality domains, requiring advanced Python, SQL, and data modeling skills with hands-on expertise in Spark, Delta Lake, dbt, and distributed systems design.…See more Responsibilities include designing medallion-architecture data products, embedding governance and data quality, adopting AI in analytics workflows, and mentoring a global engineering team. The candidate will set technical standards, lead architecture decisions, and communicate trade-offs across business, AI, and platform stakeholders.

This Data Engineer II role focuses on data operations and infrastructure, supporting the transition of data systems from development to production. The engineer will administer data lakehouse/warehouse platforms (Snowflake, Databricks, Redshift, BigQuery, Azure Synapse), manage RBAC and user governance, monitor and troubleshoot data pipelines, and contribute to data governance and quality best practices.…See more Key responsibilities include orchestration tool administration (Apache Airflow, dbt), observability framework development, incident management, and hands-on SQL and Python work to maintain and optimize production data systems.

Design, build, and maintain scalable batch and streaming data pipelines on AWS and Databricks, developing reusable data engineering frameworks and standardized patterns for ingestion, transformation, and validation. Leverage AI-based techniques to automate data quality checks, anomaly detection, and pipeline self-healing.…See more Define SLIs/SLOs, participate in on-call rotations, and mentor junior engineers while driving adoption of data frameworks and best practices across analytics, reporting, and AI/ML teams.