data-pipeline-orchestration jobs in San Diego

Staff Data Engineer to architect and build fault-tolerant, scalable big-data platforms supporting high-velocity analytics use cases across Intuit. Responsibilities include designing data normalization, lineage, governance, and discoverability systems; collaborating with product and engineering teams on extensible platform design; and enabling analytics and GenAI/ML initiatives.…See more Requires 8+ years in product/web analytics, advanced SQL and big-data technologies (Redshift, Spark, Hive, BigQuery), Python or Java/Scala, and data pipeline orchestration experience. Role includes code reviews, CI/CD process ownership, mentorship, and translating business strategy into data-driven insights.

Design, build, and maintain scalable batch and streaming data pipelines on AWS and Databricks, developing reusable data engineering frameworks and standardized patterns for ingestion, transformation, and validation. Leverage AI-based techniques to automate data quality checks, anomaly detection, and pipeline self-healing.…See more Define SLIs/SLOs, participate in on-call rotations, and mentor junior engineers while driving adoption of data frameworks and best practices across analytics, reporting, and AI/ML teams.