data-pipeline jobs in San Diego

Design and build Python and SQL-based data transformation workflows using Databricks and PySpark for large-scale processing. Analyze unstructured datasets to independently identify actionable insights, translate ambiguous data problems into clear analytic solutions, and ensure data quality and governance across pipelines.…See more Troubleshoot pipeline issues, document processes and architecture, and partner with cross-functional teams to integrate data outputs into downstream applications and dashboards.

Design, build, and maintain data pipelines that ingest, transform, and load data from SQL Server, PostgreSQL, SaaS platforms (HubSpot), and internal applications into Snowflake. Develop and optimize data models, manage data ingestion using Azure Data Factory and data replication tools, and ensure data quality and integrity.…See more Collaborate with business stakeholders to translate analytics requirements into scalable solutions, develop dashboards and reports, and optimize query performance. Implement data governance best practices, monitor pipelines, and recommend technology improvements to support the company's data strategy.

SAIC seeks a Senior Software Engineer to integrate AI capabilities into expeditionary systems for the Navy, including sensor kits, unmanned systems, command & control, and TAK. The role spans hands-on development—maintaining Zenoh data mesh in Rust, building React frontends in JavaScript, integrating machine learning models, converting tactical message formats—and technical leadership with senior management.…See more Required qualifications include 9+ years as a software engineer, data engineer, or data scientist; expert Python; intermediate Rust or Go; experience with containerization, event streaming platforms (Kafka, Kinesis, RabbitMQ, Zenoh), tactical data standardization, and data pipeline deployment. Successful candidates will collaborate with ML engineers, systems engineers, and field teams to ensure high-quality data flow and operational performance.

Data Engineer II will maintain and enhance data infrastructure, pipelines, and models supporting manufacturing analytics and operational reporting at Dexcom. The role involves writing and optimizing SQL queries, supporting ETL/ELT pipeline development in BigQuery using tools like Google Cloud Dataflow, Apache Beam, and dbt, and troubleshooting data quality issues.…See more You will partner with business stakeholders to gather requirements, document data lineage and workflows, and develop foundational GCP cloud engineering skills. The ideal candidate has a technical degree or equivalent experience and enjoys solving practical operational problems while learning modern cloud data practices.