etl jobs in San Diego

Design, build, and maintain scalable batch and streaming data pipelines on AWS and Databricks, developing reusable data engineering frameworks and standardized patterns for ingestion, transformation, and validation. Leverage AI-based techniques to automate data quality checks, anomaly detection, and pipeline self-healing.…See more Define SLIs/SLOs, participate in on-call rotations, and mentor junior engineers while driving adoption of data frameworks and best practices across analytics, reporting, and AI/ML teams.

As a Data Engineer at Booz Allen Hamilton, you will develop and deploy data pipelines and platforms that organize disparate data sources to yield actionable insights for mission-critical applications. You'll work with Python, SQL, or similar languages to build ETL operations, manage relational and non-relational databases, and support analytics workloads on cloud platforms.…See more The role requires 1+ years of data engineering, ETL, or pipeline development experience, proficiency with source control (GitHub/Atlassian), and Linux/Windows scripting. You'll collaborate with analysts, developers, and data scientists in an agile environment to design, develop, and maintain scalable data solutions.

Own the product direction, roadmap, and prioritization for a ground-up AI-accelerated migration platform that helps law firms move onto the CARET Legal practice management system. You will translate complex migration and onboarding challenges into well-scoped product opportunities, work closely with an Engineering Tech Lead on technical architecture, and partner with migration/operations teams to deliver measurable customer and business outcomes.…See more The role requires deep technical fluency with data flows and system behavior, strong judgment about scope and tradeoffs, and the ability to engage directly with engineers and cross-functional stakeholders. You'll define success metrics around time-to-value, cutover experience, delivery predictability, and quality while balancing platform investment with customer commitments.

Build and integrate oncology applications across laboratory systems, data pipelines, and enterprise platforms at Eli Lilly. Develop AI-enabled capabilities for data retrieval, extraction, and analysis while owning application reliability, user support, and lifecycle planning.…See more Deploy on Lilly cloud infrastructure using modern server-side frameworks (Python/Django/Flask preferred), front-end technologies (JavaScript/TypeScript), relational databases, and CI/CD pipelines. Mentor junior engineers and collaborate directly with scientific and operational stakeholders.

As a Sr. Technical Product Manager for Data at Petco, you will own the vision, roadmap, and delivery of enterprise data products that power analytics, personalization, and AI-driven decision-making across the organization.…See more You'll translate business needs into technical requirements, define data-quality standards and governance practices, and partner with data engineers, architects, analysts, and business stakeholders to build trusted, reusable data products. The role requires 5+ years of product management experience with strong technical depth in data warehousing, ETL/ELT, SQL, and data modeling, plus expertise managing Agile backlogs and cross-functional delivery on modern cloud platforms like Google Cloud and BigQuery.

Sr. Technical Product Manager who will own the vision, roadmap, and delivery of enterprise data products across Petco's business domains (customer, loyalty, sales, inventory, marketing, finance).…See more The role bridges business stakeholders with data engineering, analytics, architecture, and governance teams—translating requirements into data models, defining quality standards, data contracts, and metric definitions. You'll drive adoption of governed data products built on Google Cloud and BigQuery, manage cross-functional delivery, and champion data governance practices. Required: 5+ years of product management with technical product ownership or data product management experience, strong SQL and data warehousing expertise, and proficiency with ETL/ELT, APIs, data quality, and BI tools.

Principal Systems Architect responsible for defining and maintaining the technical architecture of a complex enterprise automation ecosystem spanning RPA, Machine Learning, and GenAI. Will architect data pipelines integrating diverse enterprise systems (SAP, ERP, QMS, PowerBI, Windchill, Atlassian), provide technical leadership on workflow automation and DevSecOps infrastructure, and ensure end-to-end cybersecurity compliance with DoD standards and CMMC.…See more Role requires 14+ years of progressive IT systems architecture experience, demonstrating systems engineering expertise in complex data integration, AI/ML automation, and secure deployment across engineering, manufacturing, quality, and finance domains.

Staff Automation Engineer responsible for developing, testing, and maintaining production automation systems, data pipelines, and workflow tools that support engineering organizations. The role requires strong Python and Linux expertise, SQL/database knowledge, and experience building maintainable backend systems and automation workflows.…See more Responsibilities include troubleshooting production issues, improving system reliability and monitoring, integrating data from multiple sources, and leveraging AI-assisted development tools to accelerate implementation and testing. This is a hands-on individual contributor role focused on execution, delivery, and knowledge transfer during an organizational transition.

As a Forward Deployed Engineer, you'll design and build production-grade data pipelines and ontologies within Palantir Foundry to solve mission-critical problems for defense clients. You'll translate complex mission requirements into technical architectures, develop workflows and decision-support capabilities, and collaborate with engineers, analysts, and stakeholders to deploy Foundry-based applications.…See more The role requires 3+ years in software, data analytics, or platform engineering with hands-on Foundry and ontology design experience, plus the ability to work embedded at client sites and obtain a Secret clearance.

As a Salesforce Systems Analyst at Qualcomm, you will develop customized solutions within the Salesforce platform (Service Cloud, Sales Cloud, Communities, custom applications) to support critical business functions. You will gather and translate business requirements into well-architected solutions, manage daily support and maintenance of assigned Salesforce applications, and integrate them with on-premise systems using web services or ETL processes.…See more Required experience includes 1+ years as a Salesforce Administrator in a large corporate organization, 1+ years developing Salesforce applications using Apex, Lightning, Visualforce, and JavaScript, and familiarity with object modeling, SOQL, REST/SOAP APIs, and ETL tools like Informatica Cloud. You will work collaboratively with global development teams in an agile environment to deliver solutions on time.

SAIC seeks a Principal Software Engineer to design and implement streaming data platforms and machine-learning systems for government clients. The role involves full-stack development in Python, Java, or JavaScript, Kubernetes deployment, ETL/data pipeline work, and direct client collaboration on custom applications.…See more The position requires 9 years of experience (or 7 with a Master's degree), a Top Secret clearance with TS/SCI eligibility, and hands-on proficiency in cloud platforms (AWS/Azure), databases (SQL, Postgres, MongoDB), and Linux.

Software Engineer at Eli Lilly developing oncology applications that integrate laboratory systems, data pipelines, and enterprise platforms. The role requires 5+ years of software engineering experience and involves building AI-enabled capabilities, designing scalable APIs and web applications, deploying to AWS cloud infrastructure, and owning application reliability and lifecycle.…See more Key responsibilities include implementing data quality standards, contributing to CI/CD and containerization practices, mentoring junior engineers, and working directly with scientific and operational stakeholders.

SAIC seeks a Principal Software Engineer to design and deploy streaming data platforms and machine-learning systems for defense/mission clients. You will perform full-stack development (Python, Java, JavaScript) with cloud technologies (AWS, Azure), manage Kubernetes deployments, build data-driven applications with ETL pipelines, and provide client technical support and documentation.…See more The role requires 9 years of experience (or 7 with a Master's), a Top Secret clearance with ability to obtain TS/SCI, and hands-on expertise in cloud, databases, Linux, and big-data tools.

Senior architect and developer responsible for designing, developing, and maintaining enterprise Oracle CPQ solutions, including BML scripts, configuration, commerce rules, and document logic. Will develop and support Java/Java EE applications, middleware components, REST/SOAP APIs, custom web services, and enterprise integrations.…See more Requires 8+ years of hands-on Oracle CPQ development, 8+ years of Java application development (Spring, Tomcat, JDBC, Maven), 8+ years of web development (HTML, JavaScript, CSS, JSON, AJAX), and 8+ years of database experience (Oracle, SQL, PL/SQL, data modeling, ETL). Will perform platform upgrades, security patching, production support, root-cause analysis, and contribute across the full SDLC.

Design and develop software applications orchestrating complex automated laboratory workflows, closed-loop learning systems, and AI-integrated autonomous discovery ecosystems for biotherapeutics research. Build data pipelines, visualization tools, and machine learning models for visual inspection, predictive maintenance, and process optimization.…See more Create digital lab infrastructure including IoT integrations, digital lab twins, telemetry monitoring, and integrations across automation schedulers, LIMS, and data platforms. Requires Ph.D. in Computer Science/Software Engineering/Bioengineering with 3+ years industry experience (or M.S. with 10+ years, or B.S. with 13+ years), preferably in pharmaceutical or automation sectors.

Own and evolve the software translation layer between high-level workflow logic and low-level laboratory instrument control, integrating liquid handlers, plate readers, robotic workstations, and analytical instruments. Deploy and maintain containerized services using Docker, Kubernetes, GitOps, and CI/CD practices, building scalable Python applications and data pipelines that connect experimental readouts with LIMS and downstream analysis tools.…See more Collaborate with the team to prototype AI-driven decision-making and autonomous orchestration in lab workflows, evaluating LLM tooling and agent frameworks for practical applicability. Serve as a technical authority and mentor, influencing the broader technical roadmap for autonomous discovery systems and helping grow the automation engineering team's capability.

The Senior AI Data Engineer will architect and build Cortica's data ecosystem, owning end-to-end projects from requirements through production deployment. Responsibilities include designing scalable data pipelines, developing data models for clinical and financial reporting, and building internal tools and dashboards.…See more The role requires 5+ years of production data pipeline experience, 2+ years with AI-first development workflows, advanced Python and SQL proficiency, 4+ years with AWS/Azure big data services, and 2+ years with orchestration frameworks.

Design, build, and maintain real-time data ingestion pipelines that reliably stream data from diverse sources into a production data platform. You will ensure data quality, observability, and scalability while monitoring pipeline health, building resilient systems with proper error handling and backpressure strategies, and automating monitoring and alerting for timeliness and data issues.…See more Partner with data engineers, platform engineers, and analytics teams to configure pipelines for reliability, perform root cause analysis on outages, and work with security teams on encryption and data governance. Proficiency required in Python and bash scripting, plus hands-on experience with tools like Kafka, NiFi, Flink, Spark, Snowflake, Grafana, and Prometheus.

Design, build, and maintain real-time data ingestion pipelines that reliably stream data from multiple sources into a centralized data platform. You will ensure data quality, observability, and low-latency delivery while collaborating with data engineers, platform engineers, and analytics teams.…See more Responsibilities include building resilient pipelines with error handling, automating monitoring and alerting for data issues, performing root cause analysis on outages, and partnering with security teams on encryption and data governance. You must demonstrate proficiency in Python and bash scripting, familiarity with tools like Kafka, NiFi, Spark Streaming, Snowflake, and Elasticsearch, and 3+ years of experience in data engineering or DevOps roles supporting production pipelines.

Design and implement enterprise data architecture solutions across on-premises and cloud environments, including data models, pipelines, governance frameworks, and integration patterns. Develop data pipeline blueprints, entity relationship diagrams, and manage data warehousing, cataloging, and quality standards.…See more Serve as a subject-matter expert for data architecture across DoD analytics platforms, Microsoft 365, and hybrid cloud environments. Coordinate with government technical leads, platform teams, and data stakeholders while managing data governance, security accreditations, and administrative requirements.

The Business Intelligence Analyst supports the Altman Clinical and Translational Research Institute (ACTRI) by monitoring performance metrics, interpreting dashboards, and preparing reports that inform strategic planning and continuous improvement. The role includes implementing data validation and quality checks, developing performance measurement frameworks, creating technical documentation, and managing KPIs across units and programs.…See more Required expertise includes business intelligence functions, data visualization (particularly Tableau), database management, and strong analytical and communication skills. The position combines technical support (data integrity, dashboard creation, system administration) with operational support (SOPs, requirements gathering, project management).

Software Engineer responsible for scoping and defining requirements, designing and implementing solutions using modern programming languages and technology stacks, and ensuring quality through secure coding practices and testing. The role involves converting customer requirements into refined visions, developing software interfaces across network protocols, integrating components into complex environments, and supporting both lab and on-site customer testing.…See more Requires 3–5+ years of relevant experience, strong understanding of SDLC, object-oriented programming, distributed systems, algorithms, and data structures. Travel up to 10% required.

Senior hands-on software engineer building the core orchestration, data systems, and internal tooling for an automated chemistry platform. You'll own problems end-to-end across the full stack—Python backend, TypeScript/React frontend, databases, APIs, and distributed systems—designing services, modeling data flows, and building interfaces that connect synthesis requests from intake through execution.…See more You'll work closely with automation engineers, chemists, and ML teams to ship production features, establish engineering practices, and become a primary owner of major platform components. The role prioritizes judgment and problem-solving over language expertise, expecting fluency across the stack and comfort reaching for languages like Rust, Go, or C++ when warranted.

Staff Software Engineer to architect and lead Intuit's next-generation One Logging system, designing high-scale, mission-critical logging pipelines for on-premise and public cloud (AWS, GCP) deployments. Own end-to-end platform evolution from log ingestion through routing, storage, and cost optimization, including components like FELS, Kinesis/CloudWatch integrations, and Log Router.…See more Lead modernization of legacy tooling, design edge collection agents (Fluent Bit, OIL sidecar), and drive automation initiatives using MCP Server capabilities. Provide technical leadership, mentorship, and cross-functional collaboration to align logging platform capabilities across the organization.

Design, build, and maintain data pipelines that ingest, transform, and load data from SQL Server, PostgreSQL, SaaS platforms like HubSpot, and internal applications into Snowflake. Develop and optimize data models, manage data quality and governance, and create dashboards and reports to support reporting and analytics use cases.…See more Collaborate with business stakeholders to gather requirements and translate them into scalable data solutions. Optimize query performance and storage efficiency within Snowflake while implementing best practices in documentation and pipeline monitoring.