apache-airflow jobs in San Diego

SHEIN is seeking a Senior Data Engineer to build and productionize GenAI/LLM solutions for data engineering workflows, including code assistance, metadata discovery, and knowledge access. The role focuses on developing RAG and agentic workflows, automating incident triage and log analysis, and integrating AI capabilities into internal developer tools and services.…See more You'll own scoped projects from problem definition through production support, requiring 3+ years of hands-on production experience with strong Python/SQL fundamentals, proven GenAI/LLM application development, and practical knowledge of databases, APIs, data pipelines, and distributed systems.

The SW Test Development Engineer 2 will design, develop, and maintain automated and manual test scripts for Dexcom's CGM software and data platform systems. You'll write API and UI tests, create verification and validation test plans, analyze failures with development teams, and contribute to release improvements.…See more The role requires 2–5 years of hands-on software or test development experience with Python or OOP languages, SQL/NoSQL databases, API testing frameworks (Robot framework), and cloud platforms (GCP/AWS); additional experience with Docker, Kubernetes, Kafka, BigQuery, and Airflow is highly valued. You'll mentor junior engineers and work cross-functionally in an Agile environment.

As a SW Test Development Engineer 2 at Dexcom, you will design, develop, and maintain automated and manual test scripts for CGM software systems, including API and UI testing. You will create verification and validation test plans, traceability matrices, and track issues while collaborating with development teams on root cause analysis.…See more The role requires 2–5 years of hands-on software test development experience with Python or other OOP languages, SQL/NoSQL databases, API testing frameworks (including Robot Framework), and cloud platforms (GCP/AWS). You will also mentor junior engineers and contribute to release process improvements.

The System Administrator Expeditionary Systems (OpAI) will maintain and integrate AI capabilities into Naval expeditionary systems, including sensor kits, unmanned systems, C2 platforms, and TAK. Daily responsibilities span hands-on troubleshooting of network connectivity and Linux systems, updating edge servers, testing machine learning capabilities, and ensuring high-quality data flow between tactical systems.…See more The role requires 3+ years of experience in system administration, data engineering, or related fields, with intermediate Linux proficiency, familiarity with edge servers and containerization (Docker, Kubernetes), and experience with tactical data pipelines. The successful candidate will collaborate with engineers, ML specialists, and data teams to integrate cutting-edge AI solutions while supporting operational forces.

Senior Data Engineer role focused on building and productionizing GenAI/LLM solutions for data engineering workflows. You will develop RAG and agentic workflows, automate incident triage and root-cause analysis, integrate AI capabilities into internal developer tools, and own projects from problem definition through production support.…See more Required: 3+ years of production systems experience, strong Python/SQL, hands-on GenAI/LLM application building, and software engineering fundamentals including testing, CI/CD, and monitoring.

Senior Software Engineer working on AI-integrated expeditionary systems for the Navy, designing and deploying tactical data pipelines that connect sensors, unmanned systems, and command-and-control platforms. Requires 10+ years in software engineering, data engineering, or related roles, with expert Python skills, containerization experience (Docker/Kubernetes), and hands-on expertise in tactical data formats, event streaming platforms, and system integration.…See more Will collaborate with ML engineers, data engineers, and systems engineers to normalize tactical data, integrate machine learning models, and ensure robust data flow in field-tested operational environments.

The System Administrator Expeditionary Systems (OpAI) will maintain and troubleshoot tactical systems integrating AI capabilities into Naval expeditionary platforms, including sensors, unmanned systems, and command-and-control infrastructure. Daily responsibilities span hands-on system administration (Linux, edge servers, software updates), testing machine learning capabilities in field environments, and collaborating with engineers to deploy and monitor data pipelines connecting tactical systems.…See more The role requires 3+ years in system administration, data engineering, or related technical fields, with intermediate Linux command-line proficiency, familiarity with containerization (Docker, Kubernetes), edge computing platforms (Jetson Nano, DGX), and troubleshooting of tactical data architectures. The candidate will work closely with machine learning engineers, data engineers, and software engineers to ensure performant, reliable data flow across integrated systems.

Senior Forward Deployed Engineer responsible for building and deploying GenAI/LLM-powered solutions on AWS, working directly with enterprise clients to translate business needs into production AI systems. The role requires 5+ years of software/data engineering experience, 1+ years hands-on with AWS AI&Data services (Bedrock, Neptune, OpenSearch), and the ability to lead technical workstreams while mentoring team members.…See more You will prototype solutions, develop scalable AI patterns with human-in-the-loop controls, write production-quality code with strong testing and CI/CD practices, and create reusable assets including code libraries and reference implementations. 50% travel required.

Forward Deployed Engineer who partners with enterprise clients to identify business needs and prototype production-grade GenAI/LLM solutions on AWS. Designs and builds AI-enabled agentic platforms, workflows, and scalable engineering patterns using AWS AI&Data services (Bedrock, Neptune, OpenSearch).…See more Delivers production-quality code with strong testing, CI/CD, logging, and documentation practices while mentoring team members and translating complex business problems into technical AI solutions.

Senior/Staff Data Engineer responsible for building production data pipelines, APIs, and BI tools that serve Agoda's contact center operations. Will design and maintain dashboards, metrics, and analytics platforms using SQL, Python, Java, Golang, or TypeScript; work with data warehouses like BigQuery, Snowflake, or Redshift; and orchestrate ETL/ELT workflows using tools such as Airflow or dbt.…See more At Staff level, defines roadmap for key data platforms, mentors junior engineers, and influences cross-team data architecture to scale with business growth.

Senior Microsoft Forward Deployed Engineer who will design, build, and deploy GenAI/LLM-powered solutions for government clients, translating business problems into production-grade AI systems. The role requires 7+ years of software/data engineering experience, 1+ years hands-on with GenAI/LLM solutions, and deep expertise in Microsoft Azure (AI Foundry, OpenAI, AI Search), Python/TypeScript/C#, and Copilot extensibility.…See more You will lead project workstreams, work directly with client technical teams in fast-paced environments, and mentor others while building reliable, maintainable, well-documented code. 50% travel required.

SAIC seeks an experienced System Administrator to maintain and integrate AI capabilities into expeditionary systems for the Navy, including sensors, unmanned systems, command-and-control, and TAK. The role combines hands-on administration (Linux systems, edge servers, software updates, network troubleshooting) with collaboration on machine learning integration, data pipeline monitoring, and tactical system testing at field exercises.…See more The candidate will work across cross-functional teams—including ML engineers, data engineers, and software engineers—to deploy and validate high-performance data flows in operational environments. Requirements include 2+ years in a related technical role (sysadmin, data engineer, software engineer, or similar), intermediate Linux command-line proficiency, familiarity with containerization (Docker, Kubernetes) and edge GPUs (Jetson Nano, DGX), and experience with tactical system troubleshooting and data pipeline deployment.

Build and operate the data and ML infrastructure powering an AI platform for materials science, owning both sides: data pipelines that ingest and curate large-scale scientific output into training-ready formats, and model packaging, serving, monitoring, and CI/CD systems that move models safely from research to production across customer environments. You will design data ingestion and transformation workflows, implement validation and quality gates, package and version models with reproducible builds, run models through batch and online inference with safe rollout and rollback, monitor for drift and degradation, and build observability and internal tooling for engineering and science teams.…See more The role requires 6+ years shipping production software with deep expertise in data systems, ML infrastructure, containers, orchestration, and observability.

The Data Architect is a hands-on technical leader responsible for designing and modernizing enterprise data architecture across on-premises and cloud platforms. The role defines scalable data models, integration patterns, and architectural standards for the Data Lake, Data Warehouse, ODS, and cloud platforms while ensuring security, resilience, and high performance.…See more Working closely with engineering, analytics, and business teams, the architect provides technical guidance on modern data systems, governance frameworks, and ETL/ELT pipelines. The position combines strategic vision with practical experience optimizing structured, semi-structured, and unstructured workloads across SQL, NoSQL, and cloud-native systems.

The Data Architect is a hands-on technical leader responsible for designing and modernizing enterprise data architecture across on-premises and cloud platforms. The role defines scalable data models, cloud-native integration patterns, and architectural standards supporting analytics, reporting, and digital banking applications.…See more This position combines strategic architectural vision with practical expertise in designing, implementing, and optimizing modern data systems across structured, semi-structured, and unstructured workloads. The architect provides technical leadership to Data Engineers and cross-functional teams while ensuring secure, resilient, and high-performing data environments.

Design, build, and scale ETL/ELT pipelines and cloud data warehouse infrastructure using Python, SQL, and modern orchestration tools like Apache Airflow or Prefect. Own the end-to-end data infrastructure that powers business intelligence and operational reporting, including data quality checks, anomaly detection, and performance optimization.…See more Collaborate with analytics and software engineering teams to define data modeling standards and maintain infrastructure-as-code deployments using Terraform and CI/CD. Requires 3–6 years of data engineering or backend development experience with advanced SQL, Python, and hands-on work with cloud data warehouses like Snowflake or BigQuery.

Join Singular Genomics' core software team as a generalist Software Engineer contributing to the sequencing analysis pipeline, operational tooling, and field support. You'll work across Python development, CI/CD infrastructure (Jenkins, Bitbucket), HPC job execution, and diagnostic troubleshooting of production failures on genomic sequencers.…See more Responsibilities include pipeline bug fixes and features, build system maintenance, field triage, data handling logic, and developing lightweight web services and internal APIs. You need 2–5 years of professional experience, solid Python fundamentals, Linux/HPC familiarity, and the ability to debug and move fast across a large, real production codebase.