parquet jobs in San Diego

Staff Data Engineer at Illumina seeking a senior individual contributor with 10+ years building and scaling data products on Databricks and Snowflake. The role spans end-to-end ownership of data pipelines across Supply Chain, Manufacturing, and Quality domains, requiring advanced Python, SQL, and data modeling skills with hands-on expertise in Spark, Delta Lake, dbt, and distributed systems design.…See more Responsibilities include designing medallion-architecture data products, embedding governance and data quality, adopting AI in analytics workflows, and mentoring a global engineering team. The candidate will set technical standards, lead architecture decisions, and communicate trade-offs across business, AI, and platform stakeholders.

As an IC5 Senior Staff Engineer, you will architect and deliver large-scale distributed data platform components centered on Kafka, Apache Iceberg, and Apache Spark. You will lead complex technical initiatives, design high-performance data ingestion pipelines, and define engineering best practices across the organization.…See more The role demands deep expertise in distributed systems, JVM performance tuning, stream processing, and full-stack Data Lake solutions, with hands-on delivery of production systems and mentorship of engineering teams.

Staff Engineer leading the design and operation of Shield AI's data platform to support autonomous systems, ML workflows, and edge-to-cloud data flows. You will architect distributed storage and compute solutions, build first-party integrations for heterogeneous data sources, and establish operational standards for reliability, security, and observability.…See more The role requires deep expertise in data modeling, API design, distributed systems, Kubernetes infrastructure, and the ability to guide technical direction across autonomy, ML, test, and infrastructure teams.

Senior Software Engineer working on AI-integrated expeditionary systems for the Navy, designing and deploying tactical data pipelines that connect sensors, unmanned systems, and command-and-control platforms. Requires 10+ years in software engineering, data engineering, or related roles, with expert Python skills, containerization experience (Docker/Kubernetes), and hands-on expertise in tactical data formats, event streaming platforms, and system integration.…See more Will collaborate with ML engineers, data engineers, and systems engineers to normalize tactical data, integrate machine learning models, and ensure robust data flow in field-tested operational environments.

SAIC seeks a Senior Software Engineer to integrate AI capabilities into expeditionary systems for the Navy, including sensor kits, unmanned systems, command & control, and TAK. The role spans hands-on development—maintaining Zenoh data mesh in Rust, building React frontends in JavaScript, integrating machine learning models, converting tactical message formats—and technical leadership with senior management.…See more Required qualifications include 9+ years as a software engineer, data engineer, or data scientist; expert Python; intermediate Rust or Go; experience with containerization, event streaming platforms (Kafka, Kinesis, RabbitMQ, Zenoh), tactical data standardization, and data pipeline deployment. Successful candidates will collaborate with ML engineers, systems engineers, and field teams to ensure high-quality data flow and operational performance.