apache-iceberg jobs in San Diego

ServiceNow is hiring a Staff Software Engineer to design and optimize data persistence infrastructure for the ServiceNow platform. You will write highly scalable code managing data lifecycles, data loss detection and recovery, and distributed storage systems, while collaborating with cross-functional teams on data architecture and telemetry.…See more The role requires 8+ years of software development experience (or equivalent with advanced degrees), deep expertise in Java, concurrency, relational databases, Kubernetes, and distributed systems like S3 and Apache Iceberg.

Lead the modernization of legacy SSIS/SSRS data systems into cloud-native Lakehouse pipelines using Databricks, dbt, Fivetran, and Airflow. Design standardized frameworks for ingestion, transformation, and consumption layers while driving CI/CD, observability, and engineering best practices across Azure and GCP.…See more Evaluate emerging technologies (Delta Live Tables, Iceberg, streaming ingestion) through POCs and POVs, and leverage AI-assisted tools (Databricks Assistant, Cursor AI, GitHub Copilot) to accelerate development and reduce technical debt. Provide technical guidance to the team and translate business requirements into scalable data solutions.

SAIC seeks a System Administrator for expeditionary systems integration, focusing on AI capabilities across sensor kits, unmanned systems, command-and-control, and TAK platforms. The role involves hands-on troubleshooting of network connectivity and OS updates on Linux edge servers, testing machine learning capabilities in field experiments, and collaborating with ML engineers and data engineers to integrate and monitor tactical data pipelines.…See more Responsibilities include building tactical systems for exercises, ensuring performant data flow between sensors and C2 systems, and working with software engineers to connect data infrastructure to operational systems. Required: 2+ years in system administration, data engineering, ML engineering, or related roles; intermediate Linux command-line proficiency; experience with edge servers, containerization (Docker/Kubernetes), and tactical system troubleshooting.

Staff Data Engineer at Illumina seeking a senior individual contributor with 10+ years building and scaling data products on Databricks and Snowflake. The role spans end-to-end ownership of data pipelines across Supply Chain, Manufacturing, and Quality domains, requiring advanced Python, SQL, and data modeling skills with hands-on expertise in Spark, Delta Lake, dbt, and distributed systems design.…See more Responsibilities include designing medallion-architecture data products, embedding governance and data quality, adopting AI in analytics workflows, and mentoring a global engineering team. The candidate will set technical standards, lead architecture decisions, and communicate trade-offs across business, AI, and platform stakeholders.

As an IC5 Senior Staff Engineer, you will architect and deliver large-scale distributed data platform components centered on Kafka, Apache Iceberg, and Apache Spark. You will lead complex technical initiatives, design high-performance data ingestion pipelines, and define engineering best practices across the organization.…See more The role demands deep expertise in distributed systems, JVM performance tuning, stream processing, and full-stack Data Lake solutions, with hands-on delivery of production systems and mentorship of engineering teams.

The System Administrator Expeditionary Systems (OpAI) will maintain and integrate AI capabilities into Naval expeditionary systems, including sensor kits, unmanned systems, C2 platforms, and TAK. Daily responsibilities span hands-on troubleshooting of network connectivity and Linux systems, updating edge servers, testing machine learning capabilities, and ensuring high-quality data flow between tactical systems.…See more The role requires 3+ years of experience in system administration, data engineering, or related fields, with intermediate Linux proficiency, familiarity with edge servers and containerization (Docker, Kubernetes), and experience with tactical data pipelines. The successful candidate will collaborate with engineers, ML specialists, and data teams to integrate cutting-edge AI solutions while supporting operational forces.

Senior Software Engineer working on AI-integrated expeditionary systems for the Navy, designing and deploying tactical data pipelines that connect sensors, unmanned systems, and command-and-control platforms. Requires 10+ years in software engineering, data engineering, or related roles, with expert Python skills, containerization experience (Docker/Kubernetes), and hands-on expertise in tactical data formats, event streaming platforms, and system integration.…See more Will collaborate with ML engineers, data engineers, and systems engineers to normalize tactical data, integrate machine learning models, and ensure robust data flow in field-tested operational environments.

The System Administrator Expeditionary Systems (OpAI) will maintain and troubleshoot tactical systems integrating AI capabilities into Naval expeditionary platforms, including sensors, unmanned systems, and command-and-control infrastructure. Daily responsibilities span hands-on system administration (Linux, edge servers, software updates), testing machine learning capabilities in field environments, and collaborating with engineers to deploy and monitor data pipelines connecting tactical systems.…See more The role requires 3+ years in system administration, data engineering, or related technical fields, with intermediate Linux command-line proficiency, familiarity with containerization (Docker, Kubernetes), edge computing platforms (Jetson Nano, DGX), and troubleshooting of tactical data architectures. The candidate will work closely with machine learning engineers, data engineers, and software engineers to ensure performant, reliable data flow across integrated systems.

SAIC seeks an experienced System Administrator to maintain and integrate AI capabilities into expeditionary systems for the Navy, including sensors, unmanned systems, command-and-control, and TAK. The role combines hands-on administration (Linux systems, edge servers, software updates, network troubleshooting) with collaboration on machine learning integration, data pipeline monitoring, and tactical system testing at field exercises.…See more The candidate will work across cross-functional teams—including ML engineers, data engineers, and software engineers—to deploy and validate high-performance data flows in operational environments. Requirements include 2+ years in a related technical role (sysadmin, data engineer, software engineer, or similar), intermediate Linux command-line proficiency, familiarity with containerization (Docker, Kubernetes) and edge GPUs (Jetson Nano, DGX), and experience with tactical system troubleshooting and data pipeline deployment.