databricks jobs in San Diego

Senior Software Engineer responsible for designing and operating Affirm's analytical data platform, including secure data access patterns, CI/CD integration, self-service automation, and observability infrastructure. The role requires hands-on expertise with cloud data platforms (Snowflake, Databricks, BigQuery), containerization, API integrations, and Python/SQL backend work.…See more You'll participate in on-call coverage, triage production incidents, and help build next-generation capabilities including semantic layers and AI-native data tooling while setting high engineering standards across the platform.

As a Data Engineer at Booz Allen Hamilton, you will design, develop, and deploy data pipelines and platforms that organize disparate data sources to support mission-critical analytics workloads. You'll work with ETL operations, relational and non-relational databases, and collaborate with analysts, developers, and data scientists in an agile environment.…See more Required skills include Python, SQL, Git, Linux/Windows automation, and experience with pipeline development or systems administration. The role emphasizes building scalable, maintainable data infrastructure that transforms raw data into actionable insights.

Enterprise Architect Director responsible for defining strategic architecture direction across core enterprise platforms (ERP, CRM, PLM, SCM, quality, laboratory, financial systems) and establishing enterprise-wide integration, API, data, cloud, security, and AI architecture standards. The role requires 12+ years of progressive IT experience with 8+ years in enterprise architecture, strong expertise in integration patterns, modern data platforms, public cloud (AWS/Azure), AI/generative AI, and proven leadership on complex portfolio rationalization and M&A programs.…See more This position influences executive leadership on technology strategy, manages architecture practice budgets and resources, and ensures compliance with GxP, 21 CFR Part 11, and GAMP 5 requirements.

Principal Engineer leading the design, build, and operation of a Microsoft Fabric–based unified data platform (UDP) serving 50+ enterprise source systems across R&D, Commercial, Manufacturing, and Supply Chain. You will architect production-grade data ingestion pipelines, mentor data and analytics engineers, enforce engineering standards and SLAs, manage external implementation partners, and build the semantic layer and governance controls.…See more The role requires 10+ years of data engineering and platform architecture experience, 2+ years of technical leadership in a lakehouse environment, and deep hands-on expertise in Microsoft Fabric (lakehouses, Data Factory, deployment pipelines), PySpark, T-SQL, Python, medallion-architecture design, CI/CD, and data governance tooling—with biopharmaceutical or regulated-industry GxP experience strongly preferred.

Principal Engineer Data will develop and execute a data architecture strategy aligned with business goals, building and maintaining data models, metadata standards, and integration frameworks. The role requires leading technical assessments for digitizing core business functions, working with stakeholders to translate requirements into architectural solutions, and ensuring data storage, retrieval, and governance meet enterprise standards.…See more The candidate must have a STEM degree with at least 5 years of experience (or Master's with 3 years), strong expertise in SQL Server, data visualization tools (Tableau, Power BI), and data architecture principles including data integration, governance, and security protocols.

Senior Staff Technical Data Analyst responsible for data exploration, quality assessment, and governance across Finance Technology initiatives, including AI/ML pipelines and SOX-compliant financial reporting. Design and build end-to-end BI solutions using SQL, Python, Qlik, Databricks, and Tableau while identifying where GenAI and agentic approaches can modernize financial controls, anomaly detection, and self-service analytics.…See more Partner with Finance stakeholders (FP&A, Accounting, Revenue) to translate business requirements into technical solutions, and mentor junior analysts on craft standards for data quality and documentation. Requires 10+ years in data analytics or BI supporting Finance, Accounting, or regulated compliance functions, with proven expertise in cloud data platforms, data governance frameworks, SOX controls, and active hands-on experience with generative AI tools.

Data Analyst role focused on supply chain performance and insights at a global medical device company. The analyst will build dashboards and reporting solutions using Tableau/Power BI, query large datasets with SQL, and develop self-service and AI-enabled analytics capabilities to support distribution, logistics, and supply chain stakeholders across multiple regions.…See more The role requires 3+ years of analytics experience, strong Excel and SQL skills, demonstrated AI literacy, and the ability to translate business questions into actionable insights. Candidates should be comfortable supporting global teams across time zones and identifying operational trends that drive decision-making.

Lead a team of data scientists at Insulet's Analytics Center of Excellence, managing the execution of global analytics and AI initiatives while maintaining hands-on expertise in data science work. You will mentor scientists, guide development of cloud-based analytics pipelines and automated machine learning solutions, and coordinate with cross-functional stakeholders across R&D, clinical, quality, and manufacturing to identify and deliver high-value data science opportunities.…See more The role requires a Master's degree with 5+ years in data science (or PhD with 3+), 2+ years in machine learning/AI, direct team management experience, and proficiency in Python/R, SQL, cloud platforms (Azure/AWS/GCP), and big data technologies like Spark/Databricks. You'll perform statistical analysis, predictive modeling, and communicate insights to executives while owning the data products portfolio and managing annual budgets.

Staff Data Engineer at Qualcomm responsible for designing, building, and maintaining scalable batch and streaming data pipelines on AWS and Databricks. Develop reusable data engineering frameworks, libraries, and templates while implementing AI-driven automation for schema inference, data quality checks, pipeline orchestration, and self-healing mechanisms.…See more Lead reliability and operations efforts by defining SLIs/SLOs, participating in incident response, and driving performance tuning and cost optimization. Mentor junior engineers, collaborate across analytics and platform teams, and drive adoption of standardized data frameworks and best practices.

Lead large-scale enterprise data transformation programs at Qualcomm, managing multi-year initiatives across data modernization, cloud migration, and analytics platforms. Coordinate work across distributed data engineering, architecture, governance, security, and analytics teams while managing multi-million-dollar budgets and vendor relationships.…See more Drive adoption of modern data architectures (data lakehouse, data mesh, medallion patterns) and cloud platforms (Databricks, AWS, Azure, GCP), and establish federated data governance frameworks. Influence executives and technical stakeholders to deliver measurable business outcomes while handling legacy system retirement and enterprise data integration from CRM, ERP, HCM, and supply-chain systems.

A forward-deployed engineer who builds and deploys AI/GenAI-powered solutions on Databricks and cloud platforms for forensic discovery and financial crime clients. The role requires hands-on expertise in Databricks, cloud services (AWS/Azure/GCP), and production AI/LLM systems, combined with the ability to lead client engagements, translate business requirements into technical architectures, and troubleshoot integration issues across enterprise environments.…See more You will design reusable assets, document workflows, and enable client teams to sustain delivered solutions while navigating security, compliance, and privacy reviews.

This role combines Business Intelligence development with Navy ERP (SAP) functional expertise to design and sustain reporting solutions, dashboards, and automated data pipelines for Navy financial operations. The developer will use Databricks, Qlik, Tableau, SQL, Spark, and Python to build analytics tools and data models while applying deep functional knowledge of SAP modules (FM, FI, CO, PS, MM, WM, SD, WFM) and financial business rules.…See more Responsibilities include developing executive dashboards, creating automated data delivery workflows via AWS S3 and email, integrating data from multiple systems (Jupiter, Navy ERP, Oracle), and supporting user acceptance testing and stakeholder training. The role requires hands-on BI development, SAP functional analysis, application development using NetWeaver and ABAP, and collaboration across functional teams to ensure data quality and audit compliance.

Design, implement, and troubleshoot AI/LLM-enabled software solutions for Navy cyber missions, including scripts, services, APIs, and automation workflows. Integrate systems across REST/HTTP APIs, relational and NoSQL data stores, and cloud or enterprise environments while respecting RMF controls and secure engineering practices.…See more Translate mission and security requirements into concrete technical tasks, deliver hands-on code in Python, and communicate trade-offs to both technical and non-technical stakeholders. Work in small Agile teams using Git and code review practices, with mentorship to reduce cyber risk across fleet and ashore enterprise.

This Systems Test Engineer role focuses on analyzing system faults and errors in Zoox's autonomous vehicle platform using data analytics on both road-test and simulation data. You will diagnose issues across perception, planning, and AI software; prioritize problems by severity and safety impact; identify failure trends; and develop tools and workflows for quality improvement.…See more The role requires 5+ years of systems troubleshooting experience, proficiency in Python, strong root cause analysis skills, and a background preferably in automotive or embedded systems.

Senior Data Architect with 15+ years of experience designing and implementing enterprise data platforms that support modern AI/ML and Generative AI applications. Must have strong hands-on expertise in ETL/ELT, Python, SQL, and enterprise data warehousing, with production experience in Treasure Data, real-time analytics, streaming pipelines (Apache Kafka), and AI-ready data architectures including RAG, vector databases, and LLM integrations (LangChain, LangGraph, Azure OpenAI, AWS Bedrock).…See more Will design batch and real-time enterprise data architectures on cloud platforms (AWS, Azure, GCP, Snowflake, Databricks) with CDC/Debezium incremental processing capabilities.

Build, deploy, and continuously improve MITRE ATT&CK–aligned threat detections across cloud, endpoint, identity, email, and application telemetry. Own the full detection lifecycle from hypothesis and data validation through deployment, tuning, and retirement, advancing a detection-as-code platform with version control, peer review, automated testing, and CI/CD.…See more Evaluate AI-powered security capabilities including LLMs, anomaly detection, and response automation. Partner with Security Operations on investigations, incidents, and detection maintenance.

The Data Integrator will design and optimize SQL queries, build advanced DAX reports in Power BI, and integrate data from multiple APIs, databases, and files at scale. The role requires 3+ years of data analysis and validation experience with Power BI, DAX, Power Query, Azure Data Flow, and SQL, plus strong communication skills to gather requirements and deliver solutions to end users.…See more The person will maintain these data pipelines and coordinate with management throughout the development lifecycle using modern Azure and data tools.

Lead hands-on modernization of legacy SSIS/SSRS ETL workloads into cloud-native Lakehouse pipelines using Databricks, dbt, Fivetran, and Airflow. Design and enforce standardized data frameworks (ingestion, transformation, curation, consumption), drive CI/CD and observability practices, and mentor engineers on modern data engineering patterns.…See more Evaluate emerging technologies (Delta Live Tables, Iceberg, streaming, AI-driven observability) through POCs and POVs, and leverage AI-assisted tools (Databricks Assistant, GitHub Copilot, Cursor AI) to accelerate development and reduce technical debt. Optimize Spark workloads and orchestration across Azure and GCP environments while partnering with architects, platform engineers, and business stakeholders.

The Enterprise AI FinOps Lead establishes financial governance for company-wide AI usage across multi-cloud (Azure, AWS, GCP), SaaS, and on-premise environments. The role owns cost visibility, show-back, optimization, budgeting, forecasting, and stakeholder engagement, with deep responsibility for AI-specific cost drivers such as tokens, models, prompts, embeddings, and RAG systems.…See more The leader translates telemetry into actionable insights, optimization programs, and executive reporting while managing the full departmental budget. This is a hands-on operator role requiring 8+ years in FinOps, cloud cost management, or enterprise finance, with strong analytical, stakeholder management, and executive communication skills.

Principal Engineer leading the design, build, and operation of an enterprise data platform serving 50+ source systems across R&D, manufacturing, supply chain, and business functions. Responsible for hands-on architecture of medallion-layer pipelines using Microsoft Fabric, technical leadership and mentorship of data engineers, vendor management, data governance implementation, and platform reliability—balancing feature delivery with security, compliance (GxP), and operational excellence in a regulated biopharmaceutical environment.See more

Design, build, and operate enterprise-scale Databricks lakehouse platforms for a global semiconductor company. Lead AI-native development practices, machine learning enablement, and AIOps automation while mentoring engineering teams and establishing technical standards.…See more Drive platform modernization, cloud-native practices, and intelligent data/AI infrastructure at scale. Requires 4–5 years of hands-on Databricks experience, strong Python/SQL/Spark skills, MLOps expertise, and proven technical leadership.

Design and review data engineering solution architectures on Databricks and AWS, aligning technical decisions with business goals. Lead enterprise-scale data migration and modernization programs, providing architectural guidance and technical leadership across client and internal teams.…See more Demonstrate hands-on expertise in PySpark, SQL, data warehousing, CI/CD pipelines, and data governance frameworks. Mentor team members and foster a knowledge-sharing culture while driving smooth project execution and transition.

The role seeks a Databricks & AWS Data Engineering Architect to lead enterprise-scale data migration and modernization programs for a banking client. The architect will design and implement data solutions using Databricks, PySpark, SQL, and AWS, with responsibility for CI/CD pipelines, data governance frameworks, and data quality monitoring.…See more Required skills include hands-on expertise in data engineering, data warehousing, and data architecture, along with leadership capabilities to manage stakeholders and drive engineering best practices across the organization.

Lead the design, build, and operation of enterprise-scale Databricks Lakehouse platforms at Qualcomm, driving AI-native development, MLOps practices, and cloud modernization. This hands-on Staff IT Engineer role requires 4–5 years of Databricks experience and 8–12 years total IT background, with responsibility for platform architecture (Delta Lake, Unity Catalog, Workflows), machine learning enablement (MLflow, Mosaic AI), AIOps automation, and technical mentoring of engineers.…See more You will establish engineering standards, optimize platform performance and cost, implement observability and self-healing automation, and drive adoption of generative AI tools and intelligent automation across development teams.

Senior Data Engineer responsible for designing and implementing cloud data platforms (Databricks, Snowflake, BigQuery) and enterprise-scale data warehouses using Medallion Architecture. Will develop scalable ETL pipelines, optimize Spark jobs, integrate ML models into data workflows, and implement data governance and lineage tracking.…See more The role requires hands-on expertise in Python, PySpark, SQL, and AWS services, plus experience with AI/ML integration, DevOps practices (Terraform, CI/CD), and mentoring junior engineers and analysts.