Principal Engineer leading the design, build, and operation of a Microsoft Fabric–based unified data platform (UDP) serving 50+ enterprise source systems across R&D, Commercial, Manufacturing, and Supply Chain. You will architect production-grade data ingestion pipelines, mentor data and analytics engineers, enforce engineering standards and SLAs, manage external implementation partners, and build the semantic layer and governance controls.… The role requires 10+ years of data engineering and platform architecture experience, 2+ years of technical leadership in a lakehouse environment, and deep hands-on expertise in Microsoft Fabric (lakehouses, Data Factory, deployment pipelines), PySpark, T-SQL, Python, medallion-architecture design, CI/CD, and data governance tooling—with biopharmaceutical or regulated-industry GxP experience strongly preferred.
lakehouse jobs in San Diego
Senior Data Architect with 15+ years of experience designing and implementing enterprise data platforms that support modern AI/ML and Generative AI applications. Must have strong hands-on expertise in ETL/ELT, Python, SQL, and enterprise data warehousing, with production experience in Treasure Data, real-time analytics, streaming pipelines (Apache Kafka), and AI-ready data architectures including RAG, vector databases, and LLM integrations (LangChain, LangGraph, Azure OpenAI, AWS Bedrock).… Will design batch and real-time enterprise data architectures on cloud platforms (AWS, Azure, GCP, Snowflake, Databricks) with CDC/Debezium incremental processing capabilities.
Sr. Manager overseeing a data engineering team with responsibility for hiring, coaching, and performance management while remaining hands-on with architecture, design reviews, and technical decisions.… The role requires designing and operating production data pipelines and lakehouse platforms using AWS (S3, Glue, Athena, Lambda) and Snowflake, with hands-on proficiency in SQL and Python. Responsibilities include establishing data governance, compliance, security controls, CI/CD practices, and collaborating across engineering, analytics, product, and clinical teams to translate requirements into platform capabilities. The manager must balance delivery priorities, technical debt reduction, operational excellence, and emerging-technology evaluation while driving outcomes that affect broader business objectives.
Data Engineering Manager
ExpiredLead a Data Engineering team to establish modern DataOps and CI/CD practices, mentor engineers in PySpark, SQL, dbt, Fivetran, and cloud-native development, and design scalable data infrastructure across GCP, Azure, and AWS cloud data warehouses (BigQuery, Snowflake, Databricks). Manage technical delivery, collaborate across enterprise teams to develop end-to-end data solutions, and align data initiatives with business goals while remaining current on industry trends.
Senior architect responsible for designing and leading enterprise-scale data platforms on Databricks and AWS, including cloud modernization, data migration, and lakehouse architecture. Requires deep expertise in PySpark, advanced SQL, Delta Lake, and data warehousing patterns, with accountability for technical strategy, solution design, and mentoring engineering teams.… Will drive CI/CD practices, data governance frameworks, data quality standards, and technical decision-making across complex data infrastructure initiatives. Expected to engage senior stakeholders, manage client relationships, and champion AI-powered engineering tools for productivity and automation.
Enterprise Data & Analytics Architect responsible for designing and developing SQL Server databases, data warehouses, and ETL pipelines using SSIS/Azure Data Factory. The role requires 8–10 years of experience in OLAP/OLTP environments, expert SQL Server knowledge, and proficiency in enterprise reporting (SSRS, Power BI).… Candidates will oversee data engineering, BI development, and data science initiatives; mentor developers; and maintain compliance with company policies and federal regulations.
RIVO is seeking a Senior Data Platform Engineer to architect and build a modern enterprise data platform supporting analytics, machine learning, and near real-time processing. You will design the foundational data warehouse or lakehouse architecture, modernize legacy ETL processes, implement CDC-based ingestion and low-latency pipelines, and establish data quality and governance frameworks.… This role requires 8+ years of data warehousing or platform engineering experience, expertise in cloud platforms (Snowflake, Databricks, Azure), SQL and Python proficiency, and the ability to support both analytics and data science workloads at enterprise scale.
Staff Analytics Engineer responsible for designing and operationalizing agentic AI workflows, ML models, and Databricks applications at scale. Will build multi-step agent pipelines combining rules, ML models, and reasoning to solve complex business problems, then productionize them with monitoring, drift detection, and retraining strategies.… Requires 5+ years of hands-on ML engineering or data science with production system ownership, deep Python proficiency, strong traditional ML foundations, and proven Databricks expertise including notebook apps, dashboards, and ML pipelines. Will serve as technical authority, mentor peers, and influence architectural decisions across teams.
Enterprise Data & Analytics Architect responsible for designing and maintaining SQL Server databases, developing ETL pipelines using SSIS or Azure Data Factory, and creating enterprise reporting solutions with SSRS and Power BI. The role requires 8+ years of database engineering in OLAP/OLTP environments, expert SQL Server knowledge, and experience migrating processes to Azure.… Candidates will oversee documentation, mentor developers, and stay current with data engineering, BI, and cloud computing trends while ensuring compliance with company and federal regulations.
Staff-level data engineer who designs, develops, and maintains scalable ETL/ELT pipelines using Databricks, PySpark, and Python for enterprise analytics and AI use cases. Builds curated data layers following Lakehouse Medallion architecture, develops Databricks-native applications (notebooks, dashboards, APIs), and optimizes Apache Spark workloads for performance and cost efficiency.… Owns production data pipelines end-to-end, ensures data quality and reliability, and acts as a technical leader mentoring teams on data engineering best practices and modern Databricks capabilities.