Sr Databricks Data Engineer

$116,200 – $229,100 · Posted 1 day ago

San DiegoLast seen today

Summary

Senior-level data engineer responsible for designing and implementing cloud-based data solutions on Databricks (AWS, Azure, or GCP), with expertise in Lakehouse architecture, Apache Spark, Delta Lake, and distributed compute platforms. Lead cross-functional data engineering teams and projects, oversee CI/CD automation, and consult on data governance, security, and compliance strategies. Manage complex data pipelines using Delta Live Tables, Autoloader, Structured Streaming, Databricks Workflows, and Apache Airflow, with demonstrated ability to optimize performance and mentor technical staff.

Data Science DevOps / Infrastructure AWS Azure AI Apache Airflow Apache Spark Autoloader AWS Code Pipeline Azure DevOps CI CD Data Lakes Data Quality Frameworks Data Warehousing Databricks Databricks Workflows Delta Lake Delta Live Tables Dimensional Modeling GCP Jenkins Lakehouse Architecture Machine Learning Metadata Driven Ingestion Powershell Pyspark Structured Streaming Unity Catalog