databricks-asset-bundles jobs in San Diego

Sr Manager leading a team of Platform Engineers/DataOps analysts to architect, deploy, and manage enterprise-scale Databricks Unity Catalog across dev/test/production environments. Responsibilities span platform governance, fine-grained access control (RBAC/ABAC), workspace automation via Terraform, CI/CD pipeline design (GitHub Actions, Azure DevOps, GitLab CI), FinOps optimization, and incident management for critical data infrastructure.…See more Requires 10+ years in data operations/platform engineering with 5+ years as a lead Databricks administrator, deep expertise in Unity Catalog governance, cloud security (IAM, VPC/VNet, compliance), and proficiency in Python, PySpark, and SQL.

Design and build production ETL/ELT pipelines ingesting data from databases, APIs, applications, and Microsoft 365 sources into Azure Databricks and Power BI. Own code quality, CI/CD automation, testing strategies, monitoring, and data validation across development, test, and production environments in Azure DevOps.…See more Develop transformations and curated data products for analytics and AI applications, including secure document ingestion, metadata indexing, and telemetry. Collaborate with business and technical stakeholders to communicate progress, data limitations, and risks while maintaining runbooks and technical documentation.