Data Engineering Technical Lead
ExpiredSan DiegoLast seen 21 days ago
Summary
Lead the modernization of legacy SSIS/SSRS data systems into cloud-native Lakehouse pipelines using Databricks, dbt, Fivetran, and Airflow. Design standardized frameworks for ingestion, transformation, and consumption layers while driving CI/CD, observability, and engineering best practices across Azure and GCP. Evaluate emerging technologies (Delta Live Tables, Iceberg, streaming ingestion) through POCs and POVs, and leverage AI-assisted tools (Databricks Assistant, Cursor AI, GitHub Copilot) to accelerate development and reduce technical debt. Provide technical guidance to the team and translate business requirements into scalable data solutions.
Data ScienceDevOps / InfrastructureAzureJavaPythonSQLApache AirflowApache IcebergApache SparkAzure Data FactoryAzure SynapseBigqueryCdcCensusCI CDCursor AIData Design PatternsData VaultDatabricksDatabricks AssistantDbtDbt MeshDelta Live TablesETLFivetranGCPGitHub CopilotGoogle Pub SubKafkaMedallion ArchitectureObservabilityScalaScdSsisSsrs