Staff Data Engineer / Full‑Stack Data Developer (Databricks / Python)
San DiegoLast seen 1 day ago
Summary
Staff-level data engineer who designs, develops, and maintains scalable ETL/ELT pipelines using Databricks, PySpark, and Python for enterprise analytics and AI use cases. Builds curated data layers following Lakehouse Medallion architecture, develops Databricks-native applications (notebooks, dashboards, APIs), and optimizes Apache Spark workloads for performance and cost efficiency. Owns production data pipelines end-to-end, ensures data quality and reliability, and acts as a technical leader mentoring teams on data engineering best practices and modern Databricks capabilities.
Data ScienceDevOps / InfrastructureAWSJavaPythonSQLAnomaly DetectionApache KafkaApache SparkAWS GlueCI CDData GovernanceData QualityData StructuresData TransformationDatabricksDevOpsEc2ELTETLGenerative AIGitIAMLakehouseMbseMedallion ArchitectureNoSQLObservabilityPysparkS3Structured StreamingUnity Catalog