Senior Data Engineer - Debt Solutions - San Diego, CA
ExpiredSan DiegoLast seen 16 days ago
Summary
Senior Data Engineer responsible for designing and implementing cloud data platforms (Databricks, Snowflake, BigQuery) and enterprise-scale data warehouses using Medallion Architecture. Will develop scalable ETL pipelines, optimize Spark jobs, integrate ML models into data workflows, and implement data governance and lineage tracking. The role requires hands-on expertise in Python, PySpark, SQL, and AWS services, plus experience with AI/ML integration, DevOps practices (Terraform, CI/CD), and mentoring junior engineers and analysts.
Data ScienceDevOps / InfrastructureAWSAzurePythonSQLTerraformAIAmazon S3Apache KafkaApache SparkAWS MLBigqueryCI CDClaudeCursorData GovernanceData LakehouseData Lineage TrackingData ModelingData WarehousingDatabricksDevOpsDynamodbETLGeminiGitHub CopilotGoogle Cloud StorageGrokLLM Large Language ModelsMachine LearningMedallion ArchitectureNoSQLObject Oriented ProgrammingPower BIPrompt EngineeringPysparkQuery OptimizationSnowflake