google-pub-sub jobs in San Diego

Lead the modernization of legacy SSIS/SSRS data systems into cloud-native Lakehouse pipelines using Databricks, dbt, Fivetran, and Airflow. Design standardized frameworks for ingestion, transformation, and consumption layers while driving CI/CD, observability, and engineering best practices across Azure and GCP.…See more Evaluate emerging technologies (Delta Live Tables, Iceberg, streaming ingestion) through POCs and POVs, and leverage AI-assisted tools (Databricks Assistant, Cursor AI, GitHub Copilot) to accelerate development and reduce technical debt. Provide technical guidance to the team and translate business requirements into scalable data solutions.

Staff Data Engineer role at Credit Karma building petabyte-scale data infrastructure and streaming platforms on GCP. You will design and operate Kafka-based streaming infrastructure, build cloud-native data pipelines using Dataflow/Beam, Flink, and Spark, and create persistence frameworks across Spanner, MySQL, and BigQuery.…See more The role requires 7+ years backend/data systems experience in JVM languages (Scala/Java), expertise with high-throughput distributed systems, and deep knowledge of streaming platforms, Apache Beam, CDC patterns, encryption, and data governance frameworks. You'll also integrate AI/ML and generative AI technologies including LLMs, RAG, semantic search, and knowledge graphs into the data platform.