hadoop jobs in San Diego

Principal Engineer Data will develop and execute a data architecture strategy aligned with business goals, building and maintaining data models, metadata standards, and integration frameworks. The role requires leading technical assessments for digitizing core business functions, working with stakeholders to translate requirements into architectural solutions, and ensuring data storage, retrieval, and governance meet enterprise standards.…See more The candidate must have a STEM degree with at least 5 years of experience (or Master's with 3 years), strong expertise in SQL Server, data visualization tools (Tableau, Power BI), and data architecture principles including data integration, governance, and security protocols.

Senior Data Engineer at Sony to design, build, and maintain scalable data pipelines, dashboards, and reporting solutions supporting PlayStation's payments, subscription, and fraud-prevention systems. Will develop AI-ready data products for analytics, automation, and machine-learning workflows in close partnership with data scientists, analysts, and global payments stakeholders.…See more Requires 7+ years in data engineering or related software/systems work, strong SQL and data modeling, proficiency in Python/Java/scripting languages, and experience operationalizing data for ML and governance. Will mentor team members, communicate technical architectures to executives, and drive platform reliability and security.

This software engineering internship involves developing embedded software for real-time control of advanced tactical radio equipment, working across the full software development lifecycle from requirements analysis through testing and integration. The role requires applying computer science and engineering principles using multiple programming languages (C++, C#, C, Java, Python, etc.) on embedded real-time operating systems (VxWorks, Linux, QNX, Integrity, Windows CE) and evaluating hardware-software interfaces.…See more Interns will develop test procedures, participate in peer reviews, and utilize modeling tools to conduct experimental tests. The position demands a strong foundation in computer science, computer engineering, software engineering, electrical engineering, or related disciplines.

Principal-level individual contributor role leading AI/ML architecture and engineering strategy at scale. Requires 13+ years across ML, data engineering, and distributed systems, with 3+ years shipping production Generative/Agentic AI systems.…See more Hands-on expertise in RAG, vector databases, LLM optimization, agentic orchestration, and MLOps/LLMOps practice. Will set technical direction, own architecture decisions, drive platform initiatives, and raise engineering standards across the organization without direct people-management responsibility.

A Software Engineer will design, build, test, and deliver secure, mission-critical software solutions for the U.S. Department of Defense, working with cross-functional teams to develop front-end and back-end features.…See more The role requires proficiency in multiple programming languages (C++, Python, Java, JavaScript), version control (Git), containerization (Docker, Kubernetes), relational databases (SQL/Postgres), and Linux systems, with additional value from front-end frameworks like React, DevSecOps practices, cloud/virtualization expertise, and scripting automation. The engineer will maintain CI/CD pipelines using Jenkins, integrate third-party software, and adhere to DoD and industry security and reliability standards.

A Senior Site Reliability Engineer at SHEIN will own and operate mission-critical, large-scale distributed systems (Kubernetes, Kafka, Elasticsearch, Redis, APISIX, Nginx) running 24/7/365, participating in on-call rotations and driving fast incident response using AI-assisted log analysis and anomaly detection. The role requires strong software engineering expertise in Python or Go, deep Linux and networking knowledge, and hands-on experience with observability platforms (Prometheus, Grafana) and configuration management tools.…See more Responsibilities include designing resilient monitoring and alerting infrastructure, automating operational workflows to eliminate toil, capacity planning, and collaborating with global teams to improve system reliability and performance.

Staff Site Reliability Engineer at SHEIN responsible for operating and evolving large-scale, mission-critical production systems with 24/7/365 on-call participation. Design, build, and maintain observability solutions (metrics, logs, traces, alerting) with AI-powered anomaly detection; own and operate core open-source infrastructure (APISIX, Nginx, Kubernetes, Kafka, Elasticsearch, Redis, Consul, Etcd, Zookeeper).…See more Automate operational workflows, reduce incident frequency and MTTR, and provide technical leadership across global engineering teams. Requires strong software engineering skills, deep Linux/networking/distributed systems expertise, and passion for solving problems at scale.

This role provides Tier 2 technical support for Windows and Linux systems, network infrastructure, and enterprise applications in a classified DoD environment. The administrator will configure and maintain operating systems, troubleshoot hardware and software issues, support distributed systems (Hadoop, Kafka, HBase/Accumulo, Spark), and utilize automation tools including Bash, PowerShell, Python, Ansible, Puppet, and Terraform.…See more Responsibilities include maintaining compliance with DoD and Intelligence Community security requirements, collaborating with engineering and cybersecurity teams, and documenting technical procedures. An active TS/SCI clearance and DoD 8570/8140 IAT Level I certification are required.