llm-observability jobs in San Diego

Lead a team of consultants building production AI/ML applications for cybersecurity, with hands-on responsibility for architecture, code review, and integration across SIEM, SOAR, EDR, and other security platforms. Own technical delivery, timelines, and budgets while mentoring engineers and staying engaged in pair programming and troubleshooting.…See more Work with frontier LLM providers to evaluate agentic systems, RAG pipelines, tool-calling agents, and evaluation harnesses for threat detection and incident response automation. Partner with client stakeholders to translate cyber capabilities into engineering requirements and support account growth through proposals, demos, and reusable delivery playbooks.

Build and deploy AI/ML solutions for cybersecurity as a senior consulting engineer at EY. You will design frontier AI models, LLMs, and agentic architectures tailored to client security workflows, integrating them with SIEM, SOAR, EDR, and other security platforms.…See more You'll translate client use cases into engineering tasks, develop evaluation harnesses, build secure AI deployment pipelines, and deliver production-ready solutions with clear documentation and testing. The role requires 3–5 years of hands-on software engineering experience, proficiency in Python and cloud platforms (AWS/Azure/GCP), and demonstrated expertise in building or deploying AI/ML systems within security contexts.