agent-evaluation jobs in San Diego

Design, build, and deploy production agentic AI solutions powered by Claude for enterprise clients, from proof-of-concept through production. Implement multi-agent systems that automate business processes, integrate with enterprise tools, and operate within defined autonomy and guardrails.…See more Modernize existing AI/ML platforms with generative AI capabilities including RAG and agent-based orchestration. Advise clients on generative AI adoption strategy, responsible AI practices, and model selection while partnering with technology, data, and business stakeholders to scope and deliver solutions.

Design and build AI agents that automate workflows within a multi-agent platform, enabling PM and engineering agents to exchange plans and context over shared program data. Develop full-stack web applications with generative AI functionality—conversational interfaces, natural-language querying, automated summarization, and in-context recommendations—using C#, .NET, Python, TypeScript, Angular/React, and integrations with Jira, Microsoft 365, Confluence, and SQL/NoSQL stores.…See more Define agentic engineering standards including tool contracts, MCP servers, prompt management, memory, guardrails, human-in-the-loop approval, and evaluation harnesses. Requires hands-on experience with LLM application development, agentic runtimes like LangGraph or AutoGen, full-stack enterprise development, and cloud deployment on AWS or Azure.

Lead the design, development, and operation of Qualcomm's enterprise AI platform, supporting agentic AI, model lifecycle management, and multi-cloud ML/inference infrastructure. Own core platform services including identity/RBAC, secrets, service meshes, observability, vector stores, and model gateways across on-prem GPU clusters and managed cloud services.…See more Manage a ~10-engineer global team (platform, SRE, MLOps/LLMOps), drive incident response and continuous improvement, and partner with product and security teams on AI governance and high-impact use cases.