ai-evaluation-frameworks jobs in San Diego

Advanced manager and technical consultant designing and implementing enterprise-scale AI solutions spanning classical ML, generative AI, and agentic AI systems. Responsibilities include architecting AI-powered applications for business transformation (customer service, supply chain, finance, HR, operations), building RAG and autonomous agent workflows, developing ML pipelines, and establishing governance and observability frameworks.…See more Requires 8+ years in AI/ML/data science with 5+ years hands-on experience with Claude, GPT, LLMs, agentic frameworks, and RAG systems, plus deep expertise in prompt engineering, vector databases, and multi-agent architectures.

Design, build, and operate production-quality agentic AI systems and developer tooling at scale. Lead multi-agent orchestration, Model Context Protocol (MCP) integration, prompt engineering for structured output, and CI/CD automation for code review and testing.…See more Partner with engineering teams on discovery, rapidly prototype and validate capabilities, then own the full lifecycle from implementation through production monitoring. Mentor engineers on agentic design patterns and communicate technical tradeoffs to stakeholders.

Senior AI Software Engineer responsible for designing, developing, and deploying LLM-powered applications and AI-assisted development workflows within a large-scale enterprise Linux environment (~6M+ LOC, primarily C/C++). Build high-performance GPU-based inference pipelines using vLLM and modern frameworks, develop agentic AI workflows with RAG and tool calling, and integrate LLMs with vector databases and enterprise systems into production.…See more Collaborate across software engineers, AI researchers, and platform teams to productionize AI services while optimizing for performance, latency, scalability, and operational efficiency. Requires 4+ years software development, strong Linux/Red Hat experience, advanced C/C++, Python, LLM/RAG expertise, and GitLab CI/CD workflows.