evaluation-harnesses jobs in San Diego

Design and build agentic systems that automatically acquire, clean, format, and quality-control large-scale biomedical datasets for the Enchant multimodal transformer model. You will develop LLM-based agents that generate reproducible data pipeline code, implement automated quality-control workflows, and maintain distributed pipelines in production.…See more The role combines strong software engineering with scientific understanding of biomedical data formats and ETL design, working at the intersection of LLM automation and data engineering.

Lead the design and engineering of enterprise-ready AI agents with retrieval, orchestration, policy-based routing, and lifecycle observability across multiple AI providers. Develop cloud-native abstraction layers, containerized microservices, and serverless architectures to deliver scalable agentic systems.…See more Tailor domain-specific workflows for finance, healthcare, and retail verticals through intelligent automation. Conduct design workshops, POCs, and code sessions with clients to shape data-driven agent workflows while defining metrics, evaluation harnesses, and best practices for agent accuracy, latency, safety, and cost-effectiveness.