llm-evaluation jobs in San Diego

Sr. AI Developer at XiFin will design and build AI-powered applications, agents, and automation tools that enhance software development workflows and improve engineering productivity.…See more The role involves developing intelligent testing solutions integrated with CI/CD pipelines, implementing AI-assisted developer tools using Claude and AWS Bedrock, and evaluating emerging AI technologies. You'll work hands-on across Python, LLMs, generative AI, and cloud-native AWS infrastructure, partnering with Engineering, QA, and DevOps teams to prototype and deploy scalable, production-ready solutions. The position requires 4–7+ years of software engineering experience with strong Python skills, LLM/generative AI application experience, and familiarity with modern DevOps practices.

Design, build, and ship LLM-powered capabilities end to end—from prototyping and fine-tuning models to deploying production agents and retrieval systems. Own the full stack: prompt and context engineering, multi-step agent design with tool calling, RAG systems (embeddings, chunking, hybrid search, reranking), fine-tuning on multi-GPU with LoRA/QLoRA, evaluation and tracing infrastructure, and clean APIs for other engineers.…See more Work in a secure, distributed environment where the platform runs on customer compute, cloud, or hybrid setups, requiring expertise with both commercial and self-hosted models.