ai-model-evaluation jobs in San Diego

Design and deploy generative AI solutions across firmware, embedded OS, and toolchains to automate workflows and optimize code. Partner with software, silicon, and DevOps teams to integrate AI copilots, code analysis, and test generation into existing development pipelines.…See more Evaluate AI models, develop scalable inference services, and measure their impact on developer productivity. Drive best practices for secure and compliant AI adoption in a fast-paced environment.

Lead end-to-end automation testing for web and mobile applications using Java, Selenium, Playwright, and TestNG, with specialized expertise in AI/LLM model evaluation and Generative AI testing. Design and maintain robust automation frameworks for regression, functional, and integration testing while creating comprehensive test plans for both traditional software and AI-based applications.…See more Evaluate LLM outputs against expected behavior, validate prompt/response quality, and document model-quality findings. Collaborate with developers, product owners, and stakeholders using Shift-Left Testing practices and Agile methodologies, leveraging AI-powered tools like GitHub Copilot and ChatGPT to enhance testing efficiency.