Research Engineer — Post-Training & Small Language Models (SLMs), Healthcare AI
San DiegoLast seen today
Summary
Design and build specialized small language models (SLMs) for healthcare, with expertise in post-training techniques (SFT, RLHF, DPO, PPO, GRPO) and reasoning-model training. Develop healthcare-grade evaluation frameworks covering hallucination detection, factuality, bias/fairness, and clinical benchmarking, while performing red teaming and adversarial testing to identify alignment failures and unsafe behaviors. Apply PHI/HIPAA-aware data handling and produce model documentation for regulated clinical deployment. Work with open-weight foundation models (Llama, Qwen, Mistral, DeepSeek) using PyTorch and distributed training frameworks.
Data ScienceAIMachine LearningPythonAdversarial TestingAgentic SystemsAttention MechanismsBias Fairness EvaluationData FilteringDecoding StrategiesDeduplicationDeepseekDeepspeedDpoEvaluation FrameworksFactuality EvaluationFsdpGrpoHallucination DetectionHipaaLlamaLLM BenchmarkingLoraMegatron LmMistralModel ScalingOllamaPeftPhiPpoPreference OptimizationPyTorchQloraQuantization Aware TrainingQwenRayReasoning ModelsRed TeamingReward ModelingRlRlaifRlhfRlvrSftSynthetic DatasetsTensorrt LLMTgiTokenizationTool UseTransformer ArchitecturesVllm