LLM Fine-Tuning & Model Optimization Engineer

• Home ›
• careers ›
• LLM Fine-Tuning & Model Optimization Engineer

Job Description LLM Fine-Tuning & Model Optimization Engineer Company Overview Forsure™ is the AI-native platform & consulting company that transforms how employers manage healthcare. Powered by SureSystem™ (our intelligence engine handling data, AI, and automation) and delivered through SureConsult™ (human expertise and consulting services), we combine automation, analytics, and advisory to cut costs, reduce administrative burden, and improve the employee experience. Our culture is C.L.E.A.R. - we value Clarity Over Complexity (no jargon, just truth), Lead With Empathy (fierce energy that's always human), Embrace the Unknown (reinvention is our default), Act Like a Tribe (we grow together), and Resilience in Motion (grit drives everything we do). We're looking for someone who embodies these values. ‍ What You'll Be Doing

• Fine-tune and optimize large language models (LLMs) for Forsure's healthcare benefits domain — ensuring accuracy, safety, and performance
• Design and manage training data pipelines for domain-specific model adaptation, including data curation, labeling strategy, and quality assurance
• Implement RLHF, DPO, and other alignment techniques to ensure model outputs meet clinical and regulatory standards
• Optimize model inference for cost, latency, and throughput — enabling real-time AI capabilities within SureSystem™
• Develop evaluation benchmarks specific to healthcare benefits (plan comparison accuracy, formulary reasoning, compliance adherence)
• Experiment with retrieval-augmented generation (RAG), agentic architectures, and multi-model orchestration to enhance system intelligence Forsure: LLM Fine-Tuning & Model Optimization Engineer 1
• Collaborate with the Medical AI Advisory Scientist to validate clinical accuracy of fine-tuned model outputs
• Research and implement emerging techniques in parameter-efficient fine-tuning (LoRA, QLoRA, adapters) and model compression
• Monitor model drift, bias, and performance degradation — building automated systems for ongoing quality assurance
• Document model archite

‍ ‍ What We Need To See

• 3+ years of hands-on experience with LLM fine-tuning, NLP model development, or applied ML engineering
• Strong proficiency in Python, PyTorch, and Hugging Face Transformers ecosystem
• Experience with training infrastructure: GPU clusters, distributed training, cloud ML platforms (AWS, GCP, or Azure)
• Deep understanding of transformer architectures, attention mechanisms, and modern NLP techniques
• Hands-on experience with RLHF, DPO, SFT, or other alignment and fine-tuning methodologies reproducibility
• Strong software engineering fundamentals — version control, testing, CI/CD, and
• Ability to communicate technical concepts clearly to non-technical stakeholders
• Self-motivated with the ability to drive projects from research to production

‍ ‍ WAYS TO STAND OUT IN THE CROWD

• Experience fine-tuning models for healthcare, insurance, or regulated industries
• Published research in NLP, machine learning, or related fields
• Experience with RAG systems, vector databases (Pinecone, Weaviate, Chroma), and knowledge retrieval
• Familiarity with model serving frameworks (vLLM, TGI, Triton) and optimization techniques
• Background in healthcare data standards and terminologies (ICD-10, CPT, SNOMED)
• Experience building evaluation harnesses and automated model testing pipelines Forsure: LLM Fine-Tuning & Model Optimization Engineer 2
• Contributions to open-source ML/NLP projects
• Master's or PhD in Computer Science, AI/ML, or Computational Linguistics

‍ ‍ What We Offer

• Opportunity to shape AI-driven healthcare innovation at a fast-growing company
• Direct mentorship from senior leadership (Fast paced flat-organizational structure)
• Exposure to enterprise sales, consulting, and product development
• Collaborative environment with cutting-edge technology
• Competitive salary and comprehensive benefits
• Flexible work arrangements

‍ You’ll report directly to leadership and work closely with our sales, consulting, and product teams. This role offers exceptional visibility and the opportunity to make immediate impact. Join us in making healthcare simple, transparent, and built around people. ‍ Be Sure. Forsure. ‍ To Apply: Email careers@forsure.ai with your resume. Include "Medical AI Advisory Scientist

• [Your Name]" in the subject line and a brief note on why you’re the A+ player we’re seeking.

‍ Apply to Help Make Healthcare Work Better Related Careers Full Time / Hybrid AI-Native Growth Marketer Apply to Help Make Healthcare Work Better Full Time / Hybrid Healthcare Data Scientist Apply to Help Make Healthcare Work Better Full Time / Hybrid Medical Advisor Apply to Help Make Healthcare Work Better