PathAI
Senior Data Scientist, AI Pathology & LLM Products
Jul 2024 – Present
PythonSQLRAGLangChainLLM EvaluationSnowflake
AI Pathology Analytics
- Lead data science for AI pathology products, evaluating model reliability and clinical usability across cohorts, subgroups, annotation patterns, clinical metadata, edge cases, and model outputs.
- Partner with pathologists, machine learning engineers, and product managers to translate model findings into release criteria, documentation, and practical improvements for clinical workflows.
RAG & LLM Tools
- Build RAG-based tools that help product, science, and clinical teams retrieve validated answers from model documentation, annotation guides, study materials, and validation results.
- Design offline and production LLM evaluation checks for retrieval relevance, answer faithfulness, citation quality, hallucination risk, and safety guardrails to support reliable product decisions.
- Create reusable evaluation datasets and error taxonomies that make model comparisons, regression testing, and release-readiness reviews more consistent and traceable.
Python & SQL Workflows
- Develop reusable Python and SQL workflows for dataset review, cohort analysis, slice-based performance assessment, edge-case investigation, validation, and ongoing model monitoring.