Skip to content

Add clinical triage pipeline notebook for NMP v2#426

Open
mvansegbroeck wants to merge 1 commit intoNVIDIA:mainfrom
mvansegbroeck:maarten-clinical-triage-workflow
Open

Add clinical triage pipeline notebook for NMP v2#426
mvansegbroeck wants to merge 1 commit intoNVIDIA:mainfrom
mvansegbroeck:maarten-clinical-triage-workflow

Conversation

@mvansegbroeck
Copy link
Contributor

@mvansegbroeck mvansegbroeck commented Mar 14, 2026

Summary

  • Add an end-to-end clinical triage pipeline notebook using NeMo Data Designer and NeMo Evaluator
  • Part 1 (Data Designer): Generate synthetic ESI-labeled nurse triage notes, score quality with LLM-as-a-Judge, filter and save to JSONL
  • Part 2 (Evaluator): Run inference via NMP Gateway, score with string-check metric, compare accuracy by ESI level and complexity

Details

  • Use case: Predict Emergency Severity Index (ESI) levels from synthetic triage notes
  • Models: Nemotron Nano 30B (generator), Nemotron Super 120B (judge)
  • Evaluation compares two models across 5 ESI levels and 3 complexity tiers

Test plan

  • Run notebook end-to-end against NMP v2 instance
  • Verify Data Designer preview and batch generation
  • Verify Evaluator scoring and accuracy plots

@mvansegbroeck mvansegbroeck force-pushed the maarten-clinical-triage-workflow branch 2 times, most recently from 2d0945d to f616a20 Compare March 25, 2026 23:48
Co-Authored-By: Claude Opus 4.6 (1M context) <noreply@anthropic.com>
@mvansegbroeck mvansegbroeck force-pushed the maarten-clinical-triage-workflow branch from 59feab4 to 4eb5f31 Compare March 25, 2026 23:50
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant