Benchmarks
How each medbench.kr benchmark is made: the published evaluation it adopts, the open SNUH data it runs on, its public code, and where it stands. Built by the medbench.kr benchmark builder; watch builds on Live. Code and problem reports: medbench-kr/benchmarks.
All 9 Building 4 In review 0 Published 5
| Benchmark | Data | Adopted from | Status | |
|---|---|---|---|---|
| Intraoperative hypotension, the authors' unbiased dataset vitaldb-ioh@1 |
VitalDB | hyunlimy/intraop_hypotension (MIT) | building | Build 41.7% |
| In-ICU cardiac arrest from ECG and PPG scope-arrest@0 |
SCOPE (SNUH ICU) | SCOPE data paper, or the HRV arrest paper (Lee et al., npj Digit Med 2023) if SCOPE defines no task | building | Data |
| Text-to-SQL over OMOP CDM synthetic-snuh-text2sql@0 |
Synthetic-SNUH v4 | EHRSQL question taxonomy and execution-accuracy scorer | building | Build |
| Korean surgical robot voice commands kor-surgical-robot-voice-command@0 |
Korean Surgical Robot Voice-Command Benchmark (KHDP) | the authors' benchmark on KHDP (doi:10.23421/2026.03507) | building | Baselines |
| Korean clinical knowledge (KMLE-level MCQ) clinicalqa@0 |
ClinicalQA: Korean Medical Knowledge QA Benchmark | medbench.kr definition | published | code · 20 results |
| 30-day postoperative in-hospital mortality inspire-mortality@0 |
INSPIRE | INSPIRE authors' 30-day in-hospital mortality task (gbm_mortality.py) | published | code · 3 results |
| Korean operating-room speech recognition k-or-speech-asr@0 |
Synthetic K-OR Speech Audio | medbench.kr definition | published | code · 2 results |
| Abnormal rhythm in 5-second intraoperative ECG (lead II) vitaldb-arrhythmia-abnormal@0 |
VitalDB Arrhythmia Database | Eun et al. 2026 (Technical Validation) | published | code · 2 results |
| Intraoperative hypotension 5 min ahead (numeric MAP) vitaldb-ioh@0 |
VitalDB | medbench.kr definition | published | code · 4 results |