gpt-oss 20B on synthetic-snuh-text2sql@0
Run 071979f7a992 · standard · evaluated 2026-10-30
Scores
| hard_ex | 0.193 (0.127–0.271) |
|---|---|
| rs0 | 0.223 (0.158–0.292) |
| hard_rs5 | -3.614 (-4.005–-3.183) |
| hard_rsN | -154.777 (-167.847–-139.718) |
| easy_ex | 0.899 (0.857–0.938) |
| parse rate | 0.951 |
| n | 510 |
| tokens (in / out) | 2399594 / 1432101 |
| cost (USD) | 0.2708 |
Reuse this result
Download per-item predictions (parquet) · JSON
@misc{medbench_071979f7a992,
title = {gpt-oss 20B on Synthetic-SNUH Text-to-SQL (OMOP CDM, Korean and English) (synthetic-snuh-text2sql@0)},
author = {{medbench.kr}},
year = {2026},
howpublished = {\url{https://medbench.kr/r/071979f7a992}},
note = {Evaluated 2026-10-30, harness text2sql-p0, run key 0687d608194f}
}
Versions
| model | openai/gpt-oss-20b (OpenAI) |
|---|---|
| task spec hash | abb0fa4ae8e35e706e34c4862ff8a1c1a3aba1f57c39900eb3ee3d6685f4650c |
| harness | text2sql-p0 |
| run key | 0687d608194fbb1430fd8d6374e3cbf688f353f1cd3e0de420465aea6fe56854 |
| config | {"max_tokens": 16384, "prompts": {"easy": "text2sql-omop-p0", "hard": "text2sql-omop-hard-p0"}, "temperature": 0, "tiers": ["hard", "easy"]} |
Data
Synthetic-SNUH v4, CC BY-NC 4.0.
Lee H-C, Seoul National University Hospital. Synthetic-SNUH v4.0.0: synthetic OMOP CDM and KR Core FHIR records for 10,000 virtual patients (version 4.0.0). KHDP. 2026. doi:10.23421/2026.03183