medbench.kr

Qwen3.8 Flash Next 180B-A6B on clinicalqa@0

Run f1ff027148b1 · baseline tier · evaluated 2026-10-29

Scores

accuracy0.894 (0.877–0.913)
parse rate0.980
n1045
tokens (in / out)419053 / 1982490
cost (USD)0.0000

By category

Allergy and Immunology0.889 (n=36)
Cardiology0.910 (n=89)
Dermatology0.917 (n=12)
Emergency Medicine1.000 (n=32)
Endocrinology0.897 (n=68)
Endocrinology, metabolic, and nutritional disorders1.000 (n=1)
Forensic Medicine1.000 (n=1)
Gastroenterology0.911 (n=112)
General Surgery0.931 (n=58)
Geriatric Medicine1.000 (n=1)
Gynecology0.757 (n=70)
Hematology and Oncology0.979 (n=48)
Infectious Diseases0.827 (n=52)
Musculoskeletal (e.g., costochondritis)1.000 (n=1)
Nephrology0.856 (n=111)
Neurology / Neurosurgery0.939 (n=49)
Obstetrics0.722 (n=18)
Ophthalmology1.000 (n=1)
Orthopedic Surgery0.958 (n=24)
Otolaryngology0.929 (n=14)
Otolaryngology (ENT)0.857 (n=14)
Pediatrics0.875 (n=56)
Pharmacology1.000 (n=1)
Psychiatry0.867 (n=45)
Pulmonology (Respiratory Medicine)0.954 (n=65)
Radiology1.000 (n=1)
Rheumatology0.939 (n=49)
Urology0.846 (n=13)
Vascular Surgery1.000 (n=2)
nan0.000 (n=1)

Reuse this result

Download per-item predictions (parquet) · JSON

@misc{medbench_f1ff027148b1,
  title = {Qwen3.8 Flash Next 180B-A6B on Korean clinical knowledge (KMLE-level MCQ) (clinicalqa@0)},
  author = {{medbench.kr}},
  year = {2026},
  howpublished = {\url{https://medbench.kr/r/f1ff027148b1}},
  note = {Evaluated 2026-10-29, harness p0.1, run key 04e07d24ffd9}
}

Versions

model digestkgpu/qwen3.8-flash-next-180b-a6b
task spec hash77e37cd0ca6bded7fba03792ec1922342b3f6a7dc3ce602881ce196e6aa7377c
harnessp0.1
run key04e07d24ffd9f45e3ecc727f1bbec8b4b2b294db7d8fed2cace336f30e70a93d
config{"max_tokens": 16384, "prompt": "clinicalqa-p0", "temperature": 0}

Data

ClinicalQA: Korean Medical Knowledge QA Benchmark, CC BY 4.0 (upstream Apache-2.0).

SNUH-HARI. ClinicalQA: Korean Medical Knowledge QA Benchmark. Seoul National University Hospital Healthcare AI Research Institute, 2025. doi:10.23421/2026.0800