Models /
HuatuoGPT-3: RL-Only Domain Adaptation from Base Models
Junying Chen, Xinyuan Xie, Ziniu Li, Benyou Wang et al. · arXiv · 2026-10-05 · doi · code
What it does (our summary of the abstract)
The authors adapt base language models to medicine with one reinforcement-learning stage instead of supervised fine-tuning followed by RL. Their method, OnePO, uses a stronger teacher model's answers only while they help: it strengthens learning on teacher tokens the model still finds unlikely and drops a teacher answer once the model's own samples score higher. Scaled up, it gives the open HuatuoGPT-3 models (9B and 27B) on Qwen backbones.
Model at a glance (from the paper's methods)
| Input | Medical question or clinical request (text) |
|---|---|
| Output | A reasoning trace, then a free-text answer or an option letter |
| Data | RL prompts: medical multiple-choice questions (MedQA, MedMCQA) plus rubric-scored open-ended tasks from PMC case reports and RubricHub |
| Weights | HuatuoGPT-3-27B and 9B released on Hugging Face (Apache-2.0), with training code and RL data |
Validated on SNUH data
clinicalqa@0 preview · ClinicalQA: Korean Medical Knowledge QA Benchmark, 1045 test instances
accuracy 0.897 (0.878–0.915) · #9 of 19 · agent (run by the medbench.kr model evaluator with the authors' released weights) · leaderboard · result
How the agent ran it: ✓ code license ✓ README ✓ dependency file ✓ weights released 0.66 GPU-h
Official entries will come from the model's authors, after their authorship is verified. This is planned; see the tags.