Majority class (always B) on clinicalqa@0

Run a9dc010ea139 · baseline · evaluated 2026-10-29

Scores

accuracy	0.343 (0.314–0.370)
parse rate	1.000
n	1045
tokens (in / out)	0 / 0
cost (USD)	0.0000

Reuse this result

Download per-item predictions (parquet) · JSON

@misc{benchtoward_a9dc010ea139,
  title = {Majority class (always B) on Korean clinical knowledge (KMLE-level MCQ) (clinicalqa@0)},
  author = {{BenchToward}},
  year = {2026},
  howpublished = {\url{https://benchtoward.com/r/a9dc010ea139}},
  note = {Evaluated 2026-10-29, harness p0.1, run key 0276a016479b}
}

Versions

model	`benchtoward/majority-b` (BenchToward)
task spec hash	`77e37cd0ca6bded7fba03792ec1922342b3f6a7dc3ce602881ce196e6aa7377c`
harness	`p0.1`
run key	`0276a016479b9d80854d85c96ed4da705a9f0330ae62a68ec9bb613cc09e2367` Run key before the 2026-11 rename: `be5a808d3a1c`
config	`{"letter": "B"}`

Data

ClinicalQA: Korean Medical Knowledge QA Benchmark, CC BY 4.0 (upstream Apache-2.0).

SNUH-HARI. ClinicalQA: Korean Medical Knowledge QA Benchmark. Seoul National University Hospital Healthcare AI Research Institute, 2025. doi:10.23421/2026.0800