BenchToward

Prior (ignores the input) on vitaldb-arrhythmia-abnormal@0

Run 1d493d07d294 · baseline · evaluated 2026-10-29

Scores

auroc0.500 (0.500–0.500)
auprc0.481 (0.399–0.567)
brier0.257 (0.240–0.275)
accuracy0.519 (0.433–0.601)
sensitivity0.000 (0.000–0.000)
specificity1.000 (1.000–1.000)
f10.000 (0.000–0.000)
n20874
tokens (in / out)0 / 0
cost (USD)0.0000

By category

N: false-positive rate0.000 (n=10829)
AFIB/AFL: sensitivity0.000 (n=6269)
AVB: sensitivity0.000 (n=35)
Patterned Atrial Ectopy: sensitivity0.000 (n=725)
Patterned Ventricular Ectopy: sensitivity0.000 (n=1051)
SND: sensitivity0.000 (n=1191)
SVTA: sensitivity0.000 (n=131)
Unclassifiable: sensitivity0.000 (n=2)
VT: sensitivity0.000 (n=79)
WAP/MAT: sensitivity0.000 (n=562)

Reuse this result

Download per-item predictions (parquet) · JSON

@misc{benchtoward_1d493d07d294,
  title = {Prior (ignores the input) on Abnormal rhythm in 5-second intraoperative ECG (lead II) (vitaldb-arrhythmia-abnormal@0)},
  author = {{BenchToward}},
  year = {2026},
  howpublished = {\url{https://benchtoward.com/r/1d493d07d294}},
  note = {Evaluated 2026-10-29, harness p0.1, run key d7d82d27da21}
}

Versions

modelbenchtoward/prior (BenchToward)
task spec hashbd4a0b735b2cad94715419405f020eee988266255064af1de71dcffe645c95f6
harnessp0.1
run keyd7d82d27da214a19ec0d914dd9a2e48953c57b8c88f43c5c79a5d1134c91c569
Run key before the 2026-11 rename: 5812e4ed2c05
config{"data_hash": "35b6d4522b057ea66b78d7d6354160c95e2e14087c898d090512c622a9fa0247", "eval_split": "test", "prior": "train share of abnormal segments", "train_split": "train"}

Data

VitalDB Arrhythmia Database, CC BY 4.0.

Eun D, Shim K, Lee H, Lim Y, Lim H, Lee H, Lee HC. VitalDB Arrhythmia Database: An Anesthesiologist-Validated Large-Scale Intraoperative Arrhythmia Dataset with Beat and Rhythm Labels (version 1.0.0). PhysioNet. 2026. doi:10.13026/axd6-wm13