Medical BenchBenchmark analysis
VQA-RAD: reconcile 3,515 questions with 2,248 records
An original accounting of question forms, image reuse and the original VQA-RAD evaluation.
Original analysis / Medical Bench
Read the benchmark closely.
A medical VQA result depends on which images, question forms and answer rules were evaluated. We examine VQA-RAD’s clinician-generated questions and SLAKE’s visual and knowledge-based tasks, keeping paper counts separate from cleaned releases. Our original coverage map and guides explain what those choices support. Selected historical results are credited to the original papers; no new model runs are claimed.
5 min read
Benchmark analysis
SLAKE: freeze the release, language and knowledge condition
Understand the original image split and why cleaned releases require their own denominators.
Benchmark analysis
What VQA-RAD and SLAKE can tell you about visual grounding
A task-specific audit of images, answer shortcuts and scoring rules in two medical VQA benchmarks.