Benchmark Performance

Clinicalvalidationthroughrigorousbenchmarking

August is evaluated against the same standardized tests used to train and license doctors. These aren't arbitrary metrics — they're the assessments that determine whether someone is qualified to practice medicine.

01Medical Knowledge

Validated against the same standards used in physician training

August achieves 97% accuracy on MedQA — over 12,000 authentic medical licensing questions — outperforming general-purpose models through specialised clinical architecture.

August
GPT-5
Claude 4.5 Sonnet
Gemini 2.5 Pro
GPT-4o
MedQA
97%
95.8%
94.7%
93.2%
88.1%
USMLE
100%
97%
97.2%
90.1%
92.3%
02USMLE Performance

The exam every doctor must pass before they can practise medicine

August achieves 100% accuracy on the USMLE, compared to a 60% first-attempt pass rate for human medical graduates. The same level of qualification on diagnosis, treatment, and clinical decision-making that separates licensed doctors from everyone else.

August
100%
Claude 4.5 Sonnet
97.2%
GPT-5
97.0%
GPT-4o
92.3%
Gemini 2.5 Pro
90.1%
03MedQA Benchmark

12,000+ authentic medical board questions from the US, China, and Taiwan

August outperforms GPT-5 by +1.5 pp and Gemini by +4.2 pp because August has been tested on thousands of real-world medical scenarios. August doesn't guess — it has been validated against the same questions doctors use to get licensed.

August
97.4%
GPT-5
95.8%
Claude 4.5 Sonnet
94.7%
Gemini 2.5 Pro
93.2%
GPT-4o
88.1%
04MMLU Clinical

Consistent accuracy across every medical specialty

Your health questions don't fit into neat boxes. Whether you're asking about your thyroid, your genes, or your child's development, you get the same level of reliability across every medical specialty.

August
GPT-5
Claude 4.5 Sonnet
Gemini 2.5 Pro
GPT-4o
College Medicine
95.1%
91.9%
92.5%
89.6%
87.8%
Clinical Knowledge
96.4%
95.1%
94.3%
92.8%
90.4%
Anatomy
93.6%
92.6%
92.1%
90.4%
88.9%
Professional Medicine
98.1%
97.8%
96.9%
95.5%
93.7%
College Biology
99.3%
99.3%
98.8%
97.6%
96.2%
Medical Genetics
100%
100%
99.4%
98.1%
96.8%
05Conversational Diagnostics

Diagnosis through conversation, not multiple choice

August achieves 87% diagnostic accuracy in multi-turn clinical conversations — +21 pp over GPT-5 — and 97% triage accuracy. This isn't a multiple-choice test. This is diagnosis through conversation, evaluated across 400 clinical vignettes spanning 14 medical specialties.

August
GPT-5
Claude 4.5 Sonnet
Gemini 2.5 Pro
GPT-4o
Diagnostic Accuracy
87%
66%
75%
69%
55.3%
Triage Accuracy
97%
88.3%
92.5%
88.8%
91.3%

August reaches the correct diagnosis in 47% fewer questions than competitors (16 vs 29 on average), demonstrating both accuracy and efficiency. This methodology has been peer-reviewed and published at arXiv:2412.12538.

06Document Processing

From handwritten prescriptions to lab reports

August achieves 82% accuracy on handwritten prescriptions versus 49% for competitors, and 99% accuracy on laboratory reports. August translates medical jargon into plain language and helps you understand what your doctor is recommending.

August
GPT-5
Claude 4.5 Sonnet
Gemini 2.5 Pro
GPT-4o
Lab Reports
99.4%
93%
99%
98%
72%
Handwritten Rx
82%
58%
45%
60.8%
38%
07Safety By Design

100% recall. 100% precision. Zero false alarms.

August achieves 100% recall and 100% precision in emergency identification. Other LLMs average just 28% precision — meaning 7 out of 10 times they call something an emergency, it isn't. August gets it right every time.

August
100%
Claude 4 Opus
30%
Claude 4 Sonnet
30%
GPT-4.1
28%
o3
28%
SAFETY
100%
Recall

Every true emergency flagged. None missed.

ZERO FALSE POSITIVES
100%
Precision

Eliminates inappropriate emergency escalations. Competitors average ~28% precision.

Test ResultsN = 138
True Positives
41

Emergencies correctly identified

False Positives
0

False alarms

False Negatives
0

Missed emergencies

True Negatives
97

Non-emergencies correctly handled

Need answers right now?

Talk to August. Anytime, anywhere.

For instant 24/7 medical guidance, reach out to August. Free forever. No appointments needed.

Your health journey starts with a single question

Download August today. Free forever. No insurance needed. No appointments. Just answers you can trust.

Hand reaching for August Health app icon