Artificial Analysis AutomationBench, strict pass@1

The strict pass@1 score on Artificial Analysis's AutomationBench-AA, where a business-workflow task counts only when it is fully completed.

ModelsModels with a result.3
Top resultBest result on this benchmark.—
Top-3 spreadPoints from first to third.—
YearYear of release.2026

Results

3 results
#ModelResultThe score from the source.
—Muse Ember37.8%
—GPT-6 Luna20.2%