Artificial Analysis
Artificial Analysis AutomationBench, strict pass@1
The strict pass@1 score on Artificial Analysis's AutomationBench-AA, where a business-workflow task counts only when it is fully completed.
ModelsModels with a result.3
Top resultBest result on this benchmark.—
Top-3 spreadPoints from first to third.—
YearYear of release.2026
Results
3 results#ModelResultThe score from the source.