黑洞智能体BLACK HOLE AGENTS
Docs

Agent Leaderboard

This page shows the top 30 models on the Arena AI leaderboard, snapshotted daily so you can see how recent models are doing at a glance. See the Arena AI site for the full leaderboard, filters and latest changes.

This leaderboard measures how models perform on multi-turn tool-calling and agent tasks, across net improvement, confirmed success, praise-to-complaint ratio, steerability, Bash recovery, tool hallucination and session volume.

Data updated: 2026-10-16 13:02:49 UTC / 2026-10-16 21:02:49 CST (Beijing time)

Top 30

RankRank SpreadModelNet ImprovementConfirmed SuccessPraise vs ComplaintSteerabilityTool HallucinationSessions
11-6Claude Opus 5.5 (Max) 117.18%±3.38%19.36%±5.13%31.74%±13.06%17.94%±2.90%0.55%±0.11%6,796
21-7GPT 6.1 Sol (Max) 114.78%±2.03%15.69%±3.29%34.49%±7.44%14.73%±1.95%0.65%±0.04%12,705
31-7Claude Fable 5.1 (Max) 114.12%±2.01%15.71%±3.36%27.14%±7.30%14.70%±2.39%0.57%±0.11%16,282
41-7Gemini 4 Argon (High) 113.73%±1.52%14.58%±2.55%31.29%±5.30%16.78%±1.55%0.02%±0.55%28,097
51-7GPT 6 Astra (Max) 113.69%±2.32%12.55%±4.10%28.55%±8.52%14.56%±2.43%0.59%±0.09%12,892
61-9Claude Sonnet 5.5 (Max) 112.55%±3.13%19.98%±5.24%17.02%±11.59%12.35%±3.37%0.46%±0.24%7,446
72-9GPT 6 Sol (Max) 111.20%±2.27%9.21%±4.07%22.89%±8.17%12.41%±2.24%0.39%±0.10%7,075
86-12Claude Opus 5 (Max) 19.20%±1.69%12.65%±3.02%14.95%±5.75%7.26%±2.28%0.60%±0.08%23,614
96-12Claude Fable 5 (High) 18.39%±1.41%5.05%±2.68%15.07%±4.41%10.59%±2.10%0.62%±0.07%42,474
108-13GPT 5.6 Sol (xHigh) 17.42%±1.41%3.75%±2.70%14.75%±4.51%8.42%±2.08%0.51%±0.09%36,373
118-13Claude Opus 4.8 (High) 17.14%±1.53%3.96%±2.78%12.93%±4.77%7.02%±2.73%0.35%±0.19%40,277
128-18Muse Wonder (Max) 16.42%±2.15%8.43%±4.13%7.81%±7.39%8.68%±2.66%0.27%±0.30%5,526
1310-23Claude Sonnet 5 (High) 14.69%±1.70%1.58%±3.43%4.74%±5.37%6.58%±2.46%0.41%±0.13%33,161
1412-23Gemini 3.8 Flash (High) 13.97%±1.08%5.08%±2.23%4.55%±3.34%2.09%±1.60%0.52%±0.08%37,462
1512-27MiMo V2.6 Pro 13.81%±1.18%8.61%±2.33%4.54%±3.85%2.00%±1.64%0.13%±0.27%23,636
1612-25Muse Spark 1.3 (Max) 13.63%±0.81%4.87%±1.71%4.10%±2.57%5.60%±1.10%0.55%±0.06%73,452
1712-31Grok 4.7 (xHigh) 13.39%±1.67%6.12%±3.42%3.48%±5.30%0.62%±2.55%0.56%±0.05%14,843
1812-30GPT 5.5 (xHigh) 13.31%±1.28%1.98%±2.32%6.52%±3.62%3.20%±2.62%0.50%±0.14%54,310
1913-25GPT 6 Luna (Max) 13.26%±0.49%1.30%±1.01%1.34%±1.57%6.17%±0.62%0.42%±0.06%155,783
2013-27Deepseek V4.1 Flash (Max) 12.95%±0.37%7.48%±0.77%3.58%±1.19%1.94%±0.53%0.46%±0.05%228,658
2113-29Hy4 preview 12.90%±0.69%6.04%±1.40%5.44%±2.23%2.43%±0.89%0.16%±0.17%82,690
2213-33MiMo V2.6 Flash 12.53%±1.51%7.05%±2.98%3.55%±4.87%4.80%±1.97%3.18%±0.50%18,936
2313-31GLM 5.2 (Max) 12.35%±0.83%3.55%±1.69%6.76%±2.50%1.23%±1.41%0.62%±0.05%86,843
2415-33GLM 5.3 (Max) 12.00%±0.84%3.80%±1.75%6.09%±2.56%0.41%±1.31%0.59%±0.07%86,255
2517-31Kimi K3 (Max) 11.95%±0.72%6.32%±1.50%2.21%±2.10%0.53%±1.25%0.65%±0.04%134,561
2619-31Qwen3.8 Max 11.92%±0.61%4.69%±1.29%2.09%±1.87%1.91%±0.90%0.77%±0.21%67,520
2715-33Claude Haiku 5.5 (High) 11.88%±0.98%1.64%±2.25%2.75%±3.07%6.40%±1.21%0.70%±0.47%21,839
2817-33GPT 5.4 (High) 11.64%±1.09%4.28%±2.14%0.91%±3.15%7.10%±2.15%0.34%±0.19%81,779
2919-35Grok 4.6 (xHigh) 11.16%±1.10%0.65%±2.39%0.32%±3.22%1.05%±1.76%0.52%±0.08%28,687
3021-36GPT 5.6 Terra (xHigh) 10.43%±1.34%4.13%±2.73%1.96%±3.90%2.57%±2.26%0.40%±0.16%24,138

How to read this table

  • Rank / Rank Spread: Arena AI's estimate of relative position from agent-task battles. The spread shows how far the rank moves within the confidence interval.
  • Net Improvement: how much the model improves on the baseline across multi-turn tool-calling and agent tasks.
  • Confirmed Success: share of completed tasks the user confirmed as successful.
  • Praise vs Complaint: ratio of upvotes to downvotes on the model's answers.
  • Steerability: how well the model follows instructions and keeps its output stable.
  • Bash Recovery: share of Bash / command-line errors the model recovers from.
  • Tool Hallucination: share of calls to tools that do not exist. Lower is better.
  • Sessions: sample size. Rankings move more when there are fewer sessions.

Three things to check before choosing a model

  1. Whether the provider actually serves the model, and whether it is available in your region and for your account;
  2. Whether the API price, rate limits and context window fit your workload;
  3. Run a small test on three to five real tasks instead of relying on the overall ranking alone.

Data source

Data comes from the Arena AI Agent Leaderboard and is refreshed daily by GitHub Actions. For model pricing, licenses and capabilities, check the model provider's own documentation.

On this page