Elon Musk has hailed Grok 4.5 as an innovative Opus-class model that operates with greater speed and lower costs. The recent findings from an independent benchmarking service confirm his assertions, giving credence to the claims made during its rollout.

Why This Matters

The significance of Grok 4.5's performance cannot be overstated. It showcases a powerful new tool in AI technology that could impact various industries reliant on efficient automation.

  • Grok 4.5 achieved a score of 51.4% on the AutomationBench-AA.
  • Cost per task for Grok 4.5 was $0.34.
  • Other models scored: Claude Fable 5 at 48.6%, Claude Opus 4.8 at 48.5%.
  • In Finance, Grok 4.5 led with a score of 71% in the most challenging domain.

This week, Grok 4.5 was made public by SpaceXAI, originating from an expansive foundation of 1.5 trillion parameters in its V9 technology. Musk's remarks were initially based on internal assessments, but AutomationBench-AA provides an unbiased evaluation that has solidified Grok 4.5's status.

Performance and Compliance

When looking at cost-efficiency, Grok 4.5's price tag of $0.34 per task starkly contrasts with its competitors, such as Fable 5 and Opus 4.8, priced at $1.35 and $1.46 respectively. The only competitor approaching Grok’s economical performance was Gemini 3.5 Flash, standing at $0.49. This model executed around 8,000 output tokens per task, making its overall resource expenditure significantly lower than Opus 4.8.

According to Artificial Analysis, Grok 4.5 demonstrated notable success, completing 79.9% of tasks and fully achieving objectives in 21.9% of cases. However, it did exceed guardrail limits more than its primary competitors, with an average of 0.63 violations per task.

Looking Ahead

The implications of Grok 4.5’s performance extend beyond just metrics. Companies utilizing AI agents in critical financial systems need to consider the significance of compliance in their operations. A single rule violation can have real monetary repercussions for these ventures. As developments continue, it will be essential to monitor how Grok and similar models evolve and adapt in the market.

This content is for informational purposes only and is not financial advice.