HolyGrAIL

All tasks / Models

Llama 4 Maverick

Meta's earlier open-weights Llama line; Llama 4 Maverick (April 2025) is still its newest release.

  • Meta
  • Open weights
  • Released 5 Apr 2025

Official page

Where it ranks

  • C
    Chat & assistants
    Models · Local · 1,327 on LMArena Text Arena (overall, style control)
  • C
    Writing
    Models · Local · 1,307 on LMArena Text Arena: Creative Writing (style control)
  • C
    Coding
    Models · Local · 9 on Artificial Analysis Intelligence Index (secondary benchmark)
  • B
    Image understanding
    Models · Local · 1,145 on LMArena Vision Arena (overall, style control)

Facts

Vendor
Meta
Family
Llama
Released
5 Apr 2025
Weights
Open: download and run it yourself
License
Llama 4 Community License
Parameters
400B (17B active)
GPU memory to run locally
~230 GB (4-bit ≈ 400 B × 0.57 GB + overhead ≈ 230 GB, estimate (Meta: FP8 weights fit a single H100 DGX host).)
API price
$0.35 in / $1.15 out per 1M tokens
Access
Free (open weights)
Last verified
18 Oct 2026

Price from openrouter.ai, 18 Oct 2026.

Benchmark results

BenchmarkResultEntry on the leaderboardAs ofSource
Artificial Analysis Intelligence Index9Llama 4 Maverick
Raw value from the page's embedded model data; the site displays it rounded to an integer.
18 Oct 2026artificialanalysis.ai
Artificial Analysis MMMU-Pro (independent evaluation)62.1%Llama 4 Maverick
Raw fraction 0.6214 from the model data embedded in https://artificialanalysis.ai/leaderboards/models, converted to percent; rank 87 of 124 entries with an MMMU-Pro result; no last-updated date shown.
19 Oct 2026artificialanalysis.ai
EQ-Bench Creative Writing v3860meta-llama/Llama-4-Maverick-17B-128E-Instruct
Elo score from the leaderboard data embedded in https://eqbench.com/creative_writing.js (file last modified 2026-09-24); rank 124 of 140; rubric score 10.50.
24 Sep 2026eqbench.com
LMArena Text Arena (overall, style control)1,327llama-4-maverick-17b-128e-instruct
From LMArena's official leaderboard-dataset (text_style_control, split latest, category overall, published 2026-10-15), which mirrors https://arena.ai/leaderboard/text (site blocks automated fetches).
15 Oct 2026huggingface.co
LMArena Text Arena: Creative Writing (style control)1,307llama-4-maverick-17b-128e-instruct
From LMArena's official leaderboard-dataset (text_style_control, split latest, category creative_writing, published 2026-10-15), which mirrors https://arena.ai/leaderboard/text/creative-writing (site blocks automated fetches). Rank 226 of 414; 5151 votes; 95% CI 1298.4-1315.6.
15 Oct 2026huggingface.co
LMArena Vision Arena (overall, style control)1,145llama-4-maverick-17b-128e-instruct
From LMArena's official leaderboard-dataset (vision_style_control, split latest, category overall, published 2026-10-09), which mirrors https://arena.ai/leaderboard/vision (site blocks automated fetches). Rank 119 of 165; 6922 votes; 95% CI 1136.1-1154.4.
9 Oct 2026huggingface.co

Where you can use it

Earlier versions

  • Llama 3.3 70B · 6 Dec 2024
  • Llama 3.1 405B · 23 Jul 2024

Sources