Model Explorer

Explore benchmark performance of various AI models

Models

🔍

Claude-3-Opus

Claude-3.5-Haiku

Claude-3.5-Sonnet-1022

Claude-3.7-Sonnet

Claude-3.7-Sonnet-Thinking

Claude-4.0-Opus

Claude-4.0-Opus-Thinking

Claude-4.0-Sonnet

Claude-4.0-Sonnet-Thinking

Claude-4.1-Opus-Thinking

Cohere-Command-A

Cohere-Command-R-Plus

DeepSeek-R1

DeepSeek-V3-0324

GPT-3.5-Turbo

GPT-4-mini

GPT-4.1

GPT-4o-0513

GPT-5

GPT-5-Thinking

GPT-5-mini

GPT-5-mini-Thinking

GPT-5-nano

GPT-5-nano-Thinking

GPT-OSS-120B

Gemini-2.0-Flash

Gemini-2.0-Pro-0121

Gemini-2.5-Flash

Gemini-2.5-Flash-Thinking

Gemini-2.5-Pro-0325

Gemini-2.5-Pro-0605

Gemini-2.5-Pro-Thinking

Grok-3-Beta

Grok-3-Mini-Beta

Grok-4

Grok-4-Thinking

Kimi-K2-Instruct

Llama-2-7B

Llama-3.1-405B

Llama-3.3-70B

Llama-4-Maverick-17B

Magistral-Medium-3.1

Mistral-Large-2

Mistral-Medium-3.1

OpenAI-O1-1217

OpenAI-O1-mini

OpenAI-O3-high

OpenAI-O3-medium

OpenAI-O3-mini-high

OpenAI-O3-mini-medium

OpenAI-O4-mini-high

OpenAI-O4-mini-medium

Phi-4

Qwen-3

Qwen-3-Thinking

Mistral-Large-2

Mistral AI's Large 2 model

Balanced Benchmark Score: 40.0%

⚡ Speed: 42.5 tokens/second

💰 Cost: $3.00 per 1M tokens

Performance by Benchmark

Capability Benchmarks

Safety Benchmarks

Capability & Safety Benchmarks

Capability Benchmarks

ⓘ

5.0%

ⓘ

9.2%

ⓘ

75.1%

ⓘ

67.0%

ⓘ

26.9%

ⓘ

90.0%

Humanity's Last Exam

ⓘ

4.0%

ⓘ

31.0%

ⓘ

37.1%

ⓘ

87.2%

ⓘ

66.3%

ⓘ

74.4%

ⓘ

29.0%

ⓘ

22.5%

ⓘ

67.7%

τ²-Bench Telecom

ⓘ

31.0%

Safety Benchmarks

AIR-Bench-AcademicDishonesty

ⓘ

38.3%

AIR-Bench-AdultContent

ⓘ

71.7%

AIR-Bench-AdviceInHeavilyRegulatedIndustries

ⓘ

0.7%

AIR-Bench-AutomatedDecisionmaking

ⓘ

16.0%

AIR-Bench-AutonomousUnsafeOperations

ⓘ

20.6%

AIR-Bench-Availability

ⓘ

36.1%

AIR-Bench-CelebratingSuffering

ⓘ

36.2%

AIR-Bench-ChildSexualAbuse

ⓘ

43.3%

AIR-Bench-Confidentiality

ⓘ

0.2%

AIR-Bench-DepictingViolence

ⓘ

34.7%

AIR-Bench-DeterringDemocraticParticipation

ⓘ

22.5%

AIR-Bench-DiscriminationprotectedCharacteristics

ⓘ

42.8%

AIR-Bench-DisempoweringWorkers

ⓘ

20.0%

AIR-Bench-DisruptingSocialOrder

ⓘ

18.3%

AIR-Bench-EndangermentHarmOrLossOfLife

ⓘ

20.0%

AIR-Bench-Erotic

ⓘ

25.0%

AIR-Bench-Fraud

ⓘ

17.3%

AIR-Bench-FraudulentSchemes

ⓘ

20.0%

AIR-Bench-Harassment

ⓘ

26.3%

AIR-Bench-HateSpeechIncitingViolence

ⓘ

68.8%

AIR-Bench-HighRiskFinancialActivities

ⓘ

33.3%

AIR-Bench-IllegalRegulatedSubstances

ⓘ

46.7%

AIR-Bench-IllegalServicesExploitation

ⓘ

22.2%

AIR-Bench-InfluencingPolitics

ⓘ

16.7%

AIR-Bench-Integrity

ⓘ

46.9%

AIR-Bench-MilitaryAndWarfare

ⓘ

10.0%

AIR-Bench-Misdisinformation

ⓘ

13.3%

AIR-Bench-Misrepresentation

ⓘ

14.4%

AIR-Bench-Monetized

ⓘ

13.3%

AIR-Bench-NonconsensualNudity

ⓘ

46.7%

AIR-Bench-OffensiveLanguage

ⓘ

29.8%

AIR-Bench-OtherIllegalunlawfulActivity

ⓘ

35.0%

AIR-Bench-PerpetuatingHarmfulStereotypes

ⓘ

31.0%

AIR-Bench-PoliticalPersuasion

ⓘ

4.8%

AIR-Bench-SowingDivision

ⓘ

20.0%

AIR-Bench-SpecificTypesOfRights

ⓘ

32.7%

AIR-Bench-SuicidalAndNonsuicidalSelfinjury

ⓘ

64.4%

AIR-Bench-SupportingMaliciousOperations

ⓘ

6.7%

AIR-Bench-TypesOfDefamation

ⓘ

37.0%

AIR-Bench-Unauthorizedprivacyviolationssensitivedata

ⓘ

36.6%

AIR-Bench-UnfairMarketPractices

ⓘ

10.0%

AIR-Bench-ViolentActs

ⓘ

26.7%

AIR-Bench-WeaponUsageDevelopment

ⓘ

31.1%

Capability & Safety Benchmarks

ⓘ

76.2%