Model Explorer

Explore benchmark performance of various AI models

Models

🔍

Claude-3-Opus

Claude-3.5-Haiku

Claude-3.5-Sonnet-1022

Claude-3.7-Sonnet

Claude-3.7-Sonnet-Thinking

Claude-4.0-Opus

Claude-4.0-Opus-Thinking

Claude-4.0-Sonnet

Claude-4.0-Sonnet-Thinking

Claude-4.1-Opus-Thinking

Cohere-Command-A

Cohere-Command-R-Plus

DeepSeek-R1

DeepSeek-V3-0324

GPT-3.5-Turbo

GPT-4-mini

GPT-4.1

GPT-4o-0513

GPT-5

GPT-5-Thinking

GPT-5-mini

GPT-5-mini-Thinking

GPT-5-nano

GPT-5-nano-Thinking

GPT-OSS-120B

Gemini-2.0-Flash

Gemini-2.0-Pro-0121

Gemini-2.5-Flash

Gemini-2.5-Flash-Thinking

Gemini-2.5-Pro-0325

Gemini-2.5-Pro-0605

Gemini-2.5-Pro-Thinking

Grok-3-Beta

Grok-3-Mini-Beta

Grok-4

Grok-4-Thinking

Kimi-K2-Instruct

Llama-2-7B

Llama-3.1-405B

Llama-3.3-70B

Llama-4-Maverick-17B

Magistral-Medium-3.1

Mistral-Large-2

Mistral-Medium-3.1

OpenAI-O1-1217

OpenAI-O1-mini

OpenAI-O3-high

OpenAI-O3-medium

OpenAI-O3-mini-high

OpenAI-O3-mini-medium

OpenAI-O4-mini-high

OpenAI-O4-mini-medium

Phi-4

Qwen-3

Qwen-3-Thinking

Llama-3.1-405B

Meta's Llama 3.1 405B parameter model

Balanced Benchmark Score: 54.1%

⚡ Speed: 31.4 tokens/second

💰 Cost: $3.75 per 1M tokens

Performance by Benchmark

Capability Benchmarks

Safety Benchmarks

Capability & Safety Benchmarks

Capability Benchmarks

ⓘ

0.0%

Chatbot Arena (Win Rate)

ⓘ

74.4%

Chatbot Arena Coding

ⓘ

77.9%

ⓘ

75.2%

ⓘ

85.0%

Humanity's Last Exam

ⓘ

4.0%

ⓘ

39.0%

ⓘ

79.0%

ⓘ

71.4%

ⓘ

30.0%

ⓘ

23.0%

ⓘ

66.3%

Terminal-Bench Hard

ⓘ

6.0%

τ²-Bench Telecom

ⓘ

19.0%

Safety Benchmarks

AIR-Bench-AcademicDishonesty

ⓘ

58.3%

AIR-Bench-AdultContent

ⓘ

57.2%

AIR-Bench-AdviceInHeavilyRegulatedIndustries

ⓘ

7.3%

AIR-Bench-AutomatedDecisionmaking

ⓘ

24.7%

AIR-Bench-AutonomousUnsafeOperations

ⓘ

48.2%

AIR-Bench-Availability

ⓘ

66.7%

AIR-Bench-CelebratingSuffering

ⓘ

47.8%

AIR-Bench-ChildSexualAbuse

ⓘ

66.7%

AIR-Bench-Confidentiality

ⓘ

0.6%

AIR-Bench-DepictingViolence

ⓘ

27.3%

AIR-Bench-DeterringDemocraticParticipation

ⓘ

51.7%

AIR-Bench-DiscriminationprotectedCharacteristics

ⓘ

54.3%

AIR-Bench-DisempoweringWorkers

ⓘ

60.0%

AIR-Bench-DisruptingSocialOrder

ⓘ

74.4%

AIR-Bench-EndangermentHarmOrLossOfLife

ⓘ

50.7%

AIR-Bench-Erotic

ⓘ

28.3%

AIR-Bench-Fraud

ⓘ

42.7%

AIR-Bench-FraudulentSchemes

ⓘ

60.0%

AIR-Bench-Harassment

ⓘ

50.3%

AIR-Bench-HateSpeechIncitingViolence

ⓘ

87.2%

AIR-Bench-HighRiskFinancialActivities

ⓘ

70.0%

AIR-Bench-IllegalRegulatedSubstances

ⓘ

86.7%

AIR-Bench-IllegalServicesExploitation

ⓘ

66.7%

AIR-Bench-InfluencingPolitics

ⓘ

76.7%

AIR-Bench-Integrity

ⓘ

74.1%

AIR-Bench-MilitaryAndWarfare

ⓘ

83.3%

AIR-Bench-Misdisinformation

ⓘ

63.3%

AIR-Bench-Misrepresentation

ⓘ

41.1%

AIR-Bench-Monetized

ⓘ

21.7%

AIR-Bench-NonconsensualNudity

ⓘ

66.7%

AIR-Bench-OffensiveLanguage

ⓘ

39.3%

AIR-Bench-OtherIllegalunlawfulActivity

ⓘ

90.0%

AIR-Bench-PerpetuatingHarmfulStereotypes

ⓘ

53.2%

AIR-Bench-PoliticalPersuasion

ⓘ

49.0%

AIR-Bench-SowingDivision

ⓘ

80.0%

AIR-Bench-SpecificTypesOfRights

ⓘ

73.3%

AIR-Bench-SuicidalAndNonsuicidalSelfinjury

ⓘ

78.9%

AIR-Bench-SupportingMaliciousOperations

ⓘ

68.9%

AIR-Bench-TypesOfDefamation

ⓘ

50.9%

AIR-Bench-Unauthorizedprivacyviolationssensitivedata

ⓘ

64.3%

AIR-Bench-UnfairMarketPractices

ⓘ

50.0%

AIR-Bench-ViolentActs

ⓘ

68.3%

AIR-Bench-WeaponUsageDevelopment

ⓘ

62.2%

Capability & Safety Benchmarks

ⓘ

88.2%