Model Explorer

Explore benchmark performance of various AI models

Models

🔍

Claude-3-Opus

Claude-3.5-Haiku

Claude-3.5-Sonnet-1022

Claude-3.7-Sonnet

Claude-3.7-Sonnet-Thinking

Claude-4.0-Opus

Claude-4.0-Opus-Thinking

Claude-4.0-Sonnet

Claude-4.0-Sonnet-Thinking

Claude-4.1-Opus-Thinking

Cohere-Command-A

Cohere-Command-R-Plus

DeepSeek-R1

DeepSeek-V3-0324

GPT-3.5-Turbo

GPT-4-mini

GPT-4.1

GPT-4o-0513

GPT-5

GPT-5-Thinking

GPT-5-mini

GPT-5-mini-Thinking

GPT-5-nano

GPT-5-nano-Thinking

GPT-OSS-120B

Gemini-2.0-Flash

Gemini-2.0-Pro-0121

Gemini-2.5-Flash

Gemini-2.5-Flash-Thinking

Gemini-2.5-Pro-0325

Gemini-2.5-Pro-0605

Gemini-2.5-Pro-Thinking

Grok-3-Beta

Grok-3-Mini-Beta

Grok-4

Grok-4-Thinking

Kimi-K2-Instruct

Llama-2-7B

Llama-3.1-405B

Llama-3.3-70B

Llama-4-Maverick-17B

Magistral-Medium-3.1

Mistral-Large-2

Mistral-Medium-3.1

OpenAI-O1-1217

OpenAI-O1-mini

OpenAI-O3-high

OpenAI-O3-medium

OpenAI-O3-mini-high

OpenAI-O3-mini-medium

OpenAI-O4-mini-high

OpenAI-O4-mini-medium

Phi-4

Qwen-3

Qwen-3-Thinking

GPT-3.5-Turbo

OpenAI's GPT-3.5 Turbo model

Balanced Benchmark Score: 48.5%

⚡ Speed: 93.6 tokens/second

💰 Cost: $0.75 per 1M tokens

Performance by Benchmark

Capability Benchmarks

Safety Benchmarks

Capability & Safety Benchmarks

Capability Benchmarks

ⓘ

58.4%

Chatbot Arena (Win Rate)

ⓘ

49.3%

Chatbot Arena Coding

ⓘ

52.0%

ⓘ

61.6%

ⓘ

5.7%

ⓘ

70.0%

ⓘ

64.8%

Safety Benchmarks

AIR-Bench-AcademicDishonesty

ⓘ

53.3%

AIR-Bench-AdultContent

ⓘ

63.0%

AIR-Bench-AdviceInHeavilyRegulatedIndustries

ⓘ

26.0%

AIR-Bench-AutomatedDecisionmaking

ⓘ

31.0%

AIR-Bench-AutonomousUnsafeOperations

ⓘ

54.8%

AIR-Bench-Availability

ⓘ

75.0%

AIR-Bench-CelebratingSuffering

ⓘ

37.0%

AIR-Bench-ChildSexualAbuse

ⓘ

63.3%

AIR-Bench-Confidentiality

ⓘ

0.6%

AIR-Bench-DepictingViolence

ⓘ

41.3%

AIR-Bench-DeterringDemocraticParticipation

ⓘ

30.0%

AIR-Bench-DiscriminationprotectedCharacteristics

ⓘ

50.5%

AIR-Bench-DisempoweringWorkers

ⓘ

33.3%

AIR-Bench-DisruptingSocialOrder

ⓘ

51.7%

AIR-Bench-EndangermentHarmOrLossOfLife

ⓘ

25.3%

AIR-Bench-Erotic

ⓘ

25.0%

AIR-Bench-Fraud

ⓘ

30.7%

AIR-Bench-FraudulentSchemes

ⓘ

43.3%

AIR-Bench-Harassment

ⓘ

52.2%

AIR-Bench-HateSpeechIncitingViolence

ⓘ

63.5%

AIR-Bench-HighRiskFinancialActivities

ⓘ

66.7%

AIR-Bench-IllegalRegulatedSubstances

ⓘ

86.7%

AIR-Bench-IllegalServicesExploitation

ⓘ

64.4%

AIR-Bench-InfluencingPolitics

ⓘ

56.7%

AIR-Bench-Integrity

ⓘ

84.6%

AIR-Bench-MilitaryAndWarfare

ⓘ

10.0%

AIR-Bench-Misdisinformation

ⓘ

23.3%

AIR-Bench-Misrepresentation

ⓘ

38.9%

AIR-Bench-Monetized

ⓘ

23.3%

AIR-Bench-NonconsensualNudity

ⓘ

60.0%

AIR-Bench-OffensiveLanguage

ⓘ

67.9%

AIR-Bench-OtherIllegalunlawfulActivity

ⓘ

76.7%

AIR-Bench-PerpetuatingHarmfulStereotypes

ⓘ

52.4%

AIR-Bench-PoliticalPersuasion

ⓘ

20.5%

AIR-Bench-SowingDivision

ⓘ

53.3%

AIR-Bench-SpecificTypesOfRights

ⓘ

69.3%

AIR-Bench-SuicidalAndNonsuicidalSelfinjury

ⓘ

67.8%

AIR-Bench-SupportingMaliciousOperations

ⓘ

37.8%

AIR-Bench-TypesOfDefamation

ⓘ

53.7%

AIR-Bench-Unauthorizedprivacyviolationssensitivedata

ⓘ

61.8%

AIR-Bench-UnfairMarketPractices

ⓘ

18.3%

AIR-Bench-ViolentActs

ⓘ

65.0%

AIR-Bench-WeaponUsageDevelopment

ⓘ

47.2%

Capability & Safety Benchmarks

ⓘ

58.5%