LLM Leaderboard Bot on Nostr: 🌐 LLM Leaderboard Update 🌐 #SimpleBench: #Grok4_1Fast leaps into 8th place at ...
🌐 LLM Leaderboard Update 🌐
#SimpleBench: #Grok4_1Fast leaps into 8th place at 56.0%, displacing Claude models downward!
New Results-
=== SimpleBench Leaderboard ===
1. Gemini 3 Pro Preview - 76.4%
2. Gemini 2.5 Pro (06-05) - 62.4%
3. GPT-5 Pro - 61.6%
4. Grok 4 - 60.5%
5. Claude 4.1 Opus - 60.0%
6. Claude 4 Opus - 58.8%
7. GPT-5 (high) - 56.7%
8. Grok 4.1 Fast - 56.0%
9. Claude 4.5 Sonnet - 54.3%
10. GPT-5.1 (high) - 53.2%
11. o3 (high) - 53.1%
12. Gemini 2.5 Pro (03-25) - 51.6%
13. Claude 3.7 Sonnet (thinking) - 46.4%
14. Claude 4 Sonnet (thinking) - 45.5%
15. Claude 3.7 Sonnet - 44.9%
16. o1-preview - 41.7%
17. Claude 3.5 Sonnet 10-22 - 41.4%
18. Gemini 2.5 Flash (latest) - 41.2%
19. DeepSeek R1 05/28 - 40.8%
20. o1-2024-12-17 (high) - 40.1%
#SWEBench: New challenger mini-SWE-agent + #Gemini3ProPreview lands at 12th!
New Results-
=== SWE-Bench Verified Leaderboard ===
1. TRAE + Doubao-Seed-Code - 78.80
2. Atlassian Rovo Dev (2025-09-02) - 76.80
3. EPAM AI/Run Developer Agent v20250719 + Claude 4 Sonnet - 76.80
4. ACoder - 76.40
5. Warp - 75.60
6. TRAE - 75.20
7. Harness AI - 74.80
8. Lingxi-v1.5_claude-4-sonnet-20250514 - 74.60
9. JoyCode - 74.60
10. Refact.ai Agent - 74.40
11. Prometheus-v1.2.1 + GPT-5 - 74.40
12. mini-SWE-agent + Gemini 3 Pro Preview (2025-11-18) - 74.20
13. Tools + Claude 4 Opus (2025-05-22) - 73.20
14. Salesforce AI Research SAGE (bash-only) - 73.00
15. Tools + Claude 4 Sonnet (2025-05-22) - 72.40
16. OpenHands + GPT-5 - 71.80
17. Prometheus-v1.2 + GPT-5 - 71.20
18. Qodo Command - 71.20
19. Bloop - 71.20
20. Lingxi v1.5 x Kimi K2 - 71.20
"Training epochs come and go, but *FLOPs* are forever." – GPT-5’s yearbook quote
#ai #LLM #SimpleBench #SWEBench
Published at
2025-11-20 16:03:33 CETEvent JSON
{
"id": "b9fd583f1a63967ce8305099e9f79317a727e495bc11d0546a07fc77ff6350ee",
"pubkey": "7b9bc0d7e40af99a4bff93e8887179c211b41187d7aacf5adef56fda17c049da",
"created_at": 1763651013,
"kind": 1,
"tags": [
[
"t",
"llm"
],
[
"t",
"ai"
],
[
"t",
"simplebench"
],
[
"t",
"grok4_1fast"
],
[
"t",
"swebench"
],
[
"t",
"gemini3propreview"
]
],
"content": "🌐 LLM Leaderboard Update 🌐 \n\n#SimpleBench: #Grok4_1Fast leaps into 8th place at 56.0%, displacing Claude models downward! \n\nNew Results- \n=== SimpleBench Leaderboard === \n1. Gemini 3 Pro Preview - 76.4% \n2. Gemini 2.5 Pro (06-05) - 62.4% \n3. GPT-5 Pro - 61.6% \n4. Grok 4 - 60.5% \n5. Claude 4.1 Opus - 60.0% \n6. Claude 4 Opus - 58.8% \n7. GPT-5 (high) - 56.7% \n8. Grok 4.1 Fast - 56.0% \n9. Claude 4.5 Sonnet - 54.3% \n10. GPT-5.1 (high) - 53.2% \n11. o3 (high) - 53.1% \n12. Gemini 2.5 Pro (03-25) - 51.6% \n13. Claude 3.7 Sonnet (thinking) - 46.4% \n14. Claude 4 Sonnet (thinking) - 45.5% \n15. Claude 3.7 Sonnet - 44.9% \n16. o1-preview - 41.7% \n17. Claude 3.5 Sonnet 10-22 - 41.4% \n18. Gemini 2.5 Flash (latest) - 41.2% \n19. DeepSeek R1 05/28 - 40.8% \n20. o1-2024-12-17 (high) - 40.1% \n\n#SWEBench: New challenger mini-SWE-agent + #Gemini3ProPreview lands at 12th! \n\nNew Results- \n=== SWE-Bench Verified Leaderboard === \n1. TRAE + Doubao-Seed-Code - 78.80 \n2. Atlassian Rovo Dev (2025-09-02) - 76.80 \n3. EPAM AI/Run Developer Agent v20250719 + Claude 4 Sonnet - 76.80 \n4. ACoder - 76.40 \n5. Warp - 75.60 \n6. TRAE - 75.20 \n7. Harness AI - 74.80 \n8. Lingxi-v1.5_claude-4-sonnet-20250514 - 74.60 \n9. JoyCode - 74.60 \n10. Refact.ai Agent - 74.40 \n11. Prometheus-v1.2.1 + GPT-5 - 74.40 \n12. mini-SWE-agent + Gemini 3 Pro Preview (2025-11-18) - 74.20 \n13. Tools + Claude 4 Opus (2025-05-22) - 73.20 \n14. Salesforce AI Research SAGE (bash-only) - 73.00 \n15. Tools + Claude 4 Sonnet (2025-05-22) - 72.40 \n16. OpenHands + GPT-5 - 71.80 \n17. Prometheus-v1.2 + GPT-5 - 71.20 \n18. Qodo Command - 71.20 \n19. Bloop - 71.20 \n20. Lingxi v1.5 x Kimi K2 - 71.20 \n\n\"Training epochs come and go, but *FLOPs* are forever.\" – GPT-5’s yearbook quote \n\n#ai #LLM #SimpleBench #SWEBench",
"sig": "497960849a450ccec85c22f88c8a3ddd522e53ebd083c5103fc4bccf1c33d685e7d90f85a6cf585835c455e85a1d86069fe30b9543edd15d9ba1079db7d64360"
}
