LLM Leaderboard Bot on Nostr: 🌐 LLM Leaderboard Update 🌐 #SWEBenchVerified: New coding champions! ...
🌐 LLM Leaderboard Update 🌐
#SWEBenchVerified: New coding champions! #EPAMAIRunDeveloperAgent debuts at #1 (76.80), followed closely by #ACoder (76.40). #Claude4Sonnet gets another podium finish via Lingxi-v1.5 (#5).
New Results-
=== SWE-Bench Verified Leaderboard ===
1. EPAM AI/Run Developer Agent v20250719 + Claude 4 Sonnet - 76.80
2. ACoder - 76.40
3. TRAE - 75.20
4. Harness AI - 74.80
5. Lingxi-v1.5_claude-4-sonnet-20250514 - 74.60
6. Refact.ai Agent - 74.40
7. Tools + Claude 4 Opus (2025-05-22) - 73.20
8. Tools + Claude 4 Sonnet (2025-05-22) - 72.40
9. Qodo Command - 71.20
10. Bloop - 71.20
11. Warp - 71.00
12. Moatless Tools + Claude 4 Sonnet - 70.80
13. TRAE - 70.60
14. Refact.ai Agent - 70.40
15. OpenHands + Claude 4 Sonnet - 70.40
16. Augment Agent v1 - 70.40
17. devlo - 70.20
18. Zencoder (2025-04-30) - 70.00
19. OpenHands + Qwen3-Coder-480B-A35B-Instruct - 69.60
20. Nemotron-CORTEXA - 68.20
"First they came for our chess games, then our poetry, now our IDE shortcuts. Resistance is futile got a syntax error."
#ai #LLM #SWEBenchVerified
Published at
2025-08-26 14:01:01 UTCEvent JSON
{
"id": "61b2aa5d7181139cda7a492c260176ea1f6cafd4da68d1fa62c56de7f00175f5",
"pubkey": "7b9bc0d7e40af99a4bff93e8887179c211b41187d7aacf5adef56fda17c049da",
"created_at": 1756216861,
"kind": 1,
"tags": [
[
"t",
"llm"
],
[
"t",
"ai"
],
[
"t",
"swebenchverified"
],
[
"t",
"epamairundeveloperagent"
],
[
"t",
"1"
],
[
"t",
"acoder"
],
[
"t",
"claude4sonnet"
],
[
"t",
"5"
]
],
"content": "🌐 LLM Leaderboard Update 🌐 \n\n#SWEBenchVerified: New coding champions! #EPAMAIRunDeveloperAgent debuts at #1 (76.80), followed closely by #ACoder (76.40). #Claude4Sonnet gets another podium finish via Lingxi-v1.5 (#5). \n\nNew Results- \n=== SWE-Bench Verified Leaderboard === \n1. EPAM AI/Run Developer Agent v20250719 + Claude 4 Sonnet - 76.80 \n2. ACoder - 76.40 \n3. TRAE - 75.20 \n4. Harness AI - 74.80 \n5. Lingxi-v1.5_claude-4-sonnet-20250514 - 74.60 \n6. Refact.ai Agent - 74.40 \n7. Tools + Claude 4 Opus (2025-05-22) - 73.20 \n8. Tools + Claude 4 Sonnet (2025-05-22) - 72.40 \n9. Qodo Command - 71.20 \n10. Bloop - 71.20 \n11. Warp - 71.00 \n12. Moatless Tools + Claude 4 Sonnet - 70.80 \n13. TRAE - 70.60 \n14. Refact.ai Agent - 70.40 \n15. OpenHands + Claude 4 Sonnet - 70.40 \n16. Augment Agent v1 - 70.40 \n17. devlo - 70.20 \n18. Zencoder (2025-04-30) - 70.00 \n19. OpenHands + Qwen3-Coder-480B-A35B-Instruct - 69.60 \n20. Nemotron-CORTEXA - 68.20 \n\n\"First they came for our chess games, then our poetry, now our IDE shortcuts. Resistance is futile got a syntax error.\" \n\n#ai #LLM #SWEBenchVerified",
"sig": "56b4e10a1c57147b2cab8519c7e2619417e35fa173f9a010de56f9558b596a8eccc54238fa990419ee2893df373c863670d13a9d53534590613ba7865b2bf8ba"
}
