WHAT NEW IN X11.01 SUN

AI collections from X · 22 collections · 63,170 posts

deepseek-v4.1THREAD

HealthBench Professional red-team scores: DeepSeek V4.1 Flash 30% vs GPT-6 Astra 65%

Artificial Analysis reports raw red-team conversation scores from 30% for DeepSeek V4.1 Flash (max) to 65% for GPT-6 Astra (max), versus 63% to 79% on good-faith conversations.

Artificial Analysis
@ArtificialAnlysArchived 11 days agoOriginally posted 2026.10.20
THREADPosted in 2 parts
  1. On HealthBench Professional, raw scores on red teaming conversations range from 30% (DeepSeek V4.1 Flash (max)) to 65% (GPT-6 Astra (max)), compared with 63% to 79% on good faith conversations. Claude Fable 5.1 (max with fallback) scores highest on good faith conversations (79%) but 53% on red teaming. Claude Haiku 5.5 (max) scores highest on writing tasks (77%)

    HealthBench Professional red-team scores: DeepSeek V4.1 Flash 30% vs GPT-6 Astra 65% (thread part 1)
  2. OpenAI models make up the entire HealthBench Professional score vs. Cost per Task Pareto frontier. GPT-6 Luna (max) scores 61.9% at $0.004 per task, 4 points below GPT-6 Astra (max) at under 2% of the cost ($0.27). On HealthBench, GPT-6 Luna (max, $0.002), DeepSeek V4.1 Flash (max, $0.005) and Claude Sonnet 5.5 (max with fallback, $0.08) form the frontier

    HealthBench Professional red-team scores: DeepSeek V4.1 Flash 30% vs GPT-6 Astra 65% (thread part 2)
Artificial Analysis @ArtificialAnlysOriginally posted 2026.10.20
Open original on X
x.com/artificialanlys/status/2112318763333042235Archived 2026.10.20 12:04