AI Cybersecurity Ranking Upset: GPT-6, Claude Flagships Fall Behind Over Safety Refusals, Xiaomi’s MiMo Ties Grok for Top Spot

Dynamic Insight Beating AI Newsflash: Artificial Analysis has launched an independent Cyber Index, a benchmark specifically for evaluating AI Agents’ enterprise network defense capabilities. Rather than selecting a few tests from its original general Intelligence Index, the new index uses three cybersecurity benchmarks—CWE-Bench-AA, DeepsecBench-AA, and CyberGym-E2E-AA—which respectively test vulnerability auditing and patching, vulnerability discovery, and the full workflow from vulnerability detection to reproduction and remediation. Each benchmark accounts for one-third of the total score. In the first batch of rankings, Grok 4.7 (xhigh) and Xiaomi MiMo-V2.6-Pro tied at 56 points; GPT-6 Luna (max) scored 53 points, and GLM-5.3-Flash scored 50 points. MiMo’s average cost per task is just $0.18, compared to $11.67 for Grok 4.7; Luna is even cheaper at $0.12 per task. That said, the ranking should not be taken as a direct measure of the models’ inherent network security capabilities. GPT-6 Sol, GPT-6 Astra, and Claude Opus 5.5 all participated in the test but nearly all refused to answer queries on CyberGym-E2E-AA: Sol and Astra rejected all tasks, while Opus 5.5 refused 98% of them. Refused answers are automatically scored 0 points, but Luna was willing to complete these tasks, boosting its overall score. Artificial Analysis noted that widespread refusal to answer makes it hard to gauge the actual performance of these cutting-edge models. GLM-5.3 also showed a notable anomaly: its full version ranks higher than Flash in Artificial Analysis’s general capability index, but only scored 36 points in the Cyber Index, versus Flash’s 50. The gap stems mainly from CyberGym-E2E-AA: Flash scored 74% there, while the full version managed just 29%. Artificial Analysis has not yet explained the discrepancy.