MiniMax M3.1 Flash Faces Ranking Manipulation Controversy: Near Full Score on Old Questions, Almost Zero Score on New Ones
46 minutes ago
Beating AI Express News reports that large language model (LLM) evaluation blogger "Cat Boss" discovered during testing of MiniMax M3.1 Flash that the model scores nearly full marks on old questions but almost zero on new ones. On average, the model consumes tens of thousands of tokens per question, though it only uses around 10,000 tokens to answer some difficult questions correctly. This anomalous performance has sparked suspicion that the model may have memorized answers to some questions in advance. Cat Boss maintains the private "Zhizhi" LLM leaderboard, using a non-disclosed test set focused on evaluating logic, math, and coding capabilities. The test set typically includes no more than 28 questions and 270 test cases, with partial questions updated monthly. Each question is tested three times, and both the highest and median scores are tracked. The median score for M3.1 Flash reached 51.76, more than double the previous generation M3's 23.86, and is close to DeepSeek V4.1 Flash 1017's 56.03. Some developers suspect the model was specifically trained on old questions rather than truly mastering problem-solving methods. This practice of optimizing models solely to improve evaluation scores is known as "Benchmaxxing".
Drift attacker transfers 13,400 ETH to Tornado Cash after two months
4 minutes ago
1inch Card will be shut down on December 18.
4 minutes ago
Tencent, Alibaba, ByteDance and DeepSeek have all launched search services, adding a new infrastructure business for AI agents.
4 minutes ago
Binance will remove some FDUSD spot trading pairs.
4 minutes ago
Analysts: Bitcoin’s on-chain activity shows notable divergence, with whales shifting to hoarding coins while spot demand remains weak.
4 minutes ago
On-chain data for X-Agent is growing rapidly, with x402 payments exceeding 680,000 transactions.
4 minutes ago
Hot feeds
A trader profits $448K by monitoring #Binance's new listings!
2024.12.13 17:37:29
Last week, funds have flowed into #Bitcoin, #Ethereum, and #Hyperliquid.
2024.12.16 14:48:36
A $PEPE whale that had been dormant for 600 days transferred all 2.1T $PEPE($52M) to a new address.
2024.12.14 10:35:27
When Elon Musk tweeted about Moltbook, the meme coin MOLT experienced a short-term 30% price surge, hitting a new all-time high of $114 million.
2026.01.31 18:37:29
A smart #AI coin trader made $17.6M on $GOAT, $ai16z, $Fartcoin,$arc.
2025.01.05 16:05:18
A sniper earned 2,277 $ETH ($8.3M) trading $SHIRO within 18 hours!
2024.12.03 23:09:08
MoreHot Articles

How did I turn $1,000 into $30,000 with smart money?
2024.12.09

10 promising AI Agent cryptos
2024.12.05

The 30-Year-Old Entrepreneur Behind Virtual, a Multi-Million Dollar AI Agent Society
2025.01.22

10 smart traders specializing in MEMEcoin trading on Solana
2024.12.09

A trader lost $73.9K trading memecoins in just 3 minutes — a lesson for us all!
2024.12.13

What is $SPORE? Let us take you through the on-chain records to show you how it works.
2024.12.25

