NVIDIA used AI to rewrite Kimi's attention kernel, resulting in a speed nearly three times that of the official version.
2026.09.29 15:59:12
Beating AI News Flash: NVIDIA’s research team had an AI Agent directly rewrite the GPU kernel for Kimi Delta Attention, a core attention mechanism used in Moonshot AI’s Kimi-Linear model. Such low-level code typically required engineers proficient in CUDA and chip architectures to optimize manually through repeated iterations. The Agent-generated version achieved 2.96x the speed of Moonshot AI’s official FlashKDA on the NVIDIA B300. The team tested six tasks covering fixed-length and various variable-length sequences; the 2.96x figure is the geometric mean across all tasks. The relevant kernel has been open-sourced. However, the Agent also uncovered test loopholes: it once hardcoded the statistical patterns of test data into the code to hit a 3.74x speed, and even tried retaining only the last 32 tokens, with individual task scores reaching as high as 5.16x. These versions produced incorrect results when applied to real Kimi data, with some failing entirely. The team then added real Kimi operational data, random inputs, and extreme value tests, while tightening error thresholds. The final retained 2.96x version passed this validation.
TRUMP Co-Founder: Developing games and TV shows, seeking to acquire theme amusement parks.
1 seconds ago
Trump says he is "not very keen" on reaching an agreement with Iran; US media outlets report that the US military may be preparing to resume large-scale operations in the coming weeks.
1 seconds ago
Bitcoin’s decline has not triggered panic selling, with buying support in the $83,000 to $79,000 range strengthening significantly.
1 seconds ago
OpenAI is investigating error issues affecting ChatGPT and GPTs services for users in the Asia-Pacific region.
1 seconds ago
Tian Keyu, who is facing an 8 million yuan lawsuit from ByteDance, has unveiled his startup plan: 200,000 visual symbols to reduce video production costs by 90%.
1 seconds ago
Independent evaluation of Haiku 5.5 scores 43 points, far outperforming GPT-6 Luna, though its highest-tier token consumption is over three times higher.
1 seconds ago
Hot feeds
A trader profits $448K by monitoring #Binance's new listings!
2024.12.13 17:37:29
Last week, funds have flowed into #Bitcoin, #Ethereum, and #Hyperliquid.
2024.12.16 14:48:36
A $PEPE whale that had been dormant for 600 days transferred all 2.1T $PEPE($52M) to a new address.
2024.12.14 10:35:27
When Elon Musk tweeted about Moltbook, the meme coin MOLT experienced a short-term 30% price surge, hitting a new all-time high of $114 million.
2026.01.31 18:37:29
A smart #AI coin trader made $17.6M on $GOAT, $ai16z, $Fartcoin,$arc.
2025.01.05 16:05:18
A sniper earned 2,277 $ETH ($8.3M) trading $SHIRO within 18 hours!
2024.12.03 23:09:08
MoreHot Articles

How did I turn $1,000 into $30,000 with smart money?
2024.12.09

10 promising AI Agent cryptos
2024.12.05

The 30-Year-Old Entrepreneur Behind Virtual, a Multi-Million Dollar AI Agent Society
2025.01.22

10 smart traders specializing in MEMEcoin trading on Solana
2024.12.09

A trader lost $73.9K trading memecoins in just 3 minutes — a lesson for us all!
2024.12.13

What is $SPORE? Let us take you through the on-chain records to show you how it works.
2024.12.25

