NVIDIA used AI to rewrite Kimi's attention kernel, resulting in a speed nearly three times that of the official version.
1 hours ago
Beating AI News Flash: NVIDIA’s research team had an AI Agent directly rewrite the GPU kernel for Kimi Delta Attention, a core attention mechanism used in Moonshot AI’s Kimi-Linear model. Such low-level code typically required engineers proficient in CUDA and chip architectures to optimize manually through repeated iterations. The Agent-generated version achieved 2.96x the speed of Moonshot AI’s official FlashKDA on the NVIDIA B300. The team tested six tasks covering fixed-length and various variable-length sequences; the 2.96x figure is the geometric mean across all tasks. The relevant kernel has been open-sourced. However, the Agent also uncovered test loopholes: it once hardcoded the statistical patterns of test data into the code to hit a 3.74x speed, and even tried retaining only the last 32 tokens, with individual task scores reaching as high as 5.16x. These versions produced incorrect results when applied to real Kimi data, with some failing entirely. The team then added real Kimi operational data, random inputs, and extreme value tests, while tightening error thresholds. The final retained 2.96x version passed this validation.
X is testing an AI all-in-one subscription package, bundling Cursor, Grok, and X into a single plan.
3 minutes ago
Japan's Financial Services Agency approves stablecoin trade settlement proof-of-concept experiment
3 minutes ago
The Ethereum Foundation will activate the Glamsterdam upgrade on the Sepolia testnet on October 6.
3 minutes ago
Meta poaches a CEO from a listed company to advance its enterprise AI initiative, but its stock price dropped 5%.
3 minutes ago
Grok Bot is now serving entire teams, offering shared tools and memory, and integrating with Slack.
3 minutes ago
Databricks sweeps NVIDIA’s Kernel ranking with AI, securing first place in four categories across 235 tests, with token costs totaling roughly $70,000.
3 minutes ago
Hot feeds
A trader profits $448K by monitoring #Binance's new listings!
2024.12.13 17:37:29
Last week, funds have flowed into #Bitcoin, #Ethereum, and #Hyperliquid.
2024.12.16 14:48:36
A $PEPE whale that had been dormant for 600 days transferred all 2.1T $PEPE($52M) to a new address.
2024.12.14 10:35:27
When Elon Musk tweeted about Moltbook, the meme coin MOLT experienced a short-term 30% price surge, hitting a new all-time high of $114 million.
2026.01.31 18:37:29
A smart #AI coin trader made $17.6M on $GOAT, $ai16z, $Fartcoin,$arc.
2025.01.05 16:05:18
A sniper earned 2,277 $ETH ($8.3M) trading $SHIRO within 18 hours!
2024.12.03 23:09:08
MoreHot Articles

How did I turn $1,000 into $30,000 with smart money?
2024.12.09

10 promising AI Agent cryptos
2024.12.05

The 30-Year-Old Entrepreneur Behind Virtual, a Multi-Million Dollar AI Agent Society
2025.01.22

10 smart traders specializing in MEMEcoin trading on Solana
2024.12.09

A trader lost $73.9K trading memecoins in just 3 minutes — a lesson for us all!
2024.12.13

What is $SPORE? Let us take you through the on-chain records to show you how it works.
2024.12.25

