SemiAnalysis: Kimi K3 significantly reduces KV (Key-Value) transmission bandwidth, but AI network demand will not shrink as a result.
4 days ago
Independent semiconductor and AI research firm SemiAnalysis has published a report stating that while Kimi K3 uses KDA for roughly three-quarters of its network layers, cutting KV cache transmission bandwidth by up to 10 times compared to a full global attention model, this does not mean the AI network switch market will see a significant contraction. The Kimi K3 boasts 2.8 trillion parameters; even with MXFP4 precision, each forward computation requires around 1.5TB of HBM bandwidth. To maintain reasonable interaction speed while enabling profitable deployment, the model still needs high-bandwidth network connections such as GB300 NVL72 to link a large number of chips, and relies on WideEP for scaling services. WideEP distributes 896 expert models across multiple GPUs, performing token distribution and result merging twice per layer and per forward pass, with over 120 such operations required for a single forward computation. In contrast, KV cache transmission between pre-filling and decoding only occurs once per conversation round, meaning the bandwidth saved by KDA may be far less than the network scaling demands imposed by large-scale expert models. SemiAnalysis adds that more efficient attention mechanisms could also push context lengths from 1 million tokens to over 5 million tokens. Per Jevons’ paradox, efficiency improvements may expand the overall scale of AI usage, further increasing network requirements.
US Senator Cynthia Lummis: In the coming days, she will continue to push for a bipartisan agreement on the CLARITY Act to enact it into law.
5 hours ago
The CLARITY Act adds, for the first time, provisions restricting the president and government officials from profiting through crypto assets.
5 hours ago
The revised CLARITY Act has been officially released, prohibiting the president and government officials from issuing or sponsoring crypto assets for profit.
5 hours ago
Report: Crypto industry contributes $55 billion to U.S. economy, directly employs 34,000 people
5 hours ago
The development company behind Pump.fun is hiring a Growth Marketing Lead, offering a base annual salary of up to $1 million.
5 hours ago
灰度:若美联储不再加息,比特币或已触底
5 hours ago
Hot feeds
A trader profits $448K by monitoring #Binance's new listings!
2024.12.13 17:37:29
Last week, funds have flowed into #Bitcoin, #Ethereum, and #Hyperliquid.
2024.12.16 14:48:36
A $PEPE whale that had been dormant for 600 days transferred all 2.1T $PEPE($52M) to a new address.
2024.12.14 10:35:27
When Elon Musk tweeted about Moltbook, the meme coin MOLT experienced a short-term 30% price surge, hitting a new all-time high of $114 million.
2026.01.31 18:37:29
A smart #AI coin trader made $17.6M on $GOAT, $ai16z, $Fartcoin,$arc.
2025.01.05 16:05:18
A sniper earned 2,277 $ETH ($8.3M) trading $SHIRO within 18 hours!
2024.12.03 23:09:08
MoreHot Articles

How did I turn $1,000 into $30,000 with smart money?
2024.12.09

10 promising AI Agent cryptos
2024.12.05

The 30-Year-Old Entrepreneur Behind Virtual, a Multi-Million Dollar AI Agent Society
2025.01.22

10 smart traders specializing in MEMEcoin trading on Solana
2024.12.09

A trader lost $73.9K trading memecoins in just 3 minutes — a lesson for us all!
2024.12.13

What is $SPORE? Let us take you through the on-chain records to show you how it works.
2024.12.25

