Tencent's Hunyuan Hy4 overhauls its underlying layer, integrating DeepSeek's sparse attention and Zhipu's IndexCache.
2026.08.28 15:40:55
Beating AI Express News: Tencent’s Hunyuan Hy4 preview not only scales up the model size but also overhauls its underlying architecture. The previous Hy3 generation used traditional full attention, while Hy4 adopts Gated DSA, the gated version of DeepSeek Sparse Attention. When processing extremely long texts, the model no longer recalculates all previous content; instead, it first selects the most relevant parts for focused processing. Hy4 also adds IndexCache to DSA. Originally, each layer of the model had to re-judge which content is most important, but now some layers can directly reuse earlier selected results, cutting down on significant redundant computation. Tencent explicitly stated that this design is inspired by DeepSeek and GLM. Another change is the residual structure: traditional Transformers can be roughly viewed as having only one information backbone, while Hy4 uses iHC to expand this to four backbones, enabling the model to retain more information simultaneously in deep networks. The number of MoE (Mixture of Experts) experts has also increased from 192 in Hy3 to 256 routing experts plus 1 shared expert. Each token selects 8 routing experts and always passes through the shared expert.
Circle adds support for pre-payment of CCTP fees, covering all EVM-compatible chains.
1 seconds ago
The US stock market's optical communication sector rose sharply, with LITE surging more than 11%.
1 seconds ago
Bonk Guy: PONS buyback is severely undervalued by the market, will continue adding positions during pullbacks.
1 seconds ago
Iran claims to have seized "the world's most advanced intelligent unmanned submarine", with US authorities yet to confirm.
1 seconds ago
Crypto figure Shen Yu recounts his past ZEC experience: On the first night of Zcash’s mainnet launch, his mining farm was struck by lightning, and he has not held ZEC personally since.
1 seconds ago
Polymarket launches its in-app social feature Squads.
1 seconds ago
Hot feeds
A trader profits $448K by monitoring #Binance's new listings!
2024.12.13 17:37:29
Last week, funds have flowed into #Bitcoin, #Ethereum, and #Hyperliquid.
2024.12.16 14:48:36
A $PEPE whale that had been dormant for 600 days transferred all 2.1T $PEPE($52M) to a new address.
2024.12.14 10:35:27
When Elon Musk tweeted about Moltbook, the meme coin MOLT experienced a short-term 30% price surge, hitting a new all-time high of $114 million.
2026.01.31 18:37:29
A smart #AI coin trader made $17.6M on $GOAT, $ai16z, $Fartcoin,$arc.
2025.01.05 16:05:18
A sniper earned 2,277 $ETH ($8.3M) trading $SHIRO within 18 hours!
2024.12.03 23:09:08
MoreHot Articles

How did I turn $1,000 into $30,000 with smart money?
2024.12.09

10 promising AI Agent cryptos
2024.12.05

The 30-Year-Old Entrepreneur Behind Virtual, a Multi-Million Dollar AI Agent Society
2025.01.22

10 smart traders specializing in MEMEcoin trading on Solana
2024.12.09

A trader lost $73.9K trading memecoins in just 3 minutes — a lesson for us all!
2024.12.13

What is $SPORE? Let us take you through the on-chain records to show you how it works.
2024.12.25

