Ant Group's UBTree improves speculative decoding: parallel screening of draft trees enables large models to verify more tokens at a time.
43 minutes ago
Insight Beating AI News Flash: Ant Group’s Bailing has open-sourced the large language model speculative decoding scheme UBTree. Speculative decoding lets a small model draft outputs in advance, with a large model validating multiple tokens at once to cut down on token-by-token generation computation rounds. However, drafts suffer from hit rate issues: the earlier the small model guesses wrong, the less content can be adopted directly later. Existing tech prepares multiple candidate paths, organizes them into a draft tree, and prunes low-probability branches. UBTree improves the filtering method: it first parallelly predicts possible tokens for subsequent positions, then uses a lightweight model to assess adjacent token logical coherence. Different combinations are scored simultaneously, eliminating repeated model runs along each path. It then selects promising branches to form a draft tree for the large model’s validation. The team also adjusted the filtering model’s training approach, enabling it to not only focus on highest-probability answers but also identify viable alternative paths, letting the large model accept more tokens per round. In seven Qwen3-4B tests, the average speedup ratio using the DFlash 2 selector for tree construction was 5.95x. After switching to the UBTree selector and adjusting training, this rose to 6.88x, an approximate 16% improvement over the original scheme.
Trade.xyz Founder: 381-day-old product partners with ICE to build universal exchange.
10 minutes ago
Curve Finance launches on Stellar, becoming its first non-EVM native deployment.
10 minutes ago
Nearly $30 million in long positions poured into HYPE within half an hour.
10 minutes ago
Cartesia upgrades H-Net: Enables large models to autonomously learn data segmentation, boosting training efficiency by up to around 10 times.
10 minutes ago
HYPE continues its rally, rising more than 7% in the past hour.
10 minutes ago
A crypto whale opened a new crude oil long position worth approximately $18 million, and has racked up $15 million in losses recently.
10 minutes ago
Hot feeds
A trader profits $448K by monitoring #Binance's new listings!
2024.12.13 17:37:29
Last week, funds have flowed into #Bitcoin, #Ethereum, and #Hyperliquid.
2024.12.16 14:48:36
A $PEPE whale that had been dormant for 600 days transferred all 2.1T $PEPE($52M) to a new address.
2024.12.14 10:35:27
When Elon Musk tweeted about Moltbook, the meme coin MOLT experienced a short-term 30% price surge, hitting a new all-time high of $114 million.
2026.01.31 18:37:29
A smart #AI coin trader made $17.6M on $GOAT, $ai16z, $Fartcoin,$arc.
2025.01.05 16:05:18
A sniper earned 2,277 $ETH ($8.3M) trading $SHIRO within 18 hours!
2024.12.03 23:09:08
MoreHot Articles

How did I turn $1,000 into $30,000 with smart money?
2024.12.09

10 promising AI Agent cryptos
2024.12.05

The 30-Year-Old Entrepreneur Behind Virtual, a Multi-Million Dollar AI Agent Society
2025.01.22

10 smart traders specializing in MEMEcoin trading on Solana
2024.12.09

A trader lost $73.9K trading memecoins in just 3 minutes — a lesson for us all!
2024.12.13

What is $SPORE? Let us take you through the on-chain records to show you how it works.
2024.12.25

