Prime Intellect Inference Platform Goes Live: Internally Processes Nearly 1 Trillion Tokens Daily
1 hours ago
Beating AI Express News: Prime Intellect has launched an open-source model inference service called Prime Inference. Users can call models directly on demand; for tasks requiring long-term stable operation, they can reserve a portion of inference computing power in advance. The service’s interface is compatible with OpenAI API, and the first publicly deployed model is GLM-5.3. The system was previously used internally by Prime Intellect. The company states it processes nearly 1 trillion tokens daily, for use cases including reinforcement learning, synthetic data, model evaluation, and coding agents. Prime Intellect has also been running large-scale deployments for clients since January this year. Prime Inference focuses on optimizing long-context workloads for agents. It splits prompt processing and response generation across separate GPUs, cutting p90 inter-token latency by nearly 40% in tests. Prime Intellect also compressed KV cache, boosting the number of tokens each decoder can cache from 1.09 million to 1.63 million under the same GPU memory – an improvement of roughly 50%. Prime Intellect previously offered training infrastructure such as reinforcement learning, evaluation, and sandboxes. With the addition of the inference service, it can integrate model training and actual deployment into a single platform, while data generated from real-world operations can also be used for subsequent training.
Trader Loracle shorted SanDisk with 10x leverage, incurring an unrealized loss of approximately $3.7 million.
1 hours ago
European open-source model Kolibri launches: 3.46B active parameters, supports 1M context window.
1 hours ago
CZ: Binance’s SAFU Fund’s $270 million unrealized profit may be purely a matter of luck.
1 hours ago
Ansem: Strong altcoins will keep emerging during a bull market, so investors should continuously seek excess return opportunities.
1 hours ago
HyperLink completes $2.5 million in funding round, aims to become Hyperliquid's prime broker
1 hours ago
Michael Saylor has once again released Bitcoin Tracker information, potentially signaling additional BTC purchases.
1 hours ago
Hot feeds
A trader profits $448K by monitoring #Binance's new listings!
2024.12.13 17:37:29
Last week, funds have flowed into #Bitcoin, #Ethereum, and #Hyperliquid.
2024.12.16 14:48:36
A $PEPE whale that had been dormant for 600 days transferred all 2.1T $PEPE($52M) to a new address.
2024.12.14 10:35:27
When Elon Musk tweeted about Moltbook, the meme coin MOLT experienced a short-term 30% price surge, hitting a new all-time high of $114 million.
2026.01.31 18:37:29
A smart #AI coin trader made $17.6M on $GOAT, $ai16z, $Fartcoin,$arc.
2025.01.05 16:05:18
A sniper earned 2,277 $ETH ($8.3M) trading $SHIRO within 18 hours!
2024.12.03 23:09:08
MoreHot Articles

How did I turn $1,000 into $30,000 with smart money?
2024.12.09

10 promising AI Agent cryptos
2024.12.05

The 30-Year-Old Entrepreneur Behind Virtual, a Multi-Million Dollar AI Agent Society
2025.01.22

10 smart traders specializing in MEMEcoin trading on Solana
2024.12.09

A trader lost $73.9K trading memecoins in just 3 minutes — a lesson for us all!
2024.12.13

What is $SPORE? Let us take you through the on-chain records to show you how it works.
2024.12.25

