analiza aiqbench
Multiverse Computing has demonstrated that its CompactifAI compression technology significantly accelerates inference for large Llama models on Intel Xeon 6 CPUs, achieving nearly double the token throughput and reducing latency by roughly half. This advancement highlights a critical path toward making high-capacity open-source AI viable in energy-constrained environments without relying solely on expensive GPUs or specialized hardware like NPUs.
Multiverse Computing Unveils Breakthrough : All CompactifAI Models Now Run on Intel Xeon 6 Processors

SAN SEBASTIÁN, Spain, July 23, 2026 (GLOBE NEWSWIRE) -- Multiverse Computing, a leader in AI model compression, today announced that its CompactifAI-compressed version of the Llama* 3.3 70B model now runs seamlessly on Intel Xeon 6 processors with Performance-cores, utilizing vLLM* CPU and Intel Advanced Matrix Extensions (AMX), marking a major advancement in more energy-efficient and scalable AI . With CompactifAI, Multiverse Computing's proprietary AI model compression technology, the company compresses and offers optimized versions of leading open-source AI models. This breakthrough delivers improved throughput and latency while maintaining compatibility with mainstream open-source tooling. Performance and efficiency. In controlled benchmarks using an Intel Xeon 6737P processor, the CompactifAI-compressed Llama* 3.3 70B model demonstrated significant improvements over the uncompressed baseline. For a request comprising 1,024 input and 1,024 output…
Extras afișat conform termenilor RSS ai publicației · 128 cuvinte · textul integral și figurile sunt pe site-ul publicației
Subiecte conexe

Intel says Multiverse Computing’s AI Compression boosts token throughput 94.1%
Quantum Zeitgeist · 23 iul. 2026
Multiverse Computing Unveils Breakthrough: All CompactifAI Models Now Run on Intel Xeon 6 Processors
Multiverse Computing · 23 iul. 2026

AI model compression startup Multiverse raises $570M at $1 . 7B valuation
siliconangle.com · 28 iul. 2026

Intel, HPE and Multiverse Computing double speech-to-text speed
Quantum Zeitgeist · 24 sept. 2026