aiqbench analysis
Multiverse Computing has demonstrated that its CompactifAI compression technology significantly accelerates inference for large Llama models on Intel Xeon 6 CPUs, achieving nearly double the token throughput and reducing latency by roughly half. This advancement highlights a critical path toward making high-capacity open-source AI viable in energy-constrained environments without relying solely on expensive GPUs or specialized hardware like NPUs.
Multiverse Computing Unveils Breakthrough : All CompactifAI Models Now Run on Intel Xeon 6 Processors
SAN SEBASTIÁN, Spain, July 23, 2026 (GLOBE NEWSWIRE) -- Multiverse Computing, a leader in AI model compression, today announced that its CompactifAI-compressed version of the Llama* 3.3 70B model now runs seamlessly on Intel Xeon 6 processors with Performance-cores, utilizing vLLM* CPU and Intel Advanced Matrix Extensions (AMX), marking a major advancement in more energy-efficient and scalable AI . With CompactifAI, Multiverse Computing's proprietary AI model compression technology, the company compresses and offers optimized versions of leading open-source AI models. This breakthrough delivers improved throughput and latency while maintaining compatibility with mainstream open-source tooling. Performance and efficiency. In controlled benchmarks using an Intel Xeon 6737P processor, the CompactifAI-compressed Llama* 3.3 70B model demonstrated significant improvements over the uncompressed baseline. For a request comprising 1,024 input and 1,024 output…
Excerpt shown under the publisher's RSS terms · 128 words · full text and figures are on the publisher's site
Related coverage
Intel says Multiverse Computing’s AI Compression boosts token throughput 94.1%
Quantum Zeitgeist · Jul 23, 2026
Multiverse Computing Unveils Breakthrough: All CompactifAI Models Now Run on Intel Xeon 6 Processors
Multiverse Computing · Jul 23, 2026
AI model compression startup Multiverse raises $570M at $1 . 7B valuation
siliconangle.com · Jul 28, 2026
Intel, HPE and Multiverse Computing double speech-to-text speed
Quantum Zeitgeist · Sep 24, 2026