Skip to content
aiqbench takeAI Products

aiqbench analysis

Composing insight from the full article — this may take a moment.

Source coveringAkka Blog

We Ported 65 OSS Projects With AI

Akka Blog30 min read

<div class="hs-featured-image-wrapper"> <a href="https://akka.io/blog/we-ported-65-oss-projects" title="" class="hs-featured-image-link"> <img src="https://akka.io/hubfs/website/blog/images/ported-65-linkedin.png" alt="We Ported 65 OSS Projects With AI" class="hs-featured-image" style="width:auto !important; max-width:50%; float:left; margin:0 15px 15px 0;"> </a> </div>

Complete, unattended rewrites of existing systems that pass the original's unit and integration tests are possible. Low effort models were more efficient than high effort models. The delivery harness and its structure had a bigger impact on consistency than model capability. We saw a LOC or performance improvement on 57 of 65 ports. We see a potential for AI to write and maintain entire systems without human involvement. In March, we released Akka Specify, a spec-driven delivery toolkit for creating new systems with the Akka SDK. It takes an opinionated approach to defining and implementing an AI system—inclusive of APIs, orchestration, agents, streaming data, and stateful memory. Our solution architects were completing POCs in hours instead of weeks. Our account executives were shrinking delivery times (by many months) in customer proposals. A customer upgraded a codebase written in Kalix to Akka in a few hours. We redesigned a legacy RAG system with 200K lines of code generating 64% eval accuracy reimplementing it in 48 hours shrinking the LOC to 9K while improving eval accuracy to 95%. We attributed these gains to the dramatic improvement in intelligence with frontier models, the improved reasoning structure that comes with AI harnesses, and structural…

Excerpt shown under the publisher's RSS terms · 200 words · full text and figures are on the publisher's site

Related coverage