AI coding agents can cost 5x more depending on how you use them
Original headline: Your AI coding agent could cost 5x more depending on the harness, benchmark finds — thenewstack.io
More in Programming and developer news
A new benchmark study reveals that the cost of running an AI coding agent can vary dramatically depending on which 'harness' you use to operate it. Researchers tested 22 different harness configurations across five popular open-source AI models, running over 27,000 tasks and analyzing performance and costs. The study found that while the AI model itself accounts for most cost differences, the harness—the tool that actually uses the model to write code—can still make a huge difference.
The same harness can be the cheapest option with one AI model but among the most expensive with another, flipping rankings completely. More shockingly, nearly two-thirds of estimated costs went to runs that either failed outright or timed out, meaning most money spent on these tools is wasted on unsuccessful attempts. For developers trying to control AI coding costs, this shows you need to optimize both your model choice and how you actually use it.
Read the original at thenewstack.io
Satirical commentary on real tech news, summarised with AI. Read the original source for the facts. How ZeroDaily works
