Navigation
Recherche
|
Not ready for prime time: Agentic IDEs need maturity before enterprise rollout
vendredi 25 juillet 2025, 09:27 , par InfoWorld
Despite the buzz surrounding next-generation agentic integrated development environments (IDEs) that aim to revolutionize software development with autonomous coding agents, enterprises should remain cautious about immediate adoption, analysts say.
They cite concerns about unpredictable changes in usage and pricing models, reliability, and security as key barriers, indicating that the agentic technology in IDEs, as well as some newer autonomous coding agents, are not yet mature enough for mission-critical environments. “For large enterprises, predictable costs are paramount. Sudden shifts to token-based or highly variable pricing can be challenging for budgeting and return of investment (ROI) calculations,” said Steven Dickens, CEO and principal analyst at HyperFRAME Research. Unpredictable pricing is a major challenge In the last few weeks, Cursor and Claude Code, an agentic IDE and an autonomous coding agent, changed their pricing policies, creating a furor among developers who were users of these offerings. Some users of Claude Code took to the offering’s GitHub page to report that they were facing restrictive limits not in tune with their subscription plan, specifically $200-priced Max subscribers. Claude Code’s GitHub page showed 2,351 open issues around bugs at the time of writing the story, and despite mounting complaints, Anthropic has only acknowledged slower response times without offering further details. On the other hand, Cursor introduced significant changes to its pricing, shifting from a request-based model to a usage-based one in June. The rollout of the new plan was not communicated to developers, leading them to be confused. Several of them took to social media platforms, such as Reddit, to express their dissatisfaction and state that they were looking at alternatives as their cost of usage on the same plan had increased dramatically. Although Cursor has attempted to clarify its Pro plan and has offered full refunds for surprise charges incurred between June 16 and July 4, many developers are still not clear on the changes in the plan. Some have sought clarity on the company’s official forum page, which also houses several posts showing dissatisfaction among its users. Others, who were looking at alternatives, seemed to be eager to try out Kiro, another agentic IDE offering from the stables of AWS, which also saw the imposition of a temporary daily usage limit and a waitlist for new users. AWS has even deleted the pricing tiers it planned for the service, saying, “We’re reviewing our approach to better align with how developers are using and want to use Kiro.” Reliability and security concerns add to jitters Concerns over latency are undermining the reliability of agentic IDEs and coding agents, which, according to Dickens, is discouraging enterprise adoption. These offerings rely on real-time interactions with large language models (LLMs) and external APIs, delays in execution — whether from model inference, tool invocation, or network bottlenecks — can significantly disrupt developer workflows, Dickens said. This latency also undermines the promise of seamless automation and instant feedback, which are central to the appeal of agentic coding environments, Dickens added. The latency issues are more profound with Anthropic’s Claude models, which are used across most coding agents and agentic IDEs, including Cursor and Kiro.Anthropic’s status page showed at least 21 incidents around model issues in July. In June, there were at least 23 incidents, and in May, the model provider faced over 35 incidents. Latency in response times, outages, and surprise pricing changes in these products is eroding goodwill and trust, said Dion Hinchcliffe, lead of the CIO practice at The Futurum Group. “Due to these incidents, these new agentic IDEs don’t seem to be ready for enterprise adoption, at least not at the scale most CIOs are now planning for,” Hinchcliffe added. Security, too, is an area of concern, specifically for highly sensitive codebases or codebases whose usage is relatively high, according to Dickens. “For highly sensitive codebases or very high usage, enterprises might explore fine-tuning and deploying open-source LLMs on their own infrastructure. While this requires significant upfront investment in hardware and expertise, it offers greater control and predictable long-term costs,” Dickens said. In contrast, Spencer Kimball, CEO of database providing firm Cockroach Labs, said that the pricing changes, outages are not signs of non-readiness but strains related to quick traction. The infrastructure has to play catch-up and not the agentic IDEs themselves, Kimball explained, adding that he sees agents being more sustainable as they are cheaper than their human counterparts for many rote or labour-intensive tasks. What factors are driving pricing changes and reliability issues? The sudden pricing changes and reliability issues are being mainly driven by a combination of three factors — infrastructure and usage, packaging of subscription plans, and investor sentiment, analysts say. To begin with, usage patterns of these products have evolved, creating pressure on infrastructure: early use cases like debugging or summarizing code were light on compute, but present-day workloads involve autonomous agents and research tasks, which are heavy on compute infrastructure, said Jason Andersen, principal analyst at Moor Strategy and Insights. This pressure on infrastructure is forcing vendors of these products to adjust pricing to keep up with rising operational costs, driven by scaling of cloud clusters and surging token usage, according to Wei Zhou, head of AI utility research at SemiAnalysis. “The basic business model of these companies is to arbitrage a fixed payment from consumers ($x/mo) with a variable cost per consumer ($ per million tokens input/output),” Zhou said. “At the current rate, they’re finding that the usage is growing far faster than their ability to raise prices or reduce the number of tokens per request and hence they’re running into margin pressures, sometimes going negative unit margin on power users,” Zhou added. Additionally, Andersen also pointed out that because these pricing plans are based on how much it costs to run them, the prices can vary a lot. For example, one Claude Code plan costs $20, while the next tier jumps to $200. The vendors of these offerings are also under pressure from their investors to cut costs and boost revenue, as ongoing losses are not sustainable in the long run. “Investors aren’t seeing a clear exit yet, and now that they have some money coming in from subscription plans, they will want to keep their capital safe until a clearer exit strategy comes to light where they may need to use that capital,” Andersen said. Investors are also worried about these vendors’ continuous need to come up with new additional features in order to compete with rivals, which in turn has an effect on their operational expenditure, specifically research and development, Andersen added. If not now, when? For now, IT leaders should focus on building internal readiness — experimenting with agentic IDEs in sandboxed environments, upskilling teams on prompt engineering and AI oversight, so that when the technology matures, their organizations are well-positioned to adopt it swiftly and securely, analysts said. However, Cockroach Labs’ Kimball pointed out that some users and enterprises will look for alternatives to bypass challenges around these IDEs, such as open-source models, local inference, or hyperscale platforms with more resilient infrastructure. “Enterprises are already exploring hybrid stacks: local LLMs (e.g., LLaMA 3), verticalized AI agents, and GPU co-ops. The smartest are hedging their bets by investing in their own compute (H100 clusters, or alt AI chips) to avoid being hostages to cloud GPU scarcity,” Hinchcliffe said.
https://www.infoworld.com/article/4028745/not-ready-for-prime-time-agentic-ides-need-maturity-before...
Voir aussi |
56 sources (32 en français)
Date Actuelle
sam. 26 juil. - 09:00 CEST
|