Autonomous AI agents are rapidly becoming a dominant force on the internet, fundamentally shifting its operational dynamics. Recent data indicates these bots already represent a substantial fraction of overall web traffic, according to a new analysis of bot activity. This trend is accelerating an intense security competition as bots develop increasingly sophisticated methods to evade protective measures implemented by websites.
“The majority of the Internet is going to be bot traffic in the future,” states Toshit Pangrahi, cofounder and CEO of TollBit, a firm specializing in monitoring web-scraping operations that released the report. “It’s not just a copyright problem, there is a new visitor emerging on the Internet.” The viral virtual assistant OpenClaw—previously known as Moltbot and earlier as Clawdbot—exemplifies this broader transformation underway. Rather than remaining a human-centric space, the web is poised for domination by these automated systems.
Information shared by the internet infrastructure provider Akamai corroborates these findings, showing a steady rise in bot traffic related to AI training since July of last year. Concurrently, global activity from bots that fetch web content for AI agents is also increasing. “AI is changing the web as we know it,” explains Robert Blumofe, Akamai’s chief technology officer. “The ensuing arms race will determine the future look, feel, and functionality of the web, as well as the basics of doing business.”
Major websites typically impose restrictions on content scraping by bots to prevent unauthorized use for AI training purposes. Legal actions, such as those involving Condé Nast and other publishers against several AI companies over alleged copyright infringement, highlight these concerns. However, a different category of AI-driven web scraping is gaining momentum. Many chatbots and similar AI tools now retrieve real-time information from the internet to enhance their outputs, including current product prices, movie schedules, or news summaries.
This dual surge in bot activity—for both training and real-time data retrieval—underscores the escalating arms race. Bots are deploying clever tactics to bypass website defenses designed to block them, leading to a continuous cycle of adaptation between security measures and evasion techniques. The implications extend beyond copyright issues, affecting web infrastructure, business models, and user experience as AI bots reshape online interactions.
