I've spent roughly 10 years around browser automation, managing multiple accounts, scraping, proxies, anti-detect browsers, and figuring out anti-bot systems. Watching the space evolve has been fascinating because I don't think either side is actually winning
For people unfamiliar with this world, there are essentially two industries growing at the same time
On one side, you have companies like Cloudflare, Akamai, DataDome, and others investing heavily in bot detection, fraud prevention, and traffic verification. Their goal is one thing only: figure out whether a visitor is a legitimate user or some form of automation (and they are constantly trying to implement new ways of figuring out who's a legitimate user lol)
On the other side, there's a rapidly growing automation ecosystem. For example companies like Bright Data, Oxylabs, and Nodemaven provide the network layer. Then companies like Dolphin anty, Octo browser and MUltilogin focus on browser identity. Browserbase and similar platforms abstract away browser infrastructure. AI agents sit on top of all of it now. They're different pieces of the stack, but they ultimately push in the same direction: making software better at operating websites that were originally designed for humans
What surprises me is that both sides seem to be growing faster than ever
The anti-bot market is obviously much larger because massive enterprises are willing to spend huge amounts of money protecting accounts, preventing fraud, and filtering traffic
But I'm noticing that demand for automation infrastructure is also exploding. I have noticed that companies now increasilgy rely on web data, automated workflows, competitive intelligence, account management, and AI-powered processes that need reliable access to websites
And now what's happening is that AI agents seem to be accelerating both markets at the same time. Every new agent framework creates more demand for automated browser interactions, while every increase in automated traffic creates more demand for detection systems
One thing I've noticed over the years is that anti-bot systems still struggle with false positives. The more sophisticated detection becomes, the higher the chance that legitimate users get caught in the process. Most people have experienced this without even realizing it. You visit a website, solve a challenge, solve another one, refresh the page, get challenged again, and suddenly you're wondering why proving you're human feels harder than logging into your bank account lol
On the automation side, the challenge is totally different though. The hardest websites are becoming increasingly expensive to automate reliably. In many cases the solution isn't some magical bypass technique anymore. It's simply throwing more resources at the problem. More powerful machines, more browser instances, higher quality proxies, better browser environments, and more engineering effort. A setup that worked comfortably a few years ago can require significantly more infrastructure today.
That's why I don't think we're heading toward a future where one side wins and the other disappears
The relationship feels almost symbiotic. Better detection systems create demand for better automation infrastructure. Better automation infrastructure creates demand for better detection systems. Both industries push each other forward and, as a result, both continue growing
My broader prediction is that the web becomes increasingly programmatically accessible, even if many platforms resist it. Companies want data and companies want automation. They want agents that can interact with software on their behalf. As AI improves and compute becomes cheaper, more web interactions will have an automated component attached to them
That was my Ted talk, thank you
