In a crowded federal courtroom in San Francisco on September 14, 2026, a three-judge panel of the U.S. Court of Appeals for the Ninth Circuit heard oral arguments in Amazon.com, Inc. v. Perplexity AI, Inc.—a case that legal scholars anticipate will define the constitutional and statutory boundaries of the autonomous web.

The legal battle began when Amazon forensic telemetry revealed that Perplexity's search-indexer bots were actively bypassing Amazon's robots.txt directives. According to court filings, Amazon had implemented strict Disallow directives aimed at AI crawlers, backed by Cloudflare automated challenge barriers. To maintain real-time product indexing and price comparison synthesis, Perplexity allegedly routed requests through distributed residential proxy networks, altering User-Agent strings to mimic legitimate human shoppers.

Amazon's legal team argued that deliberately evading technological barriers and ignoring explicitly posted access conditions transforms passive web viewing into unauthorized access under the Computer Fraud and Abuse Act (CFAA), as well as state common-law trespass to chattels. Amazon contended that if companies cannot enforce robots.txt, the open web will collapse under the bandwidth burden of billions of competing autonomous AI agents.

Perplexity's counsel mounted an aggressive defense rooted in the Ninth Circuit's own landmark 2022 decision in hiQ Labs v. LinkedIn. In that precedent, the court established that accessing publicly available web data that does not require a user password or authentication barrier does not constitute access without authorization under the CFAA.

Perplexity argued that robots.txt is merely a voluntary, 30-year-old advisory standard, not a binding legal contract or technological access barrier. Extending the CFAA to criminalize header alterations would, Perplexity warned, hand dominant e-commerce monopolies the unilateral power to outlaw rival search engines and consumer comparison tools.

The appellate judges questioned both sides sharply, noting the delicate balance between protecting server infrastructure from aggressive scraper exhaustion and preserving the open, competitive nature of public web indexing.

Regardless of how the Ninth Circuit rules, the case highlights the obsolescence of 1990s-era web protocols. Across the tech ecosystem, engineering teams are already moving to replace robots.txt with cryptographic agent micropayment protocols, such as HTTP 402 payment tokens and cryptographic client attestation.