(Don't) Feed the Robots
"My site [with] modest traffic (~1,000 visitors per day) went from serving ~1GB/hr (to tons of AI crawlers!) to ~50MB/hr in traffic" Can you tell what was the point where I 1. Manually blocked a few AI crawlers 2. Moved my nameserver to Cloudflare plus