Obituary: Farewell to robots.txt (1994-2025)heise.de
14 points by donohoe 1 days ago | 1 comment