AterstodBot

User agent: AterstodBot/2.0 (+https://aterstod.com/bot)

Obeys robots.txt (user-agent AterstodBot or *), including Crawl-delay, and <meta name="robots"> noindex/nofollow.
One request at a time per host, with a pause between requests. Backs off on 429/503.
Only fetches HTML. Images, video, audio and documents are recorded as links but never downloaded.
To opt out: User-agent: AterstodBot / Disallow: /.
This page: https://aterstod.com/bot · search engine: https://aterstod.com/

Suggest a site

Know a site we should crawl? Add it to the queue. It is fetched like any link we find: robots.txt, our safety checks and disk limits still apply, so it isn't guaranteed to appear.

We keep the address and the day, nothing about you. Up to 5 a day from one connection.