allow all robots.txt file

Minimal template for a robots.txt file that allows all crawlers to crawl everything. Also include a direct link to the sitemap.xml for better discoverability of the page. 

User-agent: *
Allow: /

Sitemap: https://anonyfox.com/sitemap.xml

Linked Technologies

What it's made of

illustration of HTML
HTML

The backbone of the web. Master it to craft structured, accessible content for any online project, from simple sites to complex applications!

Linked Categories

Where it's useful

illustration of SEO
SEO

Make your digital content discoverable and digestable by web crawlers. Ensure that visitors have a straightforward experience.