Build a valid robots.txt with crawler rules, custom directives, and a sitemap reference.
Watch a short video to unlock 1 free uses of this tool.