Instantly generate a robots.txt file to guide search engine crawlers.
Separate multiple paths with a comma.
User-agent: *
yoursite.com/robots.txt