# https://www.robotstxt.org/robotstxt.html User-agent: * #Disallow: / Disallow: /dev/ Disallow: /stg/