# Allow all User-agent: * Disallow: Disallow: /cgi-bin/ User-agent: cugeCrawler 1.2 user-agent: cugeCrawler Disallow: /