User-agent: * Disallow: /newssearch.php/ Disallow: /webalizer/ Disallow: /cgi-bin/