User-agent: * Disallow: /molnar/ Disallow: /mt/ Disallow: /xx/ Disallow: /abuse/usenet/2006- Disallow: /abuse/usenet/2006- Disallow: /abuse/usenet/2005- Disallow: /abuse/usenet/2004- Disallow: /abuse/usenet/2003- Disallow: /abuse/usenet/2002- Disallow: /abuse/usenet/2001- Disallow: /abuse/usenet/2000- Disallow: /abuse/usenet/1999- Disallow: /abuse/usenet/1998- Disallow: /abuse/antispam-stuff/narf/filter_innd.pl Disallow: /~cks/space/drafts/ User-agent: X-20060222-mXsXnbXot-reenabled-2006-02-14 Disallow: / User-agent: sbider Disallow: / User-agent: SBIder Disallow: / User-agent: Missigua Locator Disallow: / User-agent: Onkosh Disallow: /~cks/ User-agent: www.onkosh.com Disallow: /~cks/ User-Agent: FAST Crawler Disallow: /~cks/ User-agent: uoft-gsa-crawler Crawl-delay: 1