#all robot agents User-agent: * #no access to named folder Disallow: /cgi-bin/ Disallow: /images/ Disallow: /pics/ Disallow: /pictures/ Disallow: /_private/ Disallow: /Java/ Disallow: /log/ Disallow: /logs/