User-agent: * Disallow: /temp/ Disallow: /cgi-bin/ Disallow: /export/ Disallow: /media/ Disallow: /in/ Disallow: /log Disallow: /html/log