# Robot search allow/disallow criteria

User-agent: *
Disallow: /cgi-bin
Disallow: /ssl
Disallow: /includes
Disallow: /test
Disallow: /misc
Disallow: /spy
Disallow: /temp