User-agent: * Disallow: /agent_temp_1/ Disallow: /agents/ Disallow: /cgi-bin/ Disallow: /clientsonly/ Disallow: /mystuff/ Disallow: /test/