User-agent: * Disallow: /cgi-bin/ Disallow: /web-images/ Disallow: /downloads/ Disallow: /glimpse_index/ Disallow: /pages/internal/