User-agent:* Disallow: / Disallow: /cgi-* Disallow: /temp/ Disallow: /xfer/ Disallow: /etc/ Disallow: /mpc/ Disallow: /stats/ User-agent: ia_archiver Disallow: /