# See http://www.robotstxt.org/wc/norobots.html for documentation on how to use the robots.txt file User-agent: * Disallow: /tv_programs/2009 Disallow: /tv_programs/2008 Disallow: /tv_programs/2007 Disallow: /articles/search Disallow: /admin_sessions Disallow: /admin_articles Disallow: /admin_rubriques Disallow: /admin_tv_program_kinds Disallow: /admin_users Disallow: /admin_polls Disallow: /comments Crawl-delay: 3