# robots.txt específico walkingto.com User-agent: Googlebot Disallow: User-agent: googlebot-image Disallow: User-agent: googlebot-mobile Disallow: User-agent: MSNBot Disallow: User-agent: Slurp Disallow: User-agent: yahoo-mmcrawler Disallow: User-agent: psbot Disallow: User-Agent: W3C-checklink Disallow: User-agent: * Crawl-delay: 30 Disallow: /caminodesantiago/ Sitemap: http://www.walkingto.com/sitemapindex.xml