User-agent: Googlebot-Image Disallow: / User-agent: psbot Disallow: / User-agent: Slurp Crawl-delay: 20 User-agent: ia_archiver Disallow: / User-agent: * Disallow: /familie/rss Disallow: /familie/impressum Disallow: /familie/k/ Disallow: /geschenke Disallow: /familie/karriere/kontakt Disallow: /familie/karriere/about Disallow: /familie/karriere/impressum Disallow: /familie/karriere/newsletter Disallow: /familie/karriere/sitemap Sitemap: http://mama-im-job.de/familie/sitemap.xml