User-agent: * Crawl-delay: 1 Request-rate: 1/1s User-agent: * Disallow: /*/p/mail/recommend/ Disallow: /*/p/q/ Allow: /environment/cache/images/ Disallow: /application/ Disallow: /environment/ Disallow: /libraries/ Disallow: /*/fav/add/ Disallow: /*/p/comment/add/ Disallow: /*/reg/ Disallow: /*/login/ Disallow: /*/basket/ Disallow: /*/searchquery/