User-agent: Yandex Disallow: /asin* # blocks access to whole site Disallow: /ASIN* # blocks access to whole site User-agent: * Disallow: /static/bcgen/ Disallow: /static/excel/ Disallow: /static/sscc/ Disallow: /login Disallow: /register Disallow: /go Disallow: /ean_taskstatus Disallow: market-idx/ User-agent: istellabot Disallow: /