User-agent: * Disallow: /Handlers/ Disallow: /handlers/ Disallow: /User/ Disallow: /user/ Disallow: /Payment/ Disallow: /payment/ Disallow: /click/ Disallow: /redirect/ User-agent: AhrefsBot Disallow: / User-agent: trendkite-akashic-crawler Disallow: / User-agent: BLEXBot Disallow: / User-agent: Yandex Disallow: /directory/ User-agent: PetalBot Disallow: / User-agent: trovitBot Disallow: /