User-agent: * Disallow: /admin/ Disallow: /google*.html Disallow: /registration-step-* Disallow: /login/?* User-agent: MJ12bot Disallow: / User-agent: Yandex Disallow: / User-agent: ClaudeBot Disallow: / User-agent: meta-externalagent Disallow: / User-agent: GPTBot Disallow: / User-agent: SemrushBot Disallow: /