User-agent: Mediapartners-Google crawl-delay: 5 Disallow: User-agent: Googlebot-Image crawl-delay: 5 Disallow: User-agent: Adsbot-Google crawl-delay: 5 Disallow: User-agent: Googlebot-Mobile crawl-delay: 5 Disallow: User-agent: SemrushBot crawl-delay: 5 Disallow: User-agent: SemrushBot-SA crawl-delay: 5 Disallow: User-agent: ^Java Disallow: / User-agent: ^Jakarta Disallow: / User-agent: libwww Disallow: / User-agent: Snoopy Disallow: / User-agent: YandexSomething/1.0 Disallow: / User-agent: Mozilla/5.0 (compatible; discobot/1.1; +http://discoveryengine.com/discobot.html) Disallow: / User-agent: * Crawl-delay: 12 Disallow: /?s= Disallow: /ads/ Disallow: /scripts/ Disallow: /lp/ Disallow: /lp-fr/ Disallow: /lp-es/ Disallow: /lp-en/ Disallow: /lp-de/ Disallow: /root/ Disallow: /root-es/ Disallow: /root-en/ Disallow: /root-de/ Disallow: /root-fr/ Disallow: /cgi-bin/ Disallow: /tmp/ Disallow: /silverstripe-cache/ Disallow: /adm/ Disallow: /logs/ Disallow: /res/ Disallow: /framework/ Disallow: /themes/ Disallow: /Opie_Process/ Disallow: /hybridauth/ Disallow: /__BACKUP/ Disallow: /SortableGridField/ Disallow: /Opie_Framework/ Disallow: /widgets/ Disallow: /vendor/ Disallow: /translatable/ Disallow: /restfulserver/ Disallow: /queuedjobs/ Disallow: /Opie_Orders/ Disallow: /Opie_Intranet/ Disallow: /Opie_Dashboard/ Disallow: /Opie_Commons/ Disallow: /Opie_ClientSection/ Disallow: /hostpapa/ Disallow: /GridFieldRelationHandler/ Disallow: /googlesitemaps/ Disallow: /comments/ Disallow: /cms/ Disallow: /auth_external/ Disallow: /__UPGRADE/ Disallow: /newclient/ Disallow: /nouveauxclients/ Disallow: /nuevo-cliente/ Disallow: /neue-kunden/ Disallow: /basic-training/ Disallow: /popup/ Disallow: /popup-en/ Disallow: /popup-es/ Disallow: /popup-fr/ Disallow: /popup-de/ Disallow: /orders/ Disallow: /bestellungen/ Disallow: /commandes/ Disallow: /formulario/ Disallow: /dashboard/ Disallow: /tableau-de-bord/ Disallow: /tablero-de-control/ Disallow: /dashboard-de/ Disallow: /hostpapa-app/ Disallow: /admin/ Disallow: /intranet/ Disallow: /static/ Disallow: /form_res/ Disallow: /Landers/ Disallow: /cdn-cgi/ Disallow: /letpapain Disallow: /blog/letpapain Disallow: /knowledgebase/letpapain