Skip to main content

How can I stop cookiebot crawling my sites

Comments

4 comments

  • Elina - vConnect - Community Supporter

    Hi Sgarcia Nau,

    The scanner simulates a number of regular website users (you can think of it as a simulation of say e.g. 7-8 users) visiting your website and going through all the subpages. The scans are done that way to ensure that all cookies and trackers that a regular user could possibly encounter on your website are found.

    In order to have the least possible impact on your website's performance, the scanner only sends one request every 2 seconds.

    There is no other way to do the scans, so you cannot prevent the traffic from happening. You can, however, exclude the traffic from your regular website statistics by either excluding the provider 'microsoft corporation' or by excluding the IP addresses we scan from.

    For the website scans that are part of the Cookiebot subscription, we scan from the following IPs:

    13.74.44.241

    40.91.211.73

    52.232.29.198

    23.100.63.22

    Regards,
    Elina

    0
  • Sgarcia Nau

    Hi,

    Thank you for your response.

    Hosting techs said that the sites is going down because of bots.

    So If I cancel subscription your bot will not scan my sites?

    Regards.

    Sergio García

    0
  • Hi Sgarcia,

    If you cancel your Cookiebot account and subscription entirely, all your data will be permanently deleted and any Cookiebot scripts will not work from the time you cancel your account. Your website won`t be a part of of the Cookiebot subscription and no scan will be provided.

    Regards,
    Elina

    0
  • Adil Balti

    If you want to stop Cookiebot from crawling your sites, you can follow these steps:

    1. Access your Cookiebot account: Log in to your Cookiebot account using your credentials.

    2. Manage your domains: Once you are logged in, navigate to the "Manage Domains" section. Here you will see a list of all the domains that Cookiebot is currently crawling.

    3. Remove the domain: Locate the domain that you want to stop Cookiebot from crawling and click on the "Delete" or "Remove" button next to it. This action will remove the domain from Cookiebot's crawling list.

    4. Adjust your website configuration: In addition to removing the domain from Cookiebot's crawling list, you may need to adjust your website configuration to prevent Cookiebot from initiating the crawl again in the future. This can vary depending on the platform or content management system (CMS) you are using. Some common methods include:

      • Disabling or removing the Cookiebot script from your website's HTML code.
      • Adjusting the settings or configuration of your CMS or website platform to exclude Cookiebot or its tracking functionalities.
      • Modifying the robots.txt file on your website to disallow crawling by specific user agents or bots, including Cookiebot.
    5. Test and monitor: After making the necessary changes, it's important to test and monitor your website to ensure that Cookiebot is no longer crawling it. Check if the Cookiebot script is no longer present in your website's HTML code and verify that Cookiebot's crawler is not accessing your site's pages.

    Remember that Cookiebot is a tool designed to help website owners comply with data privacy regulations, such as the General Data Protection Regulation (GDPR). If you have concerns about the impact of disabling Cookiebot on your website's compliance, you should consult with legal or privacy experts to ensure that you are still meeting the necessary requirements.

    0

Please sign in to leave a comment.