Why is apple bot crawling my sites?

Hi,


I want to confirm is there any specific reason that apple bots are crawling my site,

I am really confused by the frequency of the crawl as well, its like 10 per second or so. I understand the site is huge but crawl rate is increasing my Cloudflare bill. Please stop.

.

Thanks


[Edited by Moderator]

Posted on Jan 31, 2024 3:54 AM

Reply
Question marked as Top-ranking reply

Posted on Jan 31, 2024 8:52 AM

Here is a description of Applebot, why it exists, and the rules that it follows: About Applebot - Apple Support


If what you are being crawled by is Applebot, you can use the provided rules to modify or block.


If what you are being crawled by is something else claiming to be Applebot, you'll need to manage that separately.

3 replies
Question marked as Top-ranking reply

Jan 31, 2024 8:52 AM in response to kaushik284

Here is a description of Applebot, why it exists, and the rules that it follows: About Applebot - Apple Support


If what you are being crawled by is Applebot, you can use the provided rules to modify or block.


If what you are being crawled by is something else claiming to be Applebot, you'll need to manage that separately.

This thread has been closed by the system or the community team. You may vote for any posts you find helpful, or search the Community for additional answers.

Why is apple bot crawling my sites?

Welcome to Apple Support Community
A forum where Apple customers help each other with their products. Get started with your Apple Account.