Just_Micah
CDCloudflare Developers
•Created by Just_Micah on 2/18/2025 in #general-help
Problems with crawlbots
Hi Guys,
We have a problem with a website of ours. The website is super big 25,000 pages approximately but because of this we get super many crawl requests. Is there any way to mitigate this via cloudflare. We don't want to turn them off completely.
2 replies
CDCloudflare Developers
•Created by Just_Micah on 1/24/2025 in #general-help
Skip google from waf rule
Hi,
We are dealing with a lot of requests from america on our website. Because of this we were forced to exclude america from our website with a waf rule. Now the problem is that Google does not go well on this, analytics doesn't work anymore and we can't measure page speed either. Is there any way to skip google?
2 replies