Ultimate Immersion
Explore posts from serversCDCloudflare Developers
•Created by Ultimate Immersion on 3/28/2024 in #general-help
Crawlers returning 404, but pages are working
I figured that a lot of the pages were actually indexed tonight so I surely wasn't blocked and still showing on google. Looking further those are actually pages that don't exist.
I had some errors with robots.txt before and wrong sitemap link within (including www after https) and I believe it took some time before that was recrawled and used.
8 replies
CDCloudflare Developers
•Created by Ultimate Immersion on 3/28/2024 in #general-help
Crawlers returning 404, but pages are working
8 replies
CDCloudflare Developers
•Created by Ultimate Immersion on 3/28/2024 in #general-help
Crawlers returning 404, but pages are working
8 replies