Logging "Bot Challenges" In Analytics
So I'm wondering - if the request was "bot challenged" by Cloudflare or (something similar) but not responded to by a user (as its sent in the background) would this show up in the logs as blocked? How could we detect or observe this?
There is an unnecessarily complicated setup involving CF <-> Netlify <-> CF -> Azure. A certain type of request from Next.js never resolves (502 on a prefetching page data). However, we cannot see these requests failing anywhere.
The requests are unique in format:
`hostname/_next/data/lp607pQyqmzra7yGICa9H/path/to/page.json?path=path&path=to&path=page
Calls associated with the hostname do not show up as blocked in Cloudflare. They do not show up as "blocked" anywhere.
7 Replies
Should show up I believe
Not 100% positive tho
If you think your ip is blocked you might Need to contact cloudflare
It's only requests with that URL format that are 502ing
Maybe it's too long
Try shorter
It's quite a confusing infrastructure setup. I don't have complete access to it.
Might be bc path us being reused
Maybe
The setup right now.
CF -> Azure WAF -> Next.js Server (App Service) -> Content Delivery Server (Sends the data)
That works no problem. This new setup however
CF -> Netlify (Next.js) -> CF -> Azure WAF -> Content Delivery Server
That fails somewhere along the journey, but only on that specific request type. 🙂
It doesn't show up as "blocked" in the Azure WAF and all of the servers work just find for normal website requests 🙃
Oh