Block AI Scrapers and Crawlers Feedback
I apologize ahead of time if this goes in a different area. I have spent the better of 6-8 hours trying to figure out why all of a sudden I could no longer use my openID sign in for Proxmox. I updated proxmox, authelia, rebooted everything, crawled through logs left and right. I finally happened to click on one of the suggestions listed on the Overview page about activating the new Block AI Scrapers and Crawlers option and remembered that I had recently activated that, just about 6-8 hours ago. I turned it off and BAM, now my OpenID sign in is working again.
TL;DR: The new Block AI Scrapers and Crawlers option was giving a 500 error when attempting to use OpenID authentication on Proxmox.
Solution:
Jump to solution
That last sentence I sent gave me an idea. I changed the Allow to skip the remaining rules and moved it to here. Now everything seems to still be working. I can't believe I missed that yesterday.
9 Replies
This error is introduced if the Block option is activated.
check Security > Events, what actually is being blocked?
most likely your identity provider, whatever it is, is calling back to proxmox and thats being misidentified, but hard to tell without knowing the details of the blocked request (which Security > Events will show)
I'll be darned, I somehow missed that.
I have these rules set.
The Geo Block blocks anyone not in my country
The Block bots is only blocking actual bots like Google or Microsoft, unless I have that switch activated, at which then my network monitor and the openID auth pages get blocked.
And the Allow are the 3 commons IP's I access my services from
I have tried a few different things to try to exclude that URI from being blocked with the switch on and I am not having any luck. It would be cool if there was a rule I could create that would allow anything and everything when coming from allowed IPs and going to allowed IPs.
Solution
That last sentence I sent gave me an idea. I changed the Allow to skip the remaining rules and moved it to here. Now everything seems to still be working. I can't believe I missed that yesterday.
What was weird though, it was only on Proxmox that it wasn't working. All of my other openID authentications were working including zero trust.