Modal pops up for Action button that's not defined as modal, when closing an actual modal.

I have two buttons for downloading pdf templates, one is defined as modal in resource and opens modal for further selection of pdf templates and other button just goes straight to downloading all PDFs. However, there's a weird bug - if I download all PDFs and then click on another button and close it, it will open modal for the button that simply downloads all templates (even though this is not defined as modal). I have no idea why this is triggered or how.