Adding my own tsconfig in the base directory with the "paths" configured the exact same as in my deno.json has fixed the issue.
Will this cause other issues I'm not aware of?
I don't know what magic Deno does behind the scenes, but whatever the case it seems like the import mapping from deno.json doesn't make it to the ts server