Formality clash check

I got these Allen Edmonds Randolph verse loafers with crepe soles. They’re super comfortable but I fear that in the most dressed up context (I.e. with dark wool trousers) there’s a bit of a clash with the light colored sole bottoms. Here they’re shown in the most formal context I’d wear them in. Im going for a prep look, would wear them most of the time with chinos or more casual pants. However I’d also like to be able to pair them with wool trousers if needed. The alternative is a version with leather soles that I think would be great but also hurt a lot more to wear and are less comfy for putting mileage on.