I'm pretty much always wearing flip flops or bike shoes, neither of which are great for driving. I keep a pair of these Amazon driving loafers in the flat tire repair compartments under the trunk. Cheap, work great, and quick to change into.
https://www.amazon.com/gp/aw/d/B01FY...b_b_asin_title