I'm 6'6" and about 300lbs. I have little drama, though I am right at the comfortable limit. I too have broad shoulders and do notice it hugging but don't find it gets too unbearable.
Besides, if you are getting uncomfortable after being in the seat for long periods of time, it is usually a good time to get out and stretch your legs. Allows you to admire your car whilst you do so!
EDIT: Yet to try sitting in it with a helmet on. It might be a very close call!