2014 BRZ owner here. I haven't found the vehicle overly noisy. But then, I come from a 4x4 background, including having driven a CJ-5 daily, sometimes wearing earplugs due to the noise level on longer trips, lol.
I drove the BRZ from Chicago to the U.P. Michigan last summer. And my son drove it 3000 miles or so, round trip from Chicago all around Colorado and back. None of us had any issues in terms of the BRZ noise. And that's with an aftermarket noisier exhaust.
If our BRZ was too noisy inside, my wife would complain about it, and she hasn't. So it can't be too bad. Other than on initial startup, the exhaust sound shakes the windows.