So just an update, I noticed that it would take a little longer for the noise to go away; instead of just the first left turn out of my neighborhood, I noticed it did it for another 5 miles (did a bunch of u-turns to see if it was still making the noise), before it was quiet.
I just changed the diff fluid yesterday (@ 4,000 miles), and the OEM fluid wasn't too dirty, but there was a lot of metallic "gunk" on the magnet. Replaced it with Motul Gear 300, and will post up if I notice any difference in the noise.