So the dealer replaced my pump. They noticed the noise during an inspection and said they would replace it. I didn't think it would do anything, but had them do it anyway so any future issue couldn't be attributed to me not getting the fuel pump replaced.
One tank of gas later, the chirps are back
. Not as loud as the old pump (yet) but I'm sure it will be.