My wife's Camry made a similar noise. It came from the rubber boot/seal/grommet thing where the shaft went through the firewall. I fixed it by stirring in the excess factory lube with my finger. Maybe it's the same thing.
edit: To clarify, this diagram is for the twin. The camry was an '04.
