Managed to fix the rattle. Just wedge a piece of paper like in the image below. The paper will restrict the movement of the bar moving downwards, and will keep the bar held in its resting position.
Do not put too thick of a paper (approx 5mm is good enough) or the seat will not latch properly - you can tell this is happening if the seat wiggles even when the latch happens.