Do you have a second fob?
Something is way off though since the alarm should not arm if the car isn’t locked.
You can try disarming the alarm completely. Instructions should be in your manual.
If not they are in post 10 here
https://www.ft86club.com/forums/showthread.php?t=115733