So for anyone who was stuck like I was: i was using a pry bar to get it out and had no luck. I finally decided to go down to Harbor Freight and buy the correct tool, an axle remover, for $10. Its like a metal fork with two prongs. Two hits with the 5lb hammer and it came out super easy.
DO NOT SPEND THREE HOURS TRYING TO SOLVE THIS LIKE I DID, JUST GO BUY THE TOOL. I will link a listing for a similar tool below but the one I got was just a random $10 one.
https://www.shop.com/STECK+71410+Axl...xoCDq4QAvD_BwE
Hope this helps!