I am using my propane gas furnace for the first time. It is blowing hot inside no problem. The exhaust on the outside is blowing very hot too. Is it normal for a gas furnace to blow hot air out the exterior exhaust?

Yes -It is the exhaust from the burning chamber. The inside is blowing air that is circulated around it. That way there is no chance of asphixiation.