I don't think .32 amp draw is very much as compared to a 12 volt bulb that can be over 1 amp. If they are running constantly, yes, it will add up. I think you will find that the 65 to 80 degree range will be too low and the fans will run all the time. I think the button thermostats have a 95 to 110 degree range. Hopefully there is a way to adjust the range on the unit you mentioned. It would probably be more accurate than the mechanical type.
Our fridge does a good job without the fan, set at the middle setting it's about 36 degrees in the lower section and down close to 0 in the freezer. The only time I run the fan is when we are doing an initial cool down before a trip, away and the trailer is closed up, and when the sun may be striking the fridge side of the trailer. We boondock mostly in a very shaded area so fan running is rare for us. If we ran the fan very much it would be getting changed out to a quieter type such as you have done.