They do make fire retardant paint. While not great looking, 2" styrofoam, or even cheaper, expanded polystyrene with taped joints would make a huge difference. Finding and stopping drafts goes a very long way towards making an area feel warmer as well