Sparrow box

Hi we have had a bird box on our wall for over a year now and in the last week a sparrow has started to use it .I was just wondering is there anything we can put in there to make it warmer and without scarring him off when he gets back and sees it .

Many thanks