Bird box cleaning?

Great tits quickly moved in to a next box we put up last spring & successfully fledged.

Should we have cleaned it out after they left & if so, would doing it now (january) be too late?

Asking as they've started nipping in & out lately (cold weather related?) & wouldn't want to do anything to put them off using it again.