Robin nest on floor?

We've had Robins nesting in a hole in the side of our house, about room ceiling height. Just come outside to find the nest and loads of nesting material on floor  We know the baby fled the nest about three weeks ago and we see the family out in the garden. Should we leave them to it, or put the stuff back in the nest? Thanks