Robin nest

I had an old nest box which I took down from a tree in the winter as we needed to remove the tree. We left the box on our potting table in the garden with the idea that we would put it back up in the spring. unfortunately robins have nested in the box while it is still on the table. I am worried it’s not safe as cats or squirrels can easily reach the table. Am I able to move the box? Thanks