I have a lone rook which hangs around my garden. Yet, there is a huge rook colony nearby. Why does this bird not mix?

The lone rook is in good condition, but seems to make itself scarce if members of the rookery turn up.  I have heard that birds can be driven out if they have not complied with the rules of the rookery.  Is that what has happened here?