Goldfinch Nest

Hello to all, I have joined to speak to anyone who can provide some advice in respect of a goldfinch nest I have very close to my back door which has a goldfinch nest in it. I had brief peer from the outer perimeter of the tree on Tuesday and there was a goldfinch parent on the nest. When the parent saw me it flew onto the fence and my sight followed the parent. I put some extra covering on the side edge of the tree because a mag pie was close by when I was observing from my window previous to this. However since I saw the parent fly I have not seen her return. I know the babies are alive because I could hear there calls last night. I watched continuously for 3 hours yesterday evening from my upstairs window to see if one of the parents would come by but they didn't, each time another bird flew by I heard the calls of the babies. I am absolutely distressed about this as I know I am totally to blame. I haven't been anywhere near the nest since and I am out working full time so I don't get to see whether the parents return in the day or not. Can anyone advise what is best to do? Goldfinch last sighted Tuesday 10/06/14 evening. However I only get home about 6pm from 8am each day. No one else at house to know. Thought I might see a parent coming back to nest for chicks at night but have not spotted - does anyone know what time they usually go to rest at night? Do I know take a chance and try and rescue the chicks or will they be dead already? Thanks Kerry