Seed or No Seed After Spring?

I have seen a decline in visitors to the feeders over the past month or so. I am thinking most adult birds are looking for grubs and caterpillars to feed their young.

My neighbour said not to put seed out after spring.

Should we still put seed out all year round? What do birds need at the end of spring through summer?