How do we accommodate our mice?

We regularly see mice around our garden - I'm going to assume they are house mice as they seem to like man-made structures.  The thing is, I'd like to be rid of them in our shed and garden storage - but what can we put up to compensate?  I don't begin to know anything about how mice live and what they need.  I only know they smell a bit.