I trapped them in one of these traps:

http://www.rodentman.com/images/RM-1007%20001.jpg

It worked for the first few, which I let go out in a field, and then, I swear, they figured out not to go in the trap. You have to block up where they are getting into your house. My house was very old and so that was very difficult. Eventually I sold out and got a better house.

After the traps stopped working I used poisoned bait. I had to get them out of my kitchen. I didn't like mice crawling on top of the fan hood and leaving marks in a pan of bacon grease and crapping in the cupboards. Sorry, but at that point it starts to be my survival or theirs.