I use the B.O.D. method, or BUCKET O' DEATH.
I take a homer bucket, and fill it up with water to about 4 inches from the top. Then sprinkle a cup or two of sunflower seeds on the surface of the water. I'll use a narrow piece of wooden trim board or make some 2" strips of wood on my tablesaw - about 36" long, and lean that up on the side of the bucket. Sometimes I'll run a small screw into one end of the "plank" to keep it on the rim of the bucket. I then place a few seeds at the base of the board and a few along the board up to the top. Theory is that the mouse will run up the board, see the seeds floating atop the water, think its a solid surface, and jump down to get some more. He'll swim around until he drowns.
Its not the most humane way of eradication, but it works very well. I have problems with not only mice, but loads of chipmunks that burrow under my walks and cause them to sink. I'll put out the buckets once or twice a year, and it will kill whole families of these wee buggers. Sometimes I'll check a bucket and it'll have 6-8 chippies and a few mice in there as well. Many times there will be pregnant ones in there too, so I know I'm getting a lot of them.
I usually pluck them out with a pair of tongs, placing into a gallon ziplock baggie, then trash. I pour the scummy water/seed mixture into the compost pile and start over.