Is Europe water OK to drink?

I'm traveling in Ireland, UK, France, Spain, Italy, Switzerland, germany, and czech republic. It says bring a canteen to save money on water. Is the water OK to drink or will I get sick like mexico?