Islands, a great place for a small colony. But you don't know if the virus is there too. You can easily fish, with the right know-how, but there's no telling if the fish are infected from any possible zombies in the water. Water is obviously abundant, as long as you distill it. Make sure the island is close to land, so you can get supplies as needed.

However, if you wipe out any zombies there, you will have almost no threat from the undead horde. A major problem is that you will have to deal with hordes refugees swarming for a safe haven.