Yes, a wireless router. Not sure what type of computer you have, but with my PC I had a Linksys router. It worked fine and was easy to set up. Now with our Mac we have the Apple Time Capsule, because it has a 500GB hard drive and wirelessly backs up your computer.
PS - It doesn't matter what internet provider you have, your iPod Touch can connect to any open WiFi network.