Gigashadow is right, as far as I know all DVD players will play music CD's. Bear in mind, though, that the sound quality will probably not be very good, as it is just hooked up to the television, not to a home theatre set up. So you'll just be listening through the TV.
Enjoy!