Amazon will replace it free of charge for the first year. After that, the Amazon factory needs to replace it for a cost of $59.
It looks like they changed to the non-replaceable battery (and no SD card) in an effort to make the Kindle 2 thinner than the Kindle 1.
Some articles say the original battery should last for 2+ years.