The other thing I noticed was you had to spend time there during the tax year. Which means that if you bank all your points for that year - intending a big trip next year, you can't deduct interest that year.
(I also think that if the loan is against your primary residence (i.e. a home equity loan) you are in the clear, but I'm not an attorney or an accountant)