Some people buy a vacation home with the idea of turning it into a permanent retirement home down the road, which puts them ahead on their payments. Another benefit is that the interest and property taxes are tax deductible, which helps to offset the cost of paying for a second home. A vacation home also can be depreciated if you live in it less than 14 days a year.