Does only making interest payments on a mortgage make sense?

I'm doing zero-down because a) I have to furnish the house and b) putting 15-20% down on the house doesn't significantly lower the interest rate and I'd rather have my extra cash sitting in a 5% savings account. Also, I plan on staying in the house for less than 10 years.