Am I Wrong For Wanting To Be Alone On Valentines Day?

My fiance wants to take me out for Valentines Day, but I know that he cannot afford it. He is trying to get a payday loan to do so, which I think is terrible, and he seems to be offended that I would rather stay home by myself and watch movies that I know he is not going to like but I would quite enjoy. What should I do? It's not that I don't like Valentines Day, I love it, but I feel like he never really prepares for it and that takes the romance out of it. If he had planned everything ahead of time without taking out a payday loan then I would be fine celebrating, but I know how much he is going to be charged on repayment and we are trying to save to get into our own apartment. I am not going to be comfortable celebrating knowing we are doing things that he cannot afford right now. I am confused as to what to do.