As seller, is it crazy to move out two weeks before closing?

So we’ve had our condo in VA listed for a while now (about 6 months), and finally got an offer last week. It is happening fast, so the closing is on December 14. They accepted our counter offer last Thursday, and have received the condo seller packet last Monday, so everything is in line. We are planning on moving next week, December 2, due to previously scheduled travel the week before closing. Is that too soon? How much protection do we have if they back out before closing with us already moved out? have been picturing the worst case scenario the past few nights, causing some stress. Just wanted a bit more info, it is our first time selling a house.

Edit: in VA