Am I the one being unreasonable?

Hi guys! I need advice. I just had a baby 7 weeks ago and though I can admit I have separation anxiety, I believe this is extremely excessive. My husband wants to send our 7 week old to his mom's each Saturday to stay overnight. Each weekend! He wants her to keep him from about 8 am Saturday morning to 8 am Sunday morning. She lives only about 5 minutes from us. To me, that is ridiculous. He said that we're tired, need a break and to get our lives back. He said we can catch up on household stuff, run errands and do whatever else we want while the baby is gone. I'm fuming writing this and of course, now we're fighting about it. This is not normal to me. I told him I had a baby knowing that I would have to rearrange my life. I get taking a break but each weekend it ridiculous. Please tell me if I'm being unreasonable!