Is your happiness more important than your family?

I'm a married man who has three young kids. I have always considered myself bi but never explored the male side. As I have gotten older (about to be 33), i feel like I am more male leaning and think that I would like to live my life with another man. It seems like I would have to sacrifice almost everything in my current life for it.I would also have to break up my family to do this. I think I would ultimately be happier that way. My question is, is that selfish to do? Is it wrong to put your happiness above your family? Id appreciate any opinions on this. Thanks.