As you said - it's not for everyone! My wife and I have had our hardships to have our long-awaited baby in 10 years finally. During our journey, we met many young couples struggling to get pregnant, and it scared us that reproductive health in both men and women has declined in the past years. If a man or a woman makes a choice not to raise a family, that choice has to be conscious and deprived of past emotional scars of failed relationships. My parents have a friend who swore that she'd never want children. But she changed her mind later in age only to find that no doctors or anything could reverse her choice now.
I had a happy bachelorhood in my 20s, even some 30s, and I didn't want to "ruin it with relationships and children" at one point, too. But I feel different now. I don't want to miss my little boy's hugs whenever he sees me. I don't want to miss watching him grow into a decent man. And surely, when I'm old, I don't want to have nothing of this to remember.