What is really wrong with being involved with someone who is a lot younger than you? (Legal age of course)?

I am a 44 year old woman who has been involved with a 24 year old man for 2 years. There has been more love in this relationship that I have ever experienced in my entire life. He is not your typical 24 year old player. It is not all about the and being a "cougar", this relationship is about mutual respect and working as a team. I understand society laughs at this "age gap", but I'm not trying to please society. I have found that in doing that we shortchange ourselves, and can become unhappy people. I guess what I really want to know is why it is judged so harshly... No one knows anyone else's story or life unless they take the time to get to know you. No one wants to be known as a "hater", perhaps that is harsh, but that is sometimes how people who judge make other people feel. Support love, and find your love. Love is all good!