Don't be reductionist. Most arguments have grounding in nature and the real world, believe it or not.

Having grounding in nature doesn't mean that it ought to be kept around though. Lots of harmful stuff is grounded in nature, and lots of amazing and good things have no grounding in nature. We have to examine everything and decide if it's worth keeping around regardless of the source.

And that's a fine opinion to have, but I doubt you'll find many people that think gender is harmful enough to be not "worth keeping around".

Sure, but I think you'll find a lot of people are more than happy to drop the idea that only boys can play with toycars and only girls can play with dolls, and that if a girl like toycars she isn't "behaving like she should".

It's not a matter of the number of people who think (after all, there are a great number of people believing climate change isn't real and that the earth is flat) but the arguments which are presented. If someone has made an argument to the effect that gender is harmful enough to not be worth keeping around, then you can respond to that argument. However, not all opponents of the patriarchy argue that gender itself shouldn't be kept around. In fact, that's quite a niche position.