Mathematics is just a language and likely a human discovery method for rules that encapsulate the universe and cascade down. A method invented to discover discoverable rules.
You can build all sorts of bizarre structures in ZFC that seem to have no relationship with reality at all. You can prove that almost all real numbers can't be computed or even described. There is an entire tower of infinities bigger than the natural numbers that telescope up and up. The axiom of choice gives you all sorts of nonphysical results.
The world of ZFC doesn't feel very constrained by the actual universe, is all.
And if you don't like ZFC, you can pick another set of axioms entirely- there are several alternatives.
Sure, math/ZFC can describe potential and impossible universes including ours. But the motiviation for its invention as a language was very likely to understand relationships in our reality, physics, trade etc.