Don't forget the most important underlying issue: a "free market advocate" should not want to contract with contract breakers (fraud, force) for the most obvious reason. Visible differences have historically been used as a Schelling fence on this issue. "Oh you can do business with me despite the fact that I use force and fraud, I only use it against people with dark skin."