To the degree that colleges have their curricula setup that you need to have experience programming to enroll in the CS degree, that's on them. It's not true of essentially any other STEM major--or indeed for most degrees. (There are a few exceptions. Lack of fluency+ in English would make it had to make it through many top humanities degrees. And many music, etc. degrees would be tough/impossible without prior exposure.)

However, in general, the idea that you need to already be a programmer per-college to major in CS is somewhere between wrong-headed and toxic.