The complaint is that the people don't live there, and therefore don't contribute to the neighborhood. See the recent article about how Vancouver is dying for more info.