That's the ideal general case. You really don't want hundreds of panicked people trapped in a broken tin can thousands of feet above ground while you're trying to handle the situation.
At least you (as a pilot) are behind a solid locked door in that scenario.
However, that brings up another question I've been wondering about: Could the pax/cabin crew of an airplane collaborate in bringing a jet down, by e.g. all together going to the very front of the plane (near the cockpit door), moving the trim up, then all running to the very end of the plane, bringing it into an uncontrollable stall?
I haven't really seen a satisfactory answer to that question. See Quora and Stackexchange (where I attempted an answer):
That's the ideal general case. You really don't want hundreds of panicked people trapped in a broken tin can thousands of feet above ground while you're trying to handle the situation.