No. Column scrambling doesn't affect row ordering and row scrambling doesn't affect column ordering. They are literally orthogonal. You can't tell, from a scrambled matrix, whether the rows or the columns were scrambled first.
Another way to think of it is that permuting rows corresponds to multiplying a matrix on the left by a permutation matrix, and permuting columns, on the right. Since matrix multiplication is associative, they commute!
Yet another way to think of it is that a matrix is an encoding of a linear (or affine) function, matrix multiplication is composition of such functions, and since composition is associative, they commute. :)
Here's a more explicit breakdown:
Column scrambling: swap 1&2: Now row scrambling: swap 0&1: Notice how the x coordinates still all match along the vertical, and y coordinates still all match along the horizontal.Let's try it in the other order, row first:
And columns: It's the same result irrespective of the order.