Creating random matrix without one number

I want to generate a matrix of size n-1 x n such that the i-th column contains all number from 1 to n without containing i, i.e. the first column should contain all numbers from 2 to n, the second should contain 1,3,4,..., the third should contain 1,2,4,... and so on. Any ideas would be most welcomed.