Generating Pseudorandom numbers: Middle-Square Approach

I was reading about middle-square method to generate pseudo-random numbers. But one thing that bothered me is that with the same initial seed isn't my pseudo-random number series going to be the same every time. Whereas, it should not be reproducible again no matter what.
For example, if I choose my initial seed to be 1234, my series would be 2343, 4896, 9706, and so on.....
OR
Have I misunderstood the concept in some way? Please clarify this for me.