Random number increment

I want to change starting number by +1/-1 value.

Example:

$startNumber = 1;

Echo $startNumber randomly, if number is 1 echo random 0 or 2, if number is 2 echo random 1 or 3.

I hope I explained well, is it possible to do this?