Get a paint pen and draw a line fom the edge toward the center, that way you can find out if the outside ring is slipping.
It is possible(but not likely) you have sheared off your your woodruff key or keyway. (or installed it without one?)
Did you match it up with the old one when you installed it?
Dan
