My machine shop said the reason is that it's not uncommon on these for cam journals to be tight, so that when the bearings are installed, they tend to compress slightly. He said they polish them all of the time. they use scotchbrite mounted on a long aluminum shaft chucked in a drill.