I'll take a look for burrs or anything obvious but it's really tight.
I see there's some honing tools available for cam bearings but haven't had any experience with them.