Way too much jumping to conclusions going on. Since you don't seem to mind tearing the engine down, I'd replace those bearings. Like Russ said, you can't predict how the wrong size will behave on down the road. It'll sure beat the hell out of repairng the potential damage in the future.