excess

When removing finished blanks from the bushings, I often get raised CA on the edge of the wood. I find sanding can either scratch the part of the finish I want to keep and attempting to shave off with an xacto knife can pull the CA away from the wood. What's the best way to solve/avoid this...