I did not grind mine down. Most of the parts you are trying to punch out are hollow in the middle, so the point does not contact. I love the set because there is always one that fits almost perfectly into the tube or part.
For instance. to disassemble a slimline. Pull the pen apart in the middle and select the punch that barely fits through the twist mechanism. The outside shoulder will contact the inside taper of the tip, tap it out with no point contact. Now select the punch for the lower barrel. The outside shoulder will engage with the twist mechanism and it can be tapped out without the point interfering. Also with the finial the point does not contact anything, it is the shoulder the does the pushing.
Certainly if you are only going to use them for pens, it won't hurt anything to grind down the points to be safe.
I will say that if you try to actually use them as transfer punches on anything harder than wood, those points will take care of themselves. [
](by bending or breaking off)