Some folks will tell you that the secret is to learn to use a skew chisel so skillfully that you get a very smooth surface and you don't have to sand at all.
A harder form of maple will be less prone to absorbing the neighbouring colored dust.
A harder form of colored wood might also help ... I am thinking of an Australian burl like brown or red mallee or concinna burl. Those eucalyptus woods are harder than bubinga.
The less sanding you do the better the result, but I know that is a hard goal to set.
If you can blow a stream of compressed air on your blank when you are turning and sanding that helps a lot.