Once you turn quarter sawn oak into a pen, pretty much any of the ray effects are lost. In fact the figure will look the same as from a plane sawn oak board. If the wood you have is big enough for other projects like boxes then save it for that unless they are narrow trimmings from bigger boards.
That is the beauty of firewood wood sourcing. I never have big, store bought boards at the start. I have tiny pieces that have figure close to the pen blank needs. I only turn it round sometimes.