I spent about ten years making jewelry from 316 stainless and 6/4 titanium on CNC and manual machines. I also almost set my house on fire cutting titanium on a hobby lathe in my bedroom.
Titanium, like 316, work hardens quickly and easily. It does not suffer dull tooling. Unless you have horsepower, you want to use sharp, positive rake cutters. Titanium also doesn't give up heat easily and the heat will build up in the part instead of leaving with the chips. That's why flood coolant is almost always recommended. All of that said, I almost always had good luck with PTD brand cobalt high speed steel drill bits. They absolutely have to be started on center. If you don't spot drill, the drill likely won't last one hole. Small pecks to clear chips and add cutting fluid will be necessary. Do not try to follow a drill with a larger drill. Drill on size or bore or ream, if you follow it with a larger drill that drill will burn. Sharp, positive rake, carbide inserts work well on lighter machines. TiAlN coatings or other similar material specific coatings will greatly improve tool performance and life. Fine chips are a fire hazard and cutting titanium can create sparks easily. (The kids used to think I was hazing them when I said the chips would go up in a tower of white flames if they didn't keep their machines clean. Got to the point that I'd take the new guys outside with a bucket of chips and fire extinguisher and set a pile of chips on fire with my cigarette lighter. It's bright white and hot, but any ABC extinguisher should put it out. It's not as bad as magnesium alloys.)
So, all of that said, I don't find it hard to work with even on a hobby lathe, but there's a learning curve and you need to be cautious particularly of the fire risk.