Brother, I will second what some other posters have recommended for tools the Harbor Freight 'best' lathe tool set is good to go. I read that same review from Alan Lacer. When you are ready to upgrade I highly recommend PM technology tools--they really do hold an edge much longer--Joe Fulgoni from You Tube is the owner and designer for Hurricane tools--the offer some PM tools at a good price my own favorites are Crown PM tools but they are a bit pricey. Also if you know what your looking for e-Bay and Amazon are really good resources.
As to your grinder, the real issue is that it runs to fast--this makes it pretty easy to 'burn' the temper out of your tool edge--the key to avoiding this is pretty simple, keep a water source close, and dunk the tool after every single pass across the stone. I personally have a Wolverine jig system, and it is really good for setting up an putting repeatable edges on your tools--having said that the key is the repeatable part--any jig you make that lets you present your tool to the wheel the same way every time is all you are really trying to achieve.
I am also a fledgling knifemaker, and have a hella good belt sander-albeit the wrong size that most knifemakers would recommend a 1x42 instead of a 2x72, but it is a heavy duty machine for sure--I sharpen a lot on my belt sander, but a lot of care must be taken to avoid burning your tools/blades--I am yet to figure out a good jig system for the beltsander, and this is what goaded me into buying the wolverine for my grinder.
One last thought, a lot of tools can be bought without a handle for a really good savings, and then you can turn a tool handle on you lather--a really easy shortcut on this is to go to Home Depot or whatever big box supply store, and buy yourself a 1/1/2 dowel, or whatever size dowel, chop it up into appropriate lengths and turn your handle out of that.
You can spend almost limitlessly on this hobby, the IAP is a great resource to gather input on the various purchases you may make to help you make a decision.
Your off to a good start--remember the internet is your friend when shopping!