I can't really give you any advice on the calibers you plan to load but I did also start on the hand press. It works fine and I still use it when I want to do some simple tasks like depriming in front of the TV. You'll do fine speed wise with it. The couple of things i'd get if I were you would be a scale, hand primer, and a powder thrower. Honestly, hand weighing each load will get old quick.
If I were to do it all over again i'd just start with a turret press, however I presume the reason for starting with the hand press is space related, so buy with confidence.