I suffered the same problem when I started - but I'm 6'1", and was 250 lbs (but can bench 180 and leg press 650), so needless to say I was frustrated when I couldn't get my driver to go further than 200 yards (and slicing HARD, no less). My club from 150 was a 4 iron, and my swing was a reverse pivot with a false coil and a fantastic hip slide. My CPGA pro couldn't believe I could even get back to impact with my swing, as I was swaying 8" during my swing.

A few lessons from my local CPGA pro had my slice removed, my 150 club a 7 iron, and my driver going 250 or 260 on average. There was one week where my driver was going almost 300 yards... but the swing was ugly.

Anyway, I'm just offering encouragement that with a good golf swing, your distance will come.