Never start the downswing with your hands. You'll completely throw your swing out of position, lose power and decrease accuracy.

Check out Ben Hogan's book. He provides an excellent analysis related to this topic. I think it's the best golf book ever. Simple, yet precise. Alot of people think Hogan had the best swing of all time.