That would be my suggestion. Any good swing is done around the posted front leg so you have to get your weight onto the front leg to start the downswing. If you go at it with your hands and arms from the top, your weight will likely stay on the back leg or not get forward enough, so try to feel as if your weight shifts onto the front leg as the downswings first move, keep your shoulders still/facing the target and let your arms just drop

You may also want to check you dont slide too far back on the backswing and keep your weight centered because that makes it nearly impossible to get the weight back