You are swaying off the ball which makes it hard to hit down because you are too busy trying not to fall down.
Seriously, try turning left shoulder behind the ball and transferring weight from left foot to INSIDE of right foot. You can put a ball under the outside of your right foot to get the feeling of this transfer.
In any case, don't sway-turn