you don't want to hit the driver on the downswing, you want to hit it one the upswing. try a upper body tilt away from the target. still have a proper weight shift, but make sure you keep your head still and do not move that foward with your weight shift.