My impact position is hips facing target, shoulders are about 45* to the target line.

As for starting the downswing, yes - the lower body needs to start the downswing. All the energy has been stored in the lower body, therefor the lower body must start the 'unwinding' process.