i played a round with a football friend and he has the same problem and he took for what seemed forever to start the swing
i asked him about it and he mentioned that it is like a darts player who has trouble releasing the dart
with this in mind think of something in your routine as a trigger point for the start of the backswing