My best advice is to not think about it.

Do you think about how your hands work when you swing a bat? No.

Do you think about what your fingers are doing when you throw a frisbee? No.

Do you think about what your ankle is doing when you kick a ball? No.

If you stop trying to manipulate the club, you'll like your swing more - trust me.