Yes. Wear them. They are designed to grip better on grass, stay dry in wet conditions, and very the sole's stability to allow your foot to feel very stable during the swing.

Tennis shoes are designed to grip pavement, cushion the shock of running, and are not very good at keeping you dry in wet conditions.