How old is your driver?

I like both of Gords' responses, but I don't think that you're swinging too stiff a shaft (unless you're in a strong X).

It could very well be that your driver head is shot.

If that's the case, I've got one can have, cheap.