I think for handicap purposes, playing from a different set of tee boxes screws up the slope and rating.

I couldn't find anything at the USGA website regarding it - maybe contact them directly.