Weight distribution is different when towing, so that includes a change in front end weight, and front ride height is likely also different because of that. So you're probably either having a front end geometry change, or something (that has always been there) is not getting damped because of either more or less vertical load than normal on the front end (should be less because of the bumper pull).
