I will guess muffler bearing, when off the throttle and in neutral the exhaust pressures are lowered and the bearing can "loosen" while spinning, creating the noise.
or any of the above, I lean toward the pinion bearing. Can you her anything on the throttle our is the Jeep loud and drowning out the noise?