Did you leave the Earth and Moon masses at normal? Even exploding an uranus would likely disturb the binary.
Edit: Wait, unless we're talking about conservation of mass here? Still, a heavy enough object passing by a low mass binary would disturb it.