There are two problems: federation works best with a variety of instances of like-minded people, and people on open-registration generalistic instances abusing that to wreak havoc on other instances.

Same as Instances can fully de-federate from other instances, they should also be able to de-federate voting from "non-friendly" instances.