The fediverse has its issues, but if an instance you're on ends up being terrible you can easily migrate to a different one while still having access to the same pool of content and people.
Whereas for leaving Twitter, the sacrifice is quite heavy no matter which platform you're moving to.