There are plenty of Chassiduses that don’t let you leave, too.
They don’t have soldiers at the gates of New Square or Williamsburg refusing exit to any party. Anyone can leave. Kvetching that it is socially difficult to leave is not a matter of them being unable. (And it is good that it is socially much easier to remain with the status quo.)