Beitei medrash and shuls are open. Not everyone is goofing off. You should hang out with Bnei Torah.
Regular yeshivos wouldn’t work since people visit out of town relatives (and believe it or not, even rabbanim, not to mention talmidim, have relatives).
The bottom line is:- If you were Mechabed Chol haMoed appropriately, you are off the hook for BeHaB; If Chas veSholom you were Mezlzel Chol haMoed you better repent seriously on BeHaB since Mishno in Pirkei Ovos states clearly:- Kol hweMevazeh Es haMo’ados>> Ein Lo Chelek leOlom haBo, which all the Meforshim explain to be talking about Chol haMoed.
Clearly BeHaB is primarily about Chol haMoed, as non existent after Shovu’os.