“I thought this only applied if there was nothing in between the two of you (like a chair or something)?”
Yes, yhe issur of walking in front of a person davening SE is only when there’s nothing in between you, and a table acts as a mechitza in this regard.