The official GV android app dials out to a special google phone number anytime you make an outgoing call with it. Then it connects your call to the number you are calling. For incoming calls, google voice calls your cell number, and the app recognizes it as a GV call and handles it.
Essentially, whatever the precise technical background processes, the bottom line is that the gv app uses cell minutes.