Dear Avirah,
Why can’t an atheist believe in the mitzvos? One can have beliefs and still not claim to have all the answers. Is that last sentence the center of our dispute? An atheist will think of the commander as a fact. Not a being. It could be the same source as the commander of the laws of nature.