When I shoot a more formal interview, I always go with the interviewer to the side of the camera. If I'm doing an interview in the moment, with the camera on my shoulder and I have a sound guy, I'll have the sound guy stand where I would and have the subject direct their answer to the sound guy after I ask. Sometimes if I am soloing a shoot and have a camera+minishotgun and maybe a LAV on my shoulder, I'll have the subject look at my face. It's not ideal in the sense that they are almost looking at the lens, but it's better than them feeling uncomfortable answering while pretending I'm over a foot or two.
That said, my approach is to always let the subject(s) tell the story. It's for this reason I avoid recorded voiceover, as well as having my voice in it. Being able to draw the story out from what is said in interviews and observationally makes things so much more powerful. Not that either of those are bad, that's just what I feel works best for me.