Anyone mind giving some advice about this guy I've been seeing?

From experience, if you can't feel comfortable then it's not worth it. Though it might still be too early on to get to the comfort level you might prefer. I say go with it until either one of you decides it's just not the best fit. That's how I've done it so far, and yeah I'm still single but it's because I'm so picky!