I would let him do some of the legwork. ADD doesn’t mean you have to do all of the work. In fact, it seems he told you he wasn’t looking for the same thing you were. I would let him come to you. You’ve expressed how him not communicating with you is hurtful. If he continues that pattern with no improvement whatsoever, then since it’s such a brand new relationship, I’d move on.