If you spend time with him but you feel that he is only there physically, you can be sure that something is not okay. It doesn’t need to be a sign of an emotional affair, but there is some problem. Try to talk to him and make him open up to you. Maybe the situation will not be so bad afterwards.