I have absolutely no idea why...?

First of all, you should forget whatever you are feeling towards this man because this thing you're doing might cause a serious problem. What I see is that you are feeling pity to this man whenever his wife shouts at him and you are just feels so sorry about his situation. Dressing sexy is good but for those who has the same as yours. Try to ignore the " feeling" you are into right now and start to focus on some things instead.