The affair is over!?!?

So to make a long story short, I had an affair with this rude,disrespectful drunken , for 2 years, told my hubby about 6 months ago bcz this jerk was threatning to go to my house, hubby forgave me, I have 2 little ones, I do love my hubby, and kids, & home ct...but there is just something about this guy that I can't get over, I haven't talked to him since Friday bcz he told me "FU Bi#@@" bcz I got a pedicure, so rediculous! But I haven't talked to him since then, this is a record for us not to talk, at first I hated him, I mean I still do for saying what he said, but now Iam just wondering why he ain't calling?!? I know that is so dumb to thinkl, but what the hell is it with him that has me so attatched?!?!?