I think this is normal la.
I have a friend, had sex almost everyday when they first together, and after few months, they didn't have that regular and later on, not even once a month. But they still live happily ever.

For your case, it is ego problem for not letting you know but it is very normal for a guy. After he split out, now you should try to understand him.

BTW, 3 times a day, i think a normal guy's little brother would not be able to stand for 3 days after that battle.