I have this problem too.. not gonna bore you with my story.. anyways, there are two types of man boobs:
1. Fat accumulated at the chest area
2. Glandular tissue (breast glands)

If you want to check, put your fingers together to form a small circle and press the spot near the areola..  if it's hard and feels gland-y, then its breast tissue.  you can only remove this via surgery...
if it's soft, then it's fat... it may be stubborn fat, and hard to remove...

For my case, i have a lot of fat as well as glandular tissue.. had my surgery two weeks ago... now in recovery period