That means you are working in a cheapskate company that force you to work long hours.

I'm still single and I always go back on time without any problem.

It's been 5 years I didn't work long/extra hours. You just need to find a company that appreciate you, not squeezing you. And of course you have to be really choosy which company you want to join. I don't join typical SME or shop lot types of company.