70% is your diet/lifestyle and 30% is exercise.

Do you have a weight lifting regiment?

Do you know how much calorie your body consume to remain your current weight without any exercise?

You can try maintenance level caloric intake and lifting heavy. You can still lose fat and gain muscle although will be at a safe and slower pace.