First and foremost, bring your baby back to the family. The baby needs her mom and dad. Why would you even have a baby if you don't plan to take care of him/her? It's easy to have a baby, only takes few min. But raising a baby or a kid is a completely different experience.

Secondly, communicate your thoughts and feelings to your hubby. He needs to know what is going on. It is tough to have a balance between his own vs his parents/relatives. Sometimes you do have to look the other way. Make him to clean the house since it's his relatives made the mess. If the communication is a one way street, then you have a bigger issue on hand. Most likely it will lead to separation then divorce.

hope for the best. and get ur baby back. The kid needs mom's love.