Depends on whether the job is important to you or you are willing to look for another job.

If the job is important to you and you cannot afford to lose the job, suck it up and continue on.

Else, throw your employment contract on your boss table, ask him to point out which line/clause required you to work on your holiday. If want you to work on your holiday and weekend, pay you for OT.

Make sure you read your employment contract first and understand it to make sure you are on the right side of things.