The amount is over what is allowed by Small Claims Court, so it looks like you can only resort to civil action.

When it comes to contractors, always pay in stages not big lump sum.