If u made the decision on leaving and not returning.....at least leave in a more professional way.
Either write him an email or calling him up and informing him of your departure. Don't get angry or spiteful....u will face much much more difficulties in the future than this. Take it down with a pinch of salt.