I've tried not using primer on wooden door before. The thing is the next layer gloss paint can be "peeled" easily from the previous layer. Gloss paint doesn't stick too well to the previous gloss paint.

Or perhaps it's because I was using a cheaper paint, I dunno.