Tips for anyone using a rooted stock ICS kernel :

If you're facing issues whereby it takes too long to start a call when the phone is trying to sync your Google contacts, up to the point that your phone app kinda hangs, just run a permission fix.

I still have no permanent fix yet, but just doing a permission fix seems to solve the problem temporarily.