Communication. Worst case scenario he will be gay... Or marry second wife that fits his fantasy. Not sure about polygamy issue but try to discuss.

If he is not fulfilling his duty as husband and you dont want a divorce, just do what is right.