I have a sense that he has stage fright. See, men grow up putting their entire worth on his manhood, so whenever they feel they are not 'up to it' the didi shrivels.

Best if you comfort / encourage him by saying all's good, that he need not worry, and he should be fine. He should be able to maintain his hardness until you both climax.