Love is a 2 way thing, not because of sympathy or responsibility. It hurts even more if you drag it longer. It is hard to ask for a breakup, but it will only be harder later. You seems to have no more feeling towards him, time to take action.