tell your boss and her boss, easier to avoid any conflict later.

I used to get call from my ex colleague even after 3 years I left the company, is like I am giving free consultation, first year I was still ok, but already 3 years, that's what I cannot stand, I finally brush that guy off.