But to constantly re-paint the house because of smeared paints from ah long might not be feasible.
Unless you put up big notice in front of your house clarifying that the previous owner had moved.

Good luck!