If you can't attend on that day itself, reschedule it to another day. I do that most of the time.

If you are not interested at all, just mentioned that you have accepted a job offer from another company.

They won't bite you through the telephone wire if you don't want to attend the interview session.