I self drive all the time. Only when Im in big cities I dont because parking is expensive. But if doing intra-city then no choice.

which part of JP? rural vs big city Osaka/Tokyo very diff.
if rural then self drive no probs..Tokyo drive w/ stroller vs public transport w/ stroller, I would go for public transport and not travel during rush hour time.

the only thing that's a hassle with stroller is looking for lift whether in station/building exit.