Close it up with gypsum board on both sides. On the room side you can paint it so it matches your wall.. so it just looks like a flush wall.

On the bathroom side you can make it a shelf or something. Don’t know how it looks like but assume typical tile half the wall. Don’t make sense spending so much to tile it or build a brick wall.

Can easily revert if needed.