Shouldn't be a problem removing the wall, but just need to check the column location, if its not in the middle it should be fine, most probably your neighbour meant the one on the right side in the drawing marked as black in colour.