This is just like quantum leap, the famous series in the 80s, it just another dimension/world with similar people. They time travel to other people world so that they will not mess up theirs, remember Tony condition not to change anything within 5 years, that's why he create the GPS. And that's why they need to return the stone back, so that they will not messed other people world future.