Hi all! I think this question should be raised before but was just wondering whether you guys would share your opinion/experiences on impacted wisdom teeth and braces?

Because I took my braces off 4 years ago and noticed that recently, my lower front teeth are out of 'alignment'. Note that I took out my permanent retainer about a year ago.
I went back to the dentist who did my braces. We took an x-ray and he said that it was due to my growing wisdom teeth. He straight away asked me to extract three of them D:!
Then I went and consulted another dentist, he said that it was not necessary to extract them at all currently and said that impacted wisdom teeth can not cause the teeth to move. He said the reason it moved was due to the removal of my permanent retainers ._.

So guys, your opinion? Should I extract the wisdom teeth or just put on back the permanent retainers?