Start with class, then social with people who speak Japanese, preferably Japanese who is not so good in other languages.

No matter how many class you attend, you can't master the speech if u did not practice with real conversations.

Sometimes is not that you don't understand, is just that your brain couldn't catch up translating the words u want to use.