Don’t let them make you feel dumb. This is a thing that native speakers (in all languages) do and may not always realize it: the bias that people who don’t speak well are dumb. Which is completely untrue if it’s a language barrier issue. Give it some time, your will adjust to the accent.