I live by the expression: your expectation is not my obligation

So do what you want, what feels right for you. And don’t be guided by your family’s expectations. So I would distance myself more and no longer visit family

It might be a little weird at first. And you will have to translate a lot. But you can still build a good relationship. My husband and his generation (brothers, sisters, nephews, nieces, etc.) are spread all over Europe. And everyone there married a local. We meet twice a year. In addition to my husband’s home language, English, German, Dutch, French and Spanish are spoken and a lot of translation is done in between. The grandchildren are now also starting to learn English, but before that they also played together and just used body language.