Sydney is a complete disaster; expensive, competitive and stressful with desperate people throwing money they don’t have at places that are tiny, mouldy, falling apart with zero security. There’s no cap on rent increases and you could find yourself moving out after six months as there’s no long term options for tenants. Best would be Malaysia, an absolute dream. Beautiful plentiful apartments with great facilities at competitive prices.
You coming to visit from overseas and your mom is asking your brother if you’d given him money like he’s an Uber driver is completely taking the piss. They demand you come back with the caveat you pay for everything and don’t stay with them or ask for anything is just setting you up to fail.
It sounds like they are punishing you for leaving and if you move back you’d doubtless find yourself an unwanted burden and scapegoat for any problems. You can’t win with people like that. Go back to Japan and make a new family with your wife.