It is rather baffling and I do feel bad for you. Being a secondary character on an island must really suck in the early game. I imagine later on it won't matter as much when pretty much all you're doing is decorating and collecting but it'd still be annoying.