Just because a word means a certain thing in English in one country, doesn't automatically mean it has the same definition in English in another country.
Just because a word means a certain thing in English in one country, doesn't automatically mean it has the same definition in English in another country.
If I didn't like it, I would just ask my friend not to say it around me. I wouldn't tell him it's negative around the world, though, just because I feel it is.
Your friend pointed out that it's NOT derogatory to them. So I'm not sure where the confusion is. Not derogatory in Australia - derogatory in America. Seems pretty cut and dried. It's derogative to YOU, not HIM.