A study conducted by researchers at CCC, which is based at the MIT Media Lab, found that state-of-the-art AI chatbots — including OpenAI’s GPT-4, Anthropic’s Claude 3 Opus, and Meta’s Llama 3 — sometimes provide less-accurate and less-truthful responses to users who have lower English proficiency, less formal education, or who originate from outside the United States. The models also refuse to answer questions at higher rates for these users, and in some cases, respond with condescending or patronizing language.
It does not say that or anything close to it.
The bots were given the exact same multiple choice questions with the same wording. The difference was the fake biography it had been given for the user prior to the question.
I think you are making the mistake of attributing intent to an LLM. A LLM does not have intent. It takes the context and generates the statistically most likely tokens that come next. The biography is part of the context.
The fact that it gives different answers based on context purely comes down to how it was trained and that there is no concept of “factual information”.
I’m not defending LLMs, this is just LLMs doing exactly what they were trained to do.