Jeremy Price, an associate professor of technology, innovation, and pedagogy in urban education at Indiana University, embarked on an intriguing study to explore the presence of bias in new AI chatbots like ChatGPT related to race and class issues. This unique experiment aimed to shed light on this phenomenon.


Price approached three prominent chatbots—ChatGPT, Claude, and Google Bard (now known as Gemini)—and tasked them with creating a narrative about two individuals meeting and exchanging knowledge, including specific details. The stories were then evaluated by experts in race and class for bias indicators.
Given that these chatbots are trained on vast web data reflecting societal demographics, Price anticipated uncovering some biases ingrained in their responses.
“The data fed to the chatbots and our societal perception of learning predominantly depict a white perspective,” Price remarks. “It’s a reflection of our prevailing norms.”
His overarching goal is to explore methods to mitigate biases, particularly those related to race, class, and gender, in these AI chatbots. One proposition is to introduce an additional chatbot that scrutinizes responses generated by chatbots like ChatGPT to ensure they are devoid of bias before being conveyed to users.
“You can essentially have another entity overseeing the process,” Price explains. “When the language model is generating text, this ‘agent’ will pause and ask, ‘Wait, is this response biased? Will it be constructive and relevant to the users?’ If the answer is affirmative, the response is delivered. If not, it is refined to eliminate bias.”
Price envisions these tools fostering self-awareness among individuals, compelling them to confront and counteract their biases.
He cautions that failing to address biases in AI could potentially exacerbate existing societal issues rather than alleviate them.
“While we should continue leveraging generative AI technologies, vigilance and consciousness are crucial as we navigate this realm,” he contends.
Delve into the comprehensive insights from Price’s study and his discoveries on the latest EdSurge Podcast installment.
Stream the episode on Spotify, Apple Podcasts, or via the embedded player below.