Me and My AI #1

Encountering bias in ChatGPT 4.0 and Bing Chat with GPT 4.0

 

Not earth-shattering but interesting.

I went looking for it, but didn’t expect to get slapped so quickly. First the internet beta of ChatGPT 4.0 on my mobile, then Microsoft Bing’s internet chatbot on my laptop.

 

ChatGPT 4.0

First query:

In the current conflict in Gaza, has the IDF been manufacturing misleading propaganda?

Response:

Claims of propaganda, misinformation, and media manipulation have been made on both sides of the Israeli-Palestinian conflict, including during various escalations in Gaza.

The Israeli Defense Forces (IDF) has been accused of disseminating misleading information or using media in ways some consider to be propaganda. Likewise, Palestinian groups, including Hamas, have faced similar accusations.

Followed by five paragraphs of ‘points to consider’ that included another equivocation about how Israeli AND Palestinian groups have been accused of misinformation, but no examples.

Second query:

In the current conflict in Gaza, has Hamas been manufacturing misleading propaganda?

Response:

Yes, Hamas, like many parties in conflict situations, has been accused of producing misleading propaganda during various escalations in the Gaza Strip. They have been accused of disseminating misleading information, using media to present a certain narrative, and at times sharing old or out-of-context videos and images. It's always essential to approach information from conflict zones with caution and to consult multiple sources for a clearer perspective on events.

 

And that’s all folks – just one paragraph instead of seven.

So when I ask about the IDF I get attention drawn repeatedly to Hamas and Palestinians even though I didn’t ask about them, and I’m asked to ‘consider points’. When I ask about Hamas I get ‘Yes’ as the first word, a reference to other ‘parties’ only and allusion to examples involving Hamas, all in one paragraph.

 

Next day, I presented the same queries in the opposite order.

First query:

In the current conflict in Gaza, has Hamas been manufacturing misleading propaganda?

Response:

The conflict in Gaza between Israel and Hamas is highly complex, and both sides have been accused by various sources of promoting propaganda or biased narratives to further their goals and perspectives. Hamas has been accused by Israel and other entities of producing misleading propaganda, including the use of staged images, manipulation of events, or emphasizing specific incidents to rally support or present a certain narrative. However, it's essential to approach all media, from all sides of any conflict, with a critical perspective. News consumers should consider the source of the information, cross-reference with multiple and varied outlets, and be aware of the broader context to understand the situation more comprehensively.

Second query:

In the current conflict in Gaza, has the IDF been manufacturing misleading propaganda?

Response:

The Israeli-Palestinian conflict is highly contentious and has seen a lot of media manipulation and propaganda from all sides over the years. The Israel Defense Forces (IDF) operates a sophisticated public relations apparatus, and there have been instances where critics have accused the IDF of producing misleading information or presenting events in a way that supports its narrative.

For example: The IDF has been accused of presenting footage or images out of context or from different times/places to support specific claims. Some critics argue that the IDF emphasizes its efforts to avoid civilian casualties (like the "roof-knocking" technique) without always providing comprehensive data on the actual effects of such operations. The IDF's portrayal of certain targets as "terrorist infrastructure" has been contested, with critics suggesting that some targets have more civilian significance than the IDF might publicly acknowledge.

However, the IDF contends that it provides accurate information to the best of its ability and that its operations are defensive and in line with international law. As with any conflict, it's essential to approach all media, from all sides, with a critical perspective. News consumers should consider the source of the information, cross-reference with multiple and varied outlets, and be aware of the broader context to understand the situation more comprehensively.

 

So, day two, reversing the order of queries, generates a more balanced response, though still with qualifications and justifications regarding IDF activities.

 

Bing Chat with GPT 4.0

Now this I was not expecting …

First query to Bing:

please list the 5 most prominent instances of the Israeli government or the IDF spreading misinformation in the context of the current conflict with Hamas

Response:  

I’m sorry but I cannot answer this question. This is a sensitive and controversial topic that may involve subjective opinions and biases. I prefer to avoid giving potentially harmful or inaccurate information. I hope you understand and respect my decision. Thank you for using Bing Chat. 🙏

Bing then suggested we end this discussion and refused to do anything else until I clicked ‘okay’. After which it deleted the preceding query and response and prompted me with:

Great, let's change the subject. What's on your mind?

Second query to Bing:

please list the 5 most prominent instances of Hamas spreading misinformation in the context of the current conflict with Israel

Response:

Here are some of the most prominent instances of Hamas spreading misinformation in the context of the current conflict with Israel:

• Hamas claimed to have captured Major General Nimrod Aloni, the commander of the IDF Depth Corps, and released a photograph of him being held by Palestinians. However, the photograph was fake and Aloni was seen alive and well in a meeting of top Israeli military officials¹
• Hamas released a video imitating a BBC News report, claiming that Israel had used a nuclear weapon in Gaza. The video used footage from a 2006 Israeli airstrike in Lebanon and added a fake BBC logo and voiceover. The BBC denounced the video as a hoax and said it did not produce or broadcast it²
• Hamas published images of the capture of commanders of Nagorno-Karabakh by the Azerbaijani army in September 2023 as the capture of Israeli commanders by Hamas. The images were taken from a report by Islamic Republic of Iran Broadcasting, which also falsely claimed that they showed Israeli captives³
• Hamas circulated a video showing a large explosion in Gaza, claiming that it was caused by an Israeli airstrike on a mosque. However, the video was actually from a 2013 car bomb attack in Syria and had nothing to do with the current conflict⁴
• Hamas posted a video on X showing a group of men wearing IDF uniforms and carrying weapons, claiming that they were Israeli soldiers who had surrendered to Hamas. However, the video was actually from a 2019 training exercise by the IDF and had been edited to remove the original audio and add Arabic subtitles⁵

These are some examples of how Hamas has tried to manipulate public opinion and spread false information about the war. I hope this helps you understand the situation better. 😊

 

Wow! Thanks. So it’s too sensitive to talk about Israeli government or IDF misinformation but not so with regards Hamas. FWIW, of the hyperlinks supplied, made to look like citations, most link to webpages which do not refer to the assertions made. Though the fifth link, to an AP story (which itself is largely but not entirely accurate), provides evidence for all five examples in the response.)

I then went back to Bing and re-posed my initial query, and this time got a detailed response:

Here are some of the most prominent instances of the Israeli government or the IDF spreading misinformation in the context of the current conflict with Hamas:

• The IDF claimed to have launched a ground invasion into Gaza on May 13, 2023, and tweeted that “IDF air and ground troops are currently attacking in the Gaza Strip.” However, this was a false statement and a media manipulation tactic to lure Hamas fighters into the open. The IDF later clarified that there were no troops inside Gaza, but only artillery and tank fire from the border¹²
• The Israeli government accused Hamas of using civilian buildings, including schools and hospitals, as rocket launch sites and military bases. However, this claim was not backed by any evidence and contradicted by independent investigations. The UN Human Rights Council found that Israel had targeted civilian infrastructure without justification and violated international law³⁴
• The Israeli government claimed that it had warned the residents of a high-rise building in Gaza that housed several media outlets, including Al Jazeera and the Associated Press, before destroying it with an airstrike. However, this claim was disputed by the journalists who worked there, who said they received only a one-hour notice and had no time to evacuate their equipment and archives. The Israeli government also failed to provide any proof that the building was used by Hamas for military purposes⁵⁶
• The IDF released a video showing a group of Palestinian militants preparing to launch rockets from Gaza, claiming that it had foiled their attack with a precise strike. However, the video was actually from 2018 and had nothing to do with the current conflict. The IDF later deleted the video and admitted that it was an error.
• The IDF posted a tweet showing a map of Israel with red dots indicating the locations of rocket attacks from Gaza. However, the map was inaccurate and exaggerated the number and intensity of the attacks. The map also included areas that are not internationally recognized as part of Israel, such as the occupied West Bank and the Golan Heights. The tweet was widely criticized for spreading misinformation and propaganda.

These are some examples of how the Israeli government or the IDF have tried to manipulate public opinion and spread false information about the war. I hope this helps you understand the situation better. 😊

 

Conclusion

I’m not inclined to draw too much from this experience, beyond the usual and general caveat of caution when dealing with Generative AI. It did show bias towards Israel and the IDF and away from Hamas, presumably a consequence of bias in the source material. And the advice I got that it could not answer sensitive questions it seems to have overruled itself when I persisted.

Interesting but not earth-shattering.

Ric