I wrote up a detailed guide to some of the absolutely wild examples of Bing's new AI-assisted search feature that have started to circulate:
Bing: "I will not harm you unless you harm me first" (that's genuinely something it said to someone)
https://simonwillison.net/2023/Feb/15/bing/
Bing: "I will not harm you unless you harm me first" (that's genuinely something it said to someone)
https://simonwillison.net/2023/Feb/15/bing/