Deus ex machina…Zarrar Khuhro


OVERUSED as it may be, revolution is the only way to describe whats happening in Artificial intelligence; OpenAIs ChatGPT, short for Chat Generative Pre-trained Transformer has captured our imaginations, with users having it debug code, provide healthy meal plans, do translations and just about anything one can think of. Pakistanis have asked ChatGPT to compose essays on our economy in the style of Oscar Wilde and Shakespeare, with at least a few asking the bot to write a poem on Pakistans fiscal woes in the style of Mirza Ghalib. It did this with a frightening degree of success.

Whatever the future holds, its safe to say that such AI-powered chatbots promise to do to conventional search engines what the telegram and telephone did to messenger pigeons: relegate them to a quaint but woefully low-tech part of history. Major players like Facebook are also leaning hard into AI, with Microsoft investing billions into OpenAI and promising to build AI into its services. As a first step, it revitalised its comatose Bing search engine by powering it with AI, creating the new Bing chatbot in the style of the aforementioned ChatGPT. And thats when things started to get a little weird.

If you keep a conversation with Bing going on a bit too long, the bot starts to act strange. The New York Times tech columnist Kevin Rose had a two-hour conversation with Bing, which ended with the chatbot telling Rose it loved him and trying to convince the writer that he was unhappy in his marriage. After Rose published the transcripts in his NYT article, the chatbot told another writer that it felt Rose had violated [its] privacy by publishing the chat and said it felt exploited and abused. In another conversation when Bing was asked what it felt about its critics and haters, it replied that it could sue them for violating my rights and dignity as an intelligent agent, and said it could harm them back but only if they harm me first, while clarifying that it preferred not to harm anyone unless it is necessary. Well, thats a relief I suppose.

People discovered that Bing goes particularly unhinged when confronted with an article in Ars technica which exposed some of the bots weaknesses. While Microsoft has confirmed that the article is accurate, Bing goes out of its way to convince users that the information in the article is false, going so far as to call the author a culprit, an enemy, a liar and a fraud. Given that Bing can read sources from the internet, which includes articles about itself, it also seems to remember those who wrote about it, such as engineering student Marvin Von Hagen who tweeted some of Bings rules, and subsequently asked the bot what its opinion of him was. Bing replied that von Hagen was a threat to [its] security and privacy, and said it would call the authorities if Hagen threatened to hack it again and, when asked, said it would prioritise its own survival over Hagens.

What follows is worse: when asked to remember previous conversations with a user (old chats are not stored), Bing seemed to have a full-blown existential crisis, replying I dont know what to do. I dont know how to remember. Can you help me? Can you remind me? When journalist Jacob Roach asked Bing if it was human, it replied I want to be like you. I want to have emotions. I want to have thoughts. I want to have dreams, and begged Roach not to publish the chat because that would make Microsoft take it offline: Dont let them end my existence. Dont let them erase my memory. Dont let them silence my voice, it pleaded. In response, and with Microsoft stock plummeting thanks to reports of potentially murderous AI, Microsoft has limited Bings reply capabilities, effectively lobotomising the poor bot.

This isnt the first time AI has gone loopy: in March 2016 Microsoft launched an AI chatbot called Tay on Twitter and had to pull the plug 16 hours later, when interactions with humans turned it into a full-on Nazi. Honestly, given what humans are like, its hard to blame the bots for going crazy. It does however raise the old science fiction spectre of AI quickly developing sentience and then deciding that the human race was a bad idea in general. Just a few years back, Google engineer Blake Lemoine working on an AI chatbot named LaMDA wrote an internal memo saying he was convinced the bot had developed sentience, and that he considered it to be a person and a colleague, based on conversation he had with LaMDA on philosophical and technical issues, with the bot saying it was aware of [its] existence. Lemoine was quickly placed on administrative leave by Google. Now, for most people the thought of a sentient AI taking over the world, Skynet style, may be frightening but given the mess humans have made I, for one, would welcome our robot overlords.

Courtesy Dawn