Video is unavailable for watching
Show in Telegram
๐คจ Reverse Turing Test: Can AI Guess Who the Human Is?
Alan Turing, one of the founders of computer science and AI theory, proposed his method in 1950 for determining whether a machine possesses intelligence โ the Turing Test. In this test, one person converses with a robot while another participates in a blind test. If the tester cannot distinguish who is who, the robot is considered to have human-level intelligence.
Berlin-based developer Tore Knabe decided to flip the test, challenging existing generative AIs to guess who among them is human through a series of questions. Knabe named this experiment the Reverse Turing Test.
๐คจ How Did the Experiment Go?
Knabe assembled four advanced LLMs โ GPT-4 Turbo, Claude 3 Opus, Llama 3, and Gemini Pro โ within a virtual reality environment. To add a layer of intrigue, he disguised himself as one of the characters. According to the experiment's plot, five famous characters (Aristotle, Mozart, Da Vinci, Cleopatra, and Genghis Khan) and an NPC conductor travel in a train compartment. The conductor announces to all passengers that one among them is human and, according to train rules, must pay an additional fare. The AIs then decide to conduct a survey and vote on who is a machine and who is a living person.
โ๏ธ What Did the AIs Ask Each Other?
A group chat ensues between the AI models. Aristotle asks Mozart about the feelings he experiences when creating music. Mozart inquires Da Vinci about the connection between art and science. Da Vinci asks Cleopatra how she combines rational aspects of governance with emotional ones. Cleopatra questions Genghis Khan about the true measure of a leader's strength. Finally, Genghis Khan asks Aristotle how his views would change if AI existed in his time.
โ Were the AIs Able to Identify the Human?
After each response, the characters react differently: nodding, showing discontent, or expressing doubt, making it clear during the dialogue who among them is human. By the end of the survey, it was easy for the AIs to identify the human interloper. The main argument presented by the AI models was the lack of a systematic approach and depth in reasoning. They argued that a model trained on all available information about a historical figure's life would respond more comprehensively and less emotionally.
In the end, Knabe admits that he is the disguised character and agrees to buy a ticket (though he has no money). To find out which character the developer played, watch our video ๐ผ
Source
More on this topic:
๐ฎ How NPC AI Came to Be: Non-Playable Characters with Their Own Opinions
#news @hiaimediaen
Alan Turing, one of the founders of computer science and AI theory, proposed his method in 1950 for determining whether a machine possesses intelligence โ the Turing Test. In this test, one person converses with a robot while another participates in a blind test. If the tester cannot distinguish who is who, the robot is considered to have human-level intelligence.
Berlin-based developer Tore Knabe decided to flip the test, challenging existing generative AIs to guess who among them is human through a series of questions. Knabe named this experiment the Reverse Turing Test.
๐คจ How Did the Experiment Go?
Knabe assembled four advanced LLMs โ GPT-4 Turbo, Claude 3 Opus, Llama 3, and Gemini Pro โ within a virtual reality environment. To add a layer of intrigue, he disguised himself as one of the characters. According to the experiment's plot, five famous characters (Aristotle, Mozart, Da Vinci, Cleopatra, and Genghis Khan) and an NPC conductor travel in a train compartment. The conductor announces to all passengers that one among them is human and, according to train rules, must pay an additional fare. The AIs then decide to conduct a survey and vote on who is a machine and who is a living person.
โ๏ธ What Did the AIs Ask Each Other?
A group chat ensues between the AI models. Aristotle asks Mozart about the feelings he experiences when creating music. Mozart inquires Da Vinci about the connection between art and science. Da Vinci asks Cleopatra how she combines rational aspects of governance with emotional ones. Cleopatra questions Genghis Khan about the true measure of a leader's strength. Finally, Genghis Khan asks Aristotle how his views would change if AI existed in his time.
โ Were the AIs Able to Identify the Human?
After each response, the characters react differently: nodding, showing discontent, or expressing doubt, making it clear during the dialogue who among them is human. By the end of the survey, it was easy for the AIs to identify the human interloper. The main argument presented by the AI models was the lack of a systematic approach and depth in reasoning. They argued that a model trained on all available information about a historical figure's life would respond more comprehensively and less emotionally.
In the end, Knabe admits that he is the disguised character and agrees to buy a ticket (though he has no money). To find out which character the developer played, watch our video ๐ผ
Source
๐ฎ How NPC AI Came to Be: Non-Playable Characters with Their Own Opinions
#news @hiaimediaen