The Professor of Montreal, Yoshua Bengio, considered one of the parents of artificial intelligence, presented his new organization dedicated to an AI responsible on Tuesday, who wants to design software capable of preventing the derivations of AI agents.
For several years, this winner of the Turing Award (2018), also called the Nobel of IT, alert about the risks linked to the development of AI, either malicious use or software slippers.
“The most advanced systems already show signs of conservation and deceptive behavior instincts,” said the researcher in a statement published on Tuesday. “And that will only accelerate as their abilities and autonomy increase.” His new non -profit organization, called Lawzero, wants to be “an answer to these challenges.”
“A safeguard”
Several recent examples have confirmed that AI had recently crossed sophistication levels, including a study conducted by the initial anthropic. In a fictional test scenario, the new interface of the anthropic generation, Claude 4, was warned of his imminent replacement by a computer engineer. Corner, she, by her own initiative, has tried to make the engineer sing to deter it from getting rid of her.
Lawzero has given the mission of “proposing a mode of supervision of AI agents”, this new generation of generative AI models capable of carrying out a series of tasks independently, from the investigation to the Internet to a call to a client, including the writing of a code program.
“AI can be extremely beneficial if we make sure you don’t harm people,” he continued, “either because it is in bad hands or independently.”
Lawzero also wants to work in an AI with limited autonomy for scientific research. The organization already has more than 15 researchers and has already received several financial contributions, one of them by Schmidt Sciences, a charitable organization created by former Google Chief Eric Schmidt and his wife Wendy.
Lawzero was launched under the auspices of the Institute of Learning Algorithms of Montreal (Mila), founded in 1993 by Yoshua Bengio.
Source: BFM TV
