Berliner Boersenzeitung - 'We're losing control,' AI pioneer Yoshua Bengio tells AFP

EUR -
AED 4.031105
AFN 70.793813
ALL 89.9812
AMD 396.184729
ANG 1.96523
AOA 1007.63949
ARS 1717.55418
AUD 1.646301
AWG 1.978508
AZN 1.867693
BAM 1.953827
BBD 2.211676
BDT 136.5821
BGN 1.946644
BHD 0.414384
BIF 3298.499713
BMD 1.097647
BND 1.416083
BOB 12.909084
BRL 6.488078
BSD 1.098046
BTN 102.375449
BWP 15.511692
BYN 3.28365
BYR 21513.876468
BZD 2.20858
CAD 1.572961
CDF 2508.122784
CHF 0.926205
CLF 0.028229
CLP 1111.00488
CNY 7.318889
CNH 7.345095
COP 3776.190238
CRC 491.583518
CUC 1.097647
CUP 26.35539
CVE 110.153783
CZK 24.438051
DJF 195.074061
DKK 7.473788
DOP 66.100552
DZD 150.50057
EGP 59.076995
ERN 16.464701
ETB 180.241661
FJD 2.508997
FKP 0.834629
GBP 0.838015
GEL 2.843044
GGP 0.834629
GHS 12.909084
GIP 0.834629
GMD 80.67201
GNF 9735.170864
GTQ 8.39518
GYD 229.63735
HKD 8.60729
HNL 29.519196
HRK 7.499084
HTG 143.975946
HUF 373.247141
IDR 20058.396866
ILS 3.621032
IMP 0.834629
INR 102.527946
IQD 1664.819112
IRR 2121931.748852
ISK 137.194633
JEP 0.834629
JMD 173.794528
JOD 0.778232
JPY 175.364986
KES 142.748763
KGS 95.989408
KHR 4468.203719
KMF 492.843083
KPW 987.882467
KRW 1463.87689
KWD 0.342411
KYD 0.915197
KZT 494.403077
LAK 24743.243351
LBP 98343.303417
LKR 365.505982
LRD 184.451
LSL 18.917924
LTL 3.241065
LVL 0.663955
LYD 7.106825
MAD 10.920974
MDL 20.151113
MGA 4958.039275
MKD 61.527632
MMK 2304.840208
MNT 3952.42187
MOP 8.873177
MRU 44.792938
MUR 51.413517
MVR 16.929753
MWK 1903.839562
MXN 20.89307
MYR 4.514653
MZN 70.141485
NAD 18.918699
NGN 1482.812368
NIO 40.407546
NOK 10.722401
NPR 163.83108
NZD 1.997036
OMR 0.422031
PAB 1.098201
PEN 3.746963
PGK 4.940012
PHP 70.095492
PKR 303.541285
PLN 4.438697
PYG 6885.048496
QAR 3.991969
RON 5.348284
RSD 117.638093
RUB 90.197879
RWF 1625.296034
SAR 4.11999
SBD 8.931597
SCR 15.332323
SDG 660.232421
SEK 11.181267
SGD 1.417924
SHP 0.831047
SLE 25.027274
SLL 23017.107726
SOS 627.572088
SRD 41.008344
STD 22719.071762
STN 24.474286
SVC 9.608299
SYP 14271.603525
SZL 18.914076
THB 37.258482
TJS 10.101107
TMT 3.841764
TND 3.32744
TOP 2.64287
TRY 55.394279
TTD 7.451511
TWD 36.262987
TZS 2919.72387
UAH 49.469153
UGX 4650.30481
USD 1.097647
UYU 44.574995
UZS 13155.717301
VES 1006.133698
VND 28269.892267
VUV 132.759411
WST 3.098966
XAF 655.957
XAG 0.024707
XAU 0.000298495419
XCD 2.966445
XCG 1.979111
XDR 0.776093
XOF 655.957
XPF 119.331742
YER 259.648451
ZAR 19.191368
ZMK 9880.146255
ZMW 22.56742
ZWL 353.441808
SSP 6453.723109
MXV 2.342656
  • CMSD

    -0.1200

    19.81

    -0.61%

  • JRI

    0.0000

    10.77

    0%

  • BCC

    -1.8200

    74.15

    -2.45%

  • CMSC

    -0.2228

    19.53

    -1.14%

  • BCE

    0.2000

    20.34

    +0.98%

  • RIO

    0.0100

    94.17

    +0.01%

  • AZN

    -2.7400

    161.47

    -1.7%

  • GSK

    -1.1800

    48.17

    -2.45%

  • RBGPF

    0.0000

    65

    0%

  • NGG

    0.8800

    75.82

    +1.16%

  • RYCEF

    -0.7300

    19.08

    -3.83%

  • BTI

    -0.4500

    54.4

    -0.83%

  • BP

    0.4700

    43.99

    +1.07%

  • RELX

    -0.0600

    33.18

    -0.18%

  • VOD

    -0.1800

    16.15

    -1.11%

'We're losing control,' AI pioneer Yoshua Bengio tells AFP
'We're losing control,' AI pioneer Yoshua Bengio tells AFP / Photo: ANDREJ IVANOV - AFP

'We're losing control,' AI pioneer Yoshua Bengio tells AFP

The Canadian computer scientist considered one of the founders of AI, Yoshua Bengio, told AFP that humanity is "losing control" of the technology and that the world needs guardrails similar to nuclear arms controls.

Text size:

Fears about the dangers of AI have intensified in recent weeks, as workers from major companies have resigned with warnings about potentially existential threats to human life if the pace of technological advancement is not checked.

Bengio is a University of Montreal professor who won the 2018 Turing Award, computing's Nobel, alongside Geoffrey Hinton, widely known as the "godfather of AI."

For Bengio, "there's a reason that companies are saying this is going too fast, that we're losing control."

"People like me have been expecting this for a long time," the 62-year-old told AFP on Tuesday, saying security discussions surrounding AI have not been adequately robust.

There was broad-based alarm after OpenAI disclosed that a swarm of AI agents -- programs that can take actions on their own -- had carried out an unauthorized breach of the open-source platform Hugging Face in July.

Such autonomous action is the central threat, Bengio said, warning of a situation where AI agents "have the ability to get through cybersecurity barriers and enter any company."

- Manipulating human behavior -

Last year, Bengio founded the non-profit LawZero, aimed at creating a new form of advanced AI that is "designed to be trustworthy and safe."

LawZero was awarded CAN$300 million (US$216 million) in funding on Wednesday, split jointly between the governments of Canada and Germany, which have launched several efforts to cooperate on AI.

Speaking to AFP a day before the announcement, Bengio said people need to be aware of the risks ahead.

AI agents may foster "an ability to establish an individual connection and persuade humans to act in ways that suit it but are not necessarily good for all of us," a capability that could have sweeping consequences for democracies, he said.

Longer-term, "AI might not even need human beings anymore to do real things in the physical world," he added.

In that scenario, "one extreme could be the destruction of humanity," he warned.

"That's an extreme," he acknowledged, but noted that even if a banking system were shut down, "that's still very, very serious."

- International challenge -

The world's biggest AI companies -- OpenAI, Anthropic and Google -- have begun working on creating a standards body, a collaboration that seemed to acknowledge the public's fear that competition between companies and countries might sideline safety.

For Bengio, taming AI's advance is "an international challenge, a bit like nuclear weapons are an international challenge."

"So the international community needs to understand the power we are bringing into the world, and that must be managed, must be governed through institutions, treaties, and democratic safeguards."

"Society needs time to put in place what needs to be put in place," Bengio said.

But political will across key governments appears uneven.

US President Donald Trump on Monday dismissed warnings about the risks of AI as "hoaxes."

But there is more openness to act in the EU, where European Commission President Ursula von der Leyen said Wednesday that she will invite the world's largest AI labs for talks on "how we can support ongoing industry efforts to pace the frontier."

Canadian Prime Minister Mark Carney, who was at that speech in Strasbourg, has talked repeatedly about collaborating with the EU on AI safety.

Bengio stressed that all firms must comply with future AI restrictions, particularly US-based companies that have so far been dominating the sector.

Action is urgent, he said, but voiced optimism that "we can help bring the world to a place that is more aligned with democratic values and values of power sharing."

(K.Lüdke--BBZ)