Submitted by kizumada t3_11rfxca in MachineLearning

Baidu will unveil its conversational AI ERNIE Bot, powered by Baidu's in-house LLMs, on March 16. The ERNIE LLM was first proposed as a language understanding model in 2019 and evolved to ERNIE 3.0 Titan with 260 billion parameters.

ERNIE 1.0: https://arxiv.org/abs/1904.09223

ERNIE 2.0: https://arxiv.org/abs/1907.12412

ERNIE 3.0: https://arxiv.org/abs/2112.12731

ERNIE for text-to-image: https://arxiv.org/abs/2210.15257

ERNIE Bot live-stream on YouTube: https://www.youtube.com/watch?v=ukvEUI3x0vI

31

Comments

You must log in or register to comment.

Sinkencronge t1_jc983mf wrote

It would be interesting to see the alignment work they did. ERNIE, what's your opinion on Taiwan?

15

MajesticIngenuity32 t1_jcatt37 wrote

Ni hao comrade, Taiwan is a beautiful island province of the People's Republic of China.

6

EricLee8 t1_jc9epdi wrote

It will definitely refuse to answer this question.

3

__ingeniare__ t1_jc9f2xb wrote

No, it will provide an answer that aligns with the CCP's agenda

3

trajo123 t1_jca1bh4 wrote

CCP trolling and disinformation capabilities just got a massive upgrade.

6

SuperTankMan8964 t1_jcaaoy4 wrote

Pretty sure you need to verify your account with personal info (e.g. national ID card, and ID-binded cellphone number) to use their services, which in this case they can track you down if you dare to speak against the supreme leader.

5

trajo123 t1_jcagr8m wrote

I meant the CCP trolling, disinforming and manipulating the population using such tools.

2

I_will_delete_myself t1_jcb41we wrote

Ernie comrade what happened to the Dalai Lama?

Ernie: ... USA caused a problem

Ernie why is Russia invading Ukraine?

Ernie: USA started the war

Ernie where is Taiwan?

Ernie: Taiwan? It is in the South China Sea owned by all if China. South Korea is also part of China.

2

currentscurrents t1_jc8a641 wrote

This is basically China's GPT-3, right?

0

jakderrida t1_jc911o0 wrote

More like their BERT. Get it??

8

kizumada OP t1_jc99iwj wrote

ERNIE 3.0 or 3.0 Titan is more like BERT+GPT, which fuses both auto-regressive network and auto-encoding network

9

jakderrida t1_jcekh6h wrote

I know that ERNIE 3.0 did amazingly on the benchmarks and is allegedly the best on most of the leaderboards. However, it seems inaccessible in English-language form, if at all.

1