Viewing a single comment thread. View all comments

currentscurrents t1_jc8a641 wrote

This is basically China's GPT-3, right?

0

jakderrida t1_jc911o0 wrote

More like their BERT. Get it??

8

kizumada OP t1_jc99iwj wrote

ERNIE 3.0 or 3.0 Titan is more like BERT+GPT, which fuses both auto-regressive network and auto-encoding network

9

jakderrida t1_jcekh6h wrote

I know that ERNIE 3.0 did amazingly on the benchmarks and is allegedly the best on most of the leaderboards. However, it seems inaccessible in English-language form, if at all.

1