gay_manta_ray t1_j8c1uv8 wrote
Reply to comment by maskedpaki in This is Revolutionary?! Amazon's 738 Million(!!!) parameter's model outpreforms humans on sience, vision, language and much more tasks. by Ok_Criticism_1414
this benchmarks seems pretty comprehensive
maskedpaki t1_j8g2v6v wrote
no actually seems like a pretty narrow science benchmark
​
if you told me the MMLU 0 shot was higher than 175 billion gpt 3.5 with under a billion parameters then id be absolutely shocked
Viewing a single comment thread. View all comments