"Google just announced a very large language model that achieves SOTA across a very large set of tasks, mere days after the DeepMind announced Chinchilla, and their discovery that data-scaling might be more valuable than we thought." [...] "A significant number of BIG-bench tasks showed discontinuous improvements from model scale, meaning that performance steeply increased as we scaled to our largest model.
Links for 2022-04-05
Links for 2022-04-05
Links for 2022-04-05
"Google just announced a very large language model that achieves SOTA across a very large set of tasks, mere days after the DeepMind announced Chinchilla, and their discovery that data-scaling might be more valuable than we thought." [...] "A significant number of BIG-bench tasks showed discontinuous improvements from model scale, meaning that performance steeply increased as we scaled to our largest model.