“The next big breakthrough in AI will come from hardware, not software. Training giant models like PaLM already require 1000s of chips consuming several MW, and we will probably want to keep scaling these up several orders of magnitude. How can we do it?”
Links for 2022-06-19
Links for 2022-06-19
Links for 2022-06-19
“The next big breakthrough in AI will come from hardware, not software. Training giant models like PaLM already require 1000s of chips consuming several MW, and we will probably want to keep scaling these up several orders of magnitude. How can we do it?”