Future ML Systems Will Be Qualitatively Different: "when predicting the future of ML, we should not simply expect existing empirical trends to continue. Instead, we will often observe qualitatively new, "emergent" behavior...even for a single model, we might encounter qualitative phase transitions as we train for longer."
Links for 2022-01-14
Links for 2022-01-14
Links for 2022-01-14
Future ML Systems Will Be Qualitatively Different: "when predicting the future of ML, we should not simply expect existing empirical trends to continue. Instead, we will often observe qualitatively new, "emergent" behavior...even for a single model, we might encounter qualitative phase transitions as we train for longer."