Links for 20210826
Cerebras' Tech Trains "Brain-Scale" AIs > A single computer can chew through neural networks 100x bigger than today's https://spectrum.ieee.org/cerebras-ai-computers
A New Chip Cluster Will Make Massive AI Models Possible: Cerebras says its technology can run a neural network with 120 trillion connections—a hundred times what's achievable today. -- “From talking to OpenAI, GPT-4 will be about 100 trillion parameters,” Feldman says. “That won’t be ready for several years.” https://wired.com/story/cerebras-chip-cluster-neural-networks-ai/
How good is Codex? — “Codex is able to write code that it has seen before in different ways and languages, and weave them together to create to code. But it isn’t yet able to write new algorithms, find clever optimizations, or consistently generate code without logic bugs. Hopefully over time better models will be developed that can exceed the ablities of Codex. There is still a long way to go in the development of source code language models, but Codex is already exicting today.” https://smitop.com/post/codex/
“I Beta Tested OpenAI’s Codex, and the Results Are Spooky Good” https://betterprogramming.pub/i-beta-tested-openais-codex-and-the-results-are-spooky-good-e282a1874c79
The Codex Skeptic FAQ https://www.lesswrong.com/posts/Rhg27MqkxJsnZwoYg/the-codex-skeptic-faq
Summary of where we are on creating macroscopic superpositions https://www.quantamagazine.org/how-big-can-the-quantum-world-be-physicists-probe-the-limits-20210818/
Thread about emergent AI behaviour that nobody deliberately designed yet seems meaningful. https://threadreaderapp.com/thread/1428008041887281157.html
Scaling Laws for Deep Learning https://arxiv.org/abs/2108.07686
Short-SF about AI alignment https://www.metastellar.com/2021/08/20/the-puppy-problem/
James Thompson summarizes a new Dutch study of how much immigrants pay into taxes vs. take out in services. Asylum seekers from Muslim countries are exceptionally expensive. https://www.unz.com/jthompson/costly-immigration/
Christian Marclay’s 2010 film The Clock is a montage of 12,000 film clips that depict clocks or timepieces, arranged in chronological order. It’s designed to run in a continuous 24-hour loop — so the film itself functions as a clock.