Links for 2022-06-18
“I think: a NN will use its weights to memorize answers because that's easy, until it has to memorize so many that it's easier to instead start encoding the algorithm that generates the answers. Neural nets are lazy, so you have to give them a hard enough job (enough, and diverse enough data) that they can't take the lazy way out.” — gwern
“If humans are filtering model outputs, then the more heavily they filter, the more they are teaching future models what are good and bad samples by populating the dataset with good samples and adding criticism to bad samples.”
— gwern
Scott Aaronson is going to work for OpenAI on the theoretical foundations of AI safety and alignment. https://scottaaronson.blog/?p=6484
The lingering effects of Neanderthal introgression on human complex traits https://www.biorxiv.org/content/10.1101/2022.06.07.495223v1
An OpenAI Codex-powered chat interface for translating natural language theorem statements into Lean mathlib. https://github.com/zhangir-azerbayev/lean-chat
New paper by Li et al (MS Asia + Peking U) uses simple tricks to get (yet another) boost to GPT-3 reasoning. https://arxiv.org/abs/2206.02336
Constant Renewal: Your Liver Is Just Under Three Years Old https://scitechdaily.com/constant-renewal-your-liver-is-just-under-three-years-old/
What does a batsman see? An essay on concentration and performance. https://www.thecricketmonthly.com/story/1136242/what-does-a-batsman-see
New draft by Nick Bostrom on foundations of ethics https://nickbostrom.com/papers/mountethics.pdf
Photonic Chip Performs Image Recognition at the Speed of Light https://spectrum.ieee.org/photonic-neural-network
How DALL-E Could Power a Creative Revolution https://www.theverge.com/23162454/openai-dall-e-image-generation-tool-creative-revolution
Banning attempt of the National Democratic Party of Germany: “…the petition was rejected in 2003 after it was discovered that a number of the NPD's inner circle, including as many as 30 of its top 200 leaders were undercover agents or informants of the German secret services, like the federal Bundesamt für Verfassungsschutz. They include a former deputy chairman of the party and author of an anti-Semitic tract that formed a central part of the government's case.” https://en.m.wikipedia.org/wiki/National_Democratic_Party_of_Germany
Science fiction short story involving sapient corvid: The Next Ten Billion Years http://archdruidmirror.blogspot.com/2017/06/the-next-ten-billion-years.html?m=1