Links for 2023-08-01
Pushing the Limits of Machine Design: Automated CPU Design with AI https://arxiv.org/abs/2306.12456
Founder of DeepMind: "[Autonomous AI agents that can become self-made millionaires] could be as little as two years away." https://www.technologyreview.com/2023/07/14/1076296/mustafa-suleyman-my-new-turing-test-would-see-if-ai-can-make-1-million/ [https://archive.is/D7YO0]
“The training goal for LLMs like GPT is not cognitively-myopic (because they think about the future) or value myopic (because the transformer architecture optimizes accuracy over the entire sequence, not just the next-token). However, training is consequence-blind, because the training data is causally independent of the models actions. This assumption breaks down when models are trained on AI generated text.” https://www.lesswrong.com/posts/c68SJsBpiAxkPwRHj/how-llms-are-and-are-not-myopic
ChatGPT Is Replacing Humans in Studies on Human Behavior—and It Works Surprisingly Well https://singularityhub.com/2023/07/25/chatgpt-is-replacing-humans-in-studies-on-human-behavior-and-its-working-surprisingly-well/
Real-Real-World Programming with ChatGPT https://www.oreilly.com/radar/real-real-world-programming-with-chatgpt/
What’s The Normal Way That Concepts Exist? — “We don’t really distinguish all of these claims in ordinary speech because they’re so closely correlated that they’ll probably all stand or fall together.” https://astralcodexten.substack.com/p/were-not-platonists-weve-just-learned
Energy Superabundance: How Cheap, Abundant Energy Will Shape Our Future https://www.thecgo.org/research/energy-superabundance/
New fMRI study of STEM creativity---students generating original scientific hypotheses---finds increased cooperation between brain networks supporting spontaneous and controlled thinking https://psycnet.apa.org/fulltext/2023-91559-001.html
“…if we imagine that the crabs are all closely related, then any deep differences are a surprising empirical fact, and are the main remaining thing our model needs to explain. But once we accept that the crabs are not closely related, then any convergence/similarity is a surprising empirical fact, and is the main remaining thing our model needs to explain.” https://www.lesswrong.com/posts/qsRvpEwmgDBNwPHyP/yes-it-s-subjective-but-why-all-the-crabs
Ukraine links:
“The only way to stop this,” Ukraine's military intelligence told the NYT, “is the immediate withdrawal of Russian occupation troops from Ukraine.” An investigation into Kyiv's growing fleet of homegrown kamikaze drones that have hit Moscow. https://www.nytimes.com/2023/07/31/world/europe/ukraine-drone-strikes-russia.html [https://archive.is/aiBoN]
Yet another drone strike in Moscow by Ukrainian “Beaver” long-range attack drones which have a range of over 1000km. Damage:
https://twitter.com/revishvilig/status/1686228506064060416 / Drone: https://twitter.com/trbrtc/status/1686200037678661632
“The only railway that was supplying Russian forces in Kherson and Zaporizhzhia has been hit by two Storm Shadow cruise missiles. Russia now has to truck supplies all the way from Dzhankoi in Crimea to frontline units.” https://twitter.com/ColbyBadhwar/status/1686021684485079041