Links for 2023-07-11
Teaching Arithmetic to Small Transformers: Isolates the factors that contribute to fast emergence of arithmetic capabilities from next-token prediction. Highlights the importance of high-quality, instructive data, which can significantly improve accuracy. https://arxiv.org/abs/2307.03381
Eric Drexler has written '“Reframing Superintelligence” + LLMs + 4 years', a look at how things have moved in the 4 years/centuries since the original CAIS paper. https://www.lesswrong.com/posts/LxNwBNxXktvzAko65/reframing-superintelligence-llms-4-years
AI and CRISPR Precisely Control Gene Expression https://www.nyu.edu/about/news-publications/news/2023/july/ai-crispr-gene-expression.html
Tree-of-thought prompting expands on chain-of-thought by causing language models to consider multiple reasoning paths in the process of generating an output. https://arxiv.org/abs/2305.10601
“What I think LLMs are doing: 1. LLMs do both of the things that their promoters and detractors say they do. 2. It is very difficult from the outside to tell which they are doing. 3. Both of them are useful.” https://moultano.wordpress.com/2023/06/28/the-many-ways-that-digital-minds-can-know/
Eric Schmidt: This is how AI will transform the way science gets done https://www.technologyreview.com/2023/07/05/1075865/eric-schmidt-ai-will-transform-science/ [https://archive.is/wip/trkjv]
Eric Schmidt, reflecting on a recent trip to Ukraine, praises FPV drones as "cheaper than a mortar round" (he says $400) and "more accurate than artillery fire" (depends on round & EW). He says the FPV drones carry up to 1.3kg of explosive payload. https://www.wsj.com/articles/the-future-of-war-has-come-in-ukraine-drone-swarms-kamikaze-kyiv-31dd19d7 [https://archive.is/pgcpC]
One Policy to Dress Them All: Learning to Dress People with Diverse Poses and Garments https://sites.google.com/view/one-policy-dress
“Ways I Expect AI Regulation To Increase Extinction Risk” https://www.lesswrong.com/posts/6untaSPpsocmkS7Z3/ways-i-expect-ai-regulation-to-increase-extinction-risk
AI image recognition models are powering the world’s next agricultural workforce: Watch as these drones use multispectral color grading to determine the ripeness + sugar content of apples, then gently pick them. Comment by user:davidad: "It may be counterintuitive, but if you want to work high on trees, it is overall cheaper to fly a light platform than to have a massive skeleton that can reach high while remaining rigid. Birds and bees are more common in nature than giraffes." -> Robot arms are ~$10k for 1 meter reach. Quadrotors are ~$200. https://twitter.com/AiBreakfast/status/1677828971214282752
“I've asked an AI to generate a trailer for a HEIDI movie and now I can never sleep again” https://www.youtube.com/watch?v=0A2-Af5JEWU
“Multiple lines of evidence suggest women gained consciousness and self-awareness first…Women with an IQ of 70 recognize faces as well as men with an IQ of 130. For women, the task is intuitive. This is their evolved niche. For men the task is effortful” https://www.vectorsofmind.com/p/eve-theory-of-consciousness-v2
According to this analysis, between 40,000-55,000 Russian soldiers KIA at the end of May 2023. If we add DPR - LPR KIA to their work, we are probably closing in on 65,000-70,000 total KIA. https://en.zona.media/article/2023/07/10/stats
This looks very promising: