Links for 2023-04-19
Machine learning models are reaching weak recursive self-improvement territory. Synthetic data is beginning to outperform real data.
Paper: Synthetic Data from Diffusion Models Improves ImageNet Classification https://arxiv.org/abs/2304.08466
MiniGPT-4, an open-sourced model performing complex vision-language tasks like GPT-4: https://minigpt-4.github.io/
Our findings reveal that MiniGPT-4 processes many capabilities similar to those exhibited by GPT-4 like detailed image description generation and website creation from hand-written drafts. Furthermore, we also observe other emerging capabilities in MiniGPT-4, including writing stories and poems inspired by given images, providing solutions to problems shown in images, teaching users how to cook based on food photos, etc. These advanced capabilities can be attributed to the use of a more advanced large language model. Furthermore, our method is computationally efficient, as we only train a projection layer using roughly 5 million aligned image-text pairs and an additional 3,500 carefully curated high-quality pairs.
Photographer admits prize-winning image was AI-generated https://www.theguardian.com/technology/2023/apr/17/photographer-admits-prize-winning-image-was-ai-generated
Google Devising Radical Search Changes to Beat Back A.I. Rivals [The New York Times] https://archive.is/NpzSm
"When von Ahn saw what GPT-4 was capable of...he scrapped the two [Duolingo] programs involving human teachers. 'It took me ~1 minute'" [The New Yorker] https://archive.is/l2v6h
“Last week, Park et all released “Generative Agents”, a paper simulating interactions between tens of agents. We gave it a close read, and implemented one of the novel components it introduced: a long-term, reflection-based memory system.” https://twitter.com/hwchase17/status/1647987713449263106
“Web LLM runs the vicuna-7b Large Language Model entirely in your browser, and it’s very impressive” https://simonwillison.net/2023/Apr/16/web-llm
US adults support a six-month pause on some kinds of AI development https://today.yougov.com/topics/technology/articles-reports/2023/04/14/ai-nuclear-weapons-world-war-humanity-poll
Overview of CCP Draft Measures on Generative AI https://www.chinalawtranslate.com/en/overview-of-draft-measures-on-generative-ai/ (see also: China’s New AI Regulations: Are They Enforcable? https://www.chinatalk.media/p/chinas-new-ai-regulations-are-they)
History of the creation of OpenAI from Elon Musk's perspective. https://twitter.com/mezaoptimizer/status/1648195392557727744
The CRISPR-based gene drive that Kevin Esvelt came up with would allow a single scientist to alter or destroy species across the world. This can eradicate malaria, or collapse ecosystems. https://www.inverse.com/science/kevin-esvelt-interview
“It's surreal to think that if humans had just invented CFCs before developing the technology to monitor atmospheric ozone we would simply have melted all the O₃ and ended most life on the planet” https://www.lesswrong.com/posts/qfiHikNEfjR4bDhGr/is-this-true-tyler_m_john-if-we-had-started-using-cfcs
Cortés, Pizarro, and Afonso as Precedents for Takeover https://www.lesswrong.com/posts/ivpKSjM4D6FbqF4pZ/cortes-pizarro-and-afonso-as-precedents-for-takeover
Exploring Metaculus’ community predictions: “Metaculus’ community predictions about probabilities[2] look good in general, but they perform close to random predictions for the category of artificial intelligence.” https://forum.effectivealtruism.org/posts/zeL52MFB2Pkq9Kdme/exploring-metaculus-community-predictions
Sleight-of-hand magic trick only fools monkeys with opposable thumbs https://phys.org/news/2023-04-sleight-of-hand-magic-monkeys-opposable-thumbs.html
MIT and GIST researchers develop a natural and comfortable “Seamless-walk” VR locomotion system https://www.csail.mit.edu/news/mit-and-gist-researchers-develop-natural-and-comfortable-seamless-walk-vr-locomotion-system
“Recent report on China's chip capabilities: in trailing-edge chips (20-120 nm) chips, China leads or has a good odds of self-sufficiency; in leading-edge (phones, AI), seems very unlikely they can suceed or go self-sufficient given US export controls.” https://twitter.com/Willyintheworld/status/1646995831113887751
As Germany closed its last three nuclear reactors this weekend, Finland's brand-new 1.6GW reactor has entered full commercial operation, generating 30% of the country's electricity demand, and has reduced its dependence on imports from Sweden https://www.bnnbloomberg.ca/europe-s-biggest-reactor-caps-14-year-delay-to-begin-commercial-output-1.1908290