Links for 2023-10-28
“Synthetic data will provide the next trillion tokens to fuel our hungry models. MimicGen: massively scaling up data pipeline for robot learning! We multiply high-quality human data in simulation with digital twins. Using < 200 human demonstrations, MimicGen can autonomously generate > 50,000 training episodes across 18 tasks, multiple simulators, and even in the real-world! MimicGen shows the power of synthetic data and simulation to keep our scaling laws alive.” https://mimicgen.github.io/
“Is a universal brain decoder possible? Can we train a decoding system that easily transfers to new individuals/tasks? We show that it’s possible to transfer from a large pretrained model to achieve SOTA 🧠!” https://poyo-brain.github.io/
“Can we make LLMs unlearn a subset of their training data? ...we took Llama2-7b and in 30 minutes of fine-tuning, made it forget the Harry Potter universe while keeping its performance on common benchmarks intact...” https://www.microsoft.com/en-us/research/project/physics-of-agi/articles/whos-harry-potter-making-llms-forget-2/
Revealing Intentionality In Language Models Through AdaVAE Guided Sampling https://www.alignmentforum.org/posts/4Hnso8NMAeeYs8Cta/revealing-intentionality-in-language-models-through-adavae
Teaching Language Models to Self-Improve through Interactive Demonstrations https://arxiv.org/abs/2310.13522
Creative Robot Tool Use with Large Language Models https://creative-robotool.github.io/
YouTube Is Creating an AI Tool That Allows People to Sound Like Popular Artists https://www.complex.com/music/a/markelibert/youtube-ai-tool-sound-like-artists
After 25 years of growth for the $68 billion SEO industry, here’s how Google and other tech firms could render it extinct with AI https://fortune.com/2023/10/21/how-generative-ai-could-change-google-search-68-billion-seo-industry/
Apple’s Big Plan to Bring Generative AI to All Its Devices https://www.macrumors.com/guide/apple-gpt/
Toyota said it was close to being able to mass-produce solid-state electric-vehicle batteries which would have double the range of existing cutting-edge batteries and could fully charge in 10 minutes. https://www.ft.com/content/6224f235-568c-4e2f-8247-e7dacf0ef20c [https://archive.ph/nU8rH]
Political links:
Tortoise understands that the attacks on the US military across the Middle East from Iranian proxies are far more extensive than has been reported. The US may have already had to withdraw from a dozen forward operating bases in NE Syria/Iraq. https://www.tortoisemedia.com/2023/10/27/us-evacuates-forward-operating-bases-in-syria-as-iranian-backed-attacks-grow/
The new house speaker, Republican Michael Johnson, said that the United States cannot allow Putin to win in Ukraine. “Russia's victory may encourage and empower China in relation to Taiwan.” https://twitter.com/NOELreports/status/1717815641493696725
EU leaders could not agree on the $50 billion aid package to Ukraine. Hungary and Slovakia opposed the proposed package. Orban said this proposal “isn’t working for us”, while Slovakian leader Fico said it will not support military aid to Ukraine. https://www.reuters.com/world/europe/positions-not-matching-yet-eu-leaders-fight-slice-budget-pie-2023-10-26/ [https://archive.ph/r0tM3]
These Russians are burning alive for Putin's insane conquest of another destroyed ghost town. https://twitter.com/wolski_jaros/status/1717807032525578426
“I saw someone mapping the Ukrainian supply routes into Avdiivka in a rather lacklustre way. So I decided to do my own, more informative, map. To talk about the logistics of Avdiivka we also need to talk about the terrain west of it.” https://twitter.com/J_JHelin/status/1717932692153462993
Avdiivka offensive equipment loss numbers as of 27 October 2023. In summary: 157 RU losses vs. 8 UA losses https://docs.google.com/spreadsheets/d/1VIyACYHfnJi8cUMWjXAXDhS419l9IHcIhGJaK1RWMFQ/edit?usp=sharing (by @naalsio26)
Subscribe to Axis of Ordinary
Links and stuff