Links for 2023-07-29
DeepMind announces Robotic Transformer 2 (RT-2)
A novel vision-language-action (VLA) model that learns from both web and robotics data, and translates this knowledge into generalised instructions for robotic control.
RT-2 shows improved generalisation capabilities and semantic and visual understanding beyond the robotic data it was exposed to. This includes interpreting new commands and responding to user commands by performing rudimentary reasoning, such as reasoning about object categories or high-level descriptions.
We also show that incorporating chain-of-thought reasoning allows RT-2 to perform multi-stage semantic reasoning, like deciding which object could be used as an improvised hammer (a rock), or which type of drink is best for a tired person (an energy drink).
RT-2 can perform more involved commands that require reasoning about intermediate steps needed to accomplish a user instruction. Thanks to its VLM backbone, RT-2 can also plan from both image and text commands, enabling visually grounded planning, whereas current plan-and-act approaches like SayCan cannot see the real world and rely entirely on language.
Read more: https://www.deepmind.com/blog/rt-2-new-model-translates-vision-and-language-into-action
In the press: https://www.nytimes.com/2023/07/28/technology/google-robots-ai.html [https://archive.is/objpJ]
For the First Time, New Tech Enables Paralyzed Man To Move and Feel Again https://time.com/6298543/paralysis-reversal-keith-thomas/
“…we're releasing the Open Catalyst Demo to the public — this new service will allow researchers to accelerate work in material sciences by enabling them to simulate the reactivity of catalyst materials ~1000x faster than existing computational methods using AI.” https://open-catalyst.metademolab.com/
Revolutionary Artificial Intelligence Algorithm Learns Chemical Language and Accelerates Polymer Research https://news.gatech.edu/news/2023/07/18/revolutionary-artificial-intelligence-algorithm-learns-chemical-language-and
LoraHub: Efficient Cross-Task Generalization via Dynamic LoRA Composition — “We anticipate this resource will widen access to and spur advancements in general intelligence as well as LLMs in production.” https://arxiv.org/abs/2307.13269
Researchers develop a machine-learning technique that can efficiently learn to control a robot, leading to better performance with fewer data. https://news.mit.edu/2023/simpler-method-learning-control-robot-0726
What are GPT Agents? A deep dive into the AI interface of the future https://logankilpatrick.medium.com/what-are-gpt-agents-a-deep-dive-into-the-ai-interface-of-the-future-3c376dcb0824 [https://archive.is/JpeHB]
“…let's take a look at a cognitive neural network proposed in the early 80s by Stephen Grossberg and Gail A. Carpenter. This model, based on Adaptive Resonance Theory (ART), tackles the stability-plasticity dilemma (explained below).” https://twitter.com/ray_khz/status/1679886163224543234
The US government is taking a serious step toward space-based nuclear propulsion https://arstechnica.com/space/2023/07/nasa-seeks-to-launch-a-nuclear-powered-rocket-engine-in-four-years/
Mitsubishi Heavy Industries to be responsible for design of new Japanese fast reactor https://www.neimagazine.com/news/newsmhi-to-be-responsible-for-design-of-new-japanese-fast-reactor-11014815
The shape of our brain rather than the interactions between various regions, plays a pivotal role in influencing our thoughts, emotions, and actions. https://scitechdaily.com/century-old-paradigm-overturned-brain-shape-matters-more-than-neural-connectivity/?expand_article=1
Ultraflexible endovascular probes for brain recording through micrometer-scale vasculature https://www.science.org/doi/10.1126/science.adh3916
New sensor mimics cell membrane functions https://news.mit.edu/2023/new-sensor-mimics-cell-membrane-functions-0721
Oxford chemists achieve breakthrough achievement: hazard-free production of fluorochemicals https://www.ox.ac.uk/news/2023-07-21-oxford-chemists-achieve-breakthrough-achievement-hazard-free-production
Ukraine links:
"...the military analysts Michael Kofman and Jeffrey Edmonds wrote in Foreign Affairs, just days before the start of the full-scale invasion, Russia would attack Ukraine with hundreds of bombers, masses of missiles, and other systems that would provide Russian forces with “overwhelming firepower.” Russia, they said, “would have the advantage along every axis of attack.”...The Russian air force has struggled to do any of this...Ukrainian forces behind the frontlines have been able to move freely on open roads in broad daylight." https://www.foreignaffairs.com/ukraine/war-defied-expectations [https://archive.is/7S5ci]
Several people were injured in a reprisal attack on the Ukrainian city of Dnipro after an S-200 missile struck the Russian city of Taganrog. https://www.thedrive.com/the-war-zone/ukraine-situation-report-s-200-missile-slams-into-russian-town
“Big video from the Ukrainian SBU released earlier today, with a number of recent rear area strikes on the Velyka Novosilka axis.” https://twitter.com/Osinttechnical/status/1685108104537513985 [https://t.me/SBUkr/9084]
Russia’s mass abduction of Ukrainian children may qualify as genocide https://www.atlanticcouncil.org/blogs/ukrainealert/russias-mass-abduction-of-ukrainian-children-may-qualify-as-genocide/
“Whoever planned this assault should be jailed. I am sorry but I can’t stay silent.” https://twitter.com/Teoyaomiquu/status/1685075457962627072