Links for 2023-10-22
‘Mind-blowing’ IBM chip speeds up AI https://www.nature.com/articles/d41586-023-03267-0
From square to cube: Hardware processing for AI goes 3D, boosting processing power https://www.ox.ac.uk/news/2023-10-20-square-cube-hardware-processing-ai-goes-3d-boosting-processing-power
“Creating a "unified" policy for a robot is uniquely challenging for two reasons: (a) data is scarce; (b) a single robot can only act sequentially. In PolyTask, we learn a single policy to solve many tasks in a lifelong fashion given *just 1 demonstration* for each task.” https://poly-task.github.io/
“Introducing Video Language Planning: By planning across the space of generated videos/language, we can synthesize long-horizon video plans and solve much longer horizon tasks than existing baseline (such as RT-2 and PALM-E).” https://video-language-planning.github.io/
Introducing Self-RAG, a new easy-to-train, customizable, and powerful framework for making an LM learn to retrieve, generate, and critique its own outputs and retrieved passages, by using model-predicted reflection tokens. https://selfrag.github.io/
OpenAgents: An Open Platform for Language Agents in the Wild https://arxiv.org/abs/2310.10634 (code: https://github.com/xlang-ai/OpenAgents)
4K4D: Real-Time 4D View Synthesis at 4K Resolution https://zju3dv.github.io/4k4d/
PaLI-3 Vision Language Models: Smaller, Faster, Stronger https://arxiv.org/abs/2310.09199
“Interpretability could unravel the mysteries of LLMs! Our latest research finds an extremely efficient algorithm that generally outperforms existing work in identifying key subnetworks (circuits).” https://arxiv.org/abs/2310.10348
A web-based, interactive, and opensource Optical Simulation tool that allows students to virtually play around with mirrors, lenses, etc. https://www.optico.app/en/start-en/
Ultimately, this must be treated with the same urgency as defending against a full-scale genocidal invasion.
Ukraine links:
Russia has now lost as many KA-52 helicopters as the entire KA-52 fleet of the Egyptian Air Force. https://www.oryxspioenkop.com/2022/02/attack-on-europe-documenting-equipment.html
Russian Avdiivka Offensive: The offensive started around 10 October, resulting already in 100+ vehicle losses. https://twitter.com/GeoConfirmed/status/1715742177828000226
Dystopian and unintentionally funny Russian propaganda video about their North Korean allies. My favorite is the scene where the North Korean guy blocks Lavrov from talking to his own reporter. https://www.youtube.com/watch?v=cxAScMYgyJs (see also: How North Korean magazines accidentally subverted the USSR https://www.theguardian.com/world/2016/dec/19/how-north-korean-magazines-accidentally-subverted-the-ussr)
“The Russians have been experiencing serious issues while trying to punch through Ukrainian minefields. As Russians lacked mine-clearing equipment, they tried to improvise a solution by pushing a BTR with another BTR into the anti-tank mines.” https://twitter.com/emilkastehelmi/status/1715645160720056632
“…one of the defenders of Avdiivka, spoke about the first days of the offensive, and explained the human wave tactics that Russians deployed in an attempt to break through in the early days of the operation and beyond.” https://twitter.com/wartranslated/status/1715631066982105127
“This is insane, I really do not understand why the Russian command sends extra infantry mounted on top of tanks and armored vehicles (in Avdiivka as well). It is causing insane casualties among their soldiers. These are suicide missions. Seen plenty of such videos in Avdiivka and while we have very little footage from Kupyansk looks like the situation there is not much different.” https://twitter.com/MilitaryLabb/status/1715789962933686636
“Drawing on more than 450 interviews, a U.N. report documented abuses such as the use of electric shocks against civilians, the rape of women ranging in age from 16 to 83 and the transfer of unaccompanied Ukrainian children to Russian territory.” https://www.nytimes.com/2023/10/21/world/europe/russia-war-crimes-ukraine.html [https://archive.ph/hIS6D]