Links for 2024-02-23
AI:
Meta presents Beyond A*: Better Planning with Transformers via Search Dynamics Bootstrapping — “…we demonstrate how to train Transformers to solve complex planning tasks...optimally solves previously unseen Sokoban puzzles 93.7% of the time, while using up to 26.8% fewer search steps...significantly outperforms baselines that predict the optimal plan directly with a 5-10times smaller model size and a 10times smaller training dataset.” https://arxiv.org/abs/2402.14083
TOOLVERIFIER: Generalization to New Tools via Self-Verification https://arxiv.org/abs/2402.14158
Google presents In Deep Reinforcement Learning, a Pruned Network Is a Good Network…”This results in networks that yield dramatic performance improvements over traditional networks and exhibit a type of "scaling law", using only a small fraction of the full network parameters” https://arxiv.org/abs/2402.12479
YOLOv9: Learning What You Want to Learn Using Programmable Gradient Information — “It can be used to obtain complete information, so that train-from-scratch models can achieve better results than state-of-the-art models pre-trained using large datasets…” https://arxiv.org/abs/2402.13616
What Evidence Do Language Models Find Convincing? Finds that LLMs today rely heavily on the relevance of a website to the query, while largely ignoring stylistic features that humans find important such as whether a text contains scientific references https://arxiv.org/abs/2402.11782
“…we show that simple supervised fine-tuning with GPT-4 as the teacher outperforms existing RLAIF pipelines.” https://arxiv.org/abs/2402.12366
Miscellaneous:
Tadashi Tokieda on how one can use the laws of physics to derive many well known results in pure mathematics, such as the Pythagorean theorem, the infinitude of primes, and many other examples. https://www.youtube.com/watch?v=vNzmj6ryulI (See also: 'The Mathematical Mechanic: Using Physical Reasoning to Solve Problems' by by Mark Levi https://www.amazon.com/dp/0691154562)
A group from CERN reports sound speed measurements in quark gluon plasmas made by colliding lead beams. Extracting the speed of sound in the strongly interacting matter created in ultrarelativistic lead-lead collisions at the LHC https://arxiv.org/abs/2401.06896
Researchers harness 2D magnetic materials for energy-efficient computing https://news.mit.edu/2024/researchers-harness-2d-magnetic-materials-energy-efficient-computing-0222
“Your fingerprints can be recreated from the sounds made when you swipe on a touchscreen — Chinese and US researchers show new side channel can reproduce fingerprints to enable attacks” https://www.tomshardware.com/tech-industry/cyber-security/your-fingerprints-can-be-recreated-from-the-sounds-made-when-you-swipe-on-a-touchscreen-researchers-new-side-channel-attack-can-reproduce-partial-fingerprints-to-enable-attacks
Ukraine:
“Reminder: President Biden can respond to this escalation by sending Ukraine 1200 ATACMS using Section 506 of the Foreign Assistance Act (Presidential Drawdown Authority). Nothing is stopping him except for his own willingness.” https://x.com/ColbyBadhwar/status/1760672058302685457
The US predicts a catastrophic shortage of ammunition and air defense missiles in Ukraine. If additional funding is not approved, a shortage of air defense assets is expected which could change the course of the war already by the end of March, ABC writes. https://abcnews.go.com/Politics/us-estimates-ukraine-military-shortages-grow-catastrophic-late/story?id=107169502
European Union countries are scrambling to raise $1.5 billion in emergency funding to supply Ukraine with at least 800.000 artillery shells from abroad, found by the Czech Republic. https://www.ft.com/content/428fdef6-57e8-4aeb-b7f6-9845fcc045f9 [no paywall: https://archive.is/j384N]
Footage of Ukrainian pilots and technicians training on the F-16 fighter jet in Denmark. https://x.com/NOELreports/status/1760954839901630468
“It’s no secret how the 7th Brigade, working closely with the wider air force as well as with Ukraine’s foreign allies, has managed to survive and even grow despite being one of Russia’s top targets.” https://www.forbes.com/sites/davidaxe/2024/02/22/its-official-despite-losses-ukraines-sole-bomber-brigade-is-bigger-now-than-it-was-before-the-war/