Links for 2024-04-11
AI:
Wu's Method can Boost Symbolic AI to Rival Silver Medalists and AlphaGeometry to Outperform Gold Medalists at IMO Geometry — “…by combining AlphaGeometry with Wu's method we set a new state-of-the-art for automated theorem proving on IMO-AG-30, solving 27 out of 30 problems, the first AI method which outperforms an IMO gold medalist.” https://arxiv.org/abs/2404.06405
Google presents Leave No Context Behind: Efficient Infinite Context Transformers with Infini-attention: “We demonstrate the effectiveness of our approach on long-context language modeling benchmarks, 1M sequence length passkey context block retrieval and 500K length book summarization tasks with 1B and 8B LLMs.” https://arxiv.org/abs/2404.07143
Is robotics about to have its own ChatGPT moment? — “Thanks to cheap hardware like Stretch, along with efforts to collect and share data and advances in generative AI, robots are getting more competent and helpful faster than ever before. “We’re at a point where we’re very close to getting capability that is really going to be useful,” Goldberg says.” https://www.technologyreview.com/2024/04/11/1090718/household-robots-ai-data-robotics/ [no paywall: https://web.archive.org/web/20240411093526/https://www.technologyreview.com/2024/04/11/1090718/household-robots-ai-data-robotics/]
MA-LMM: Memory-Augmented Large Multimodal Model for Long-Term Video Understanding https://boheumd.github.io/MA-LMM/
“Principal Singular values and Singular vectors Adaptation (PiSSA), which optimizes a significantly reduced parameter space while achieving or surpassing the performance of full-parameter fine-tuning.” https://arxiv.org/abs/2404.02948
“Diffison-RWKV achieves performance on par with or surpasses existing CNN or Transformer-based diffusion models in FID and IS metrics while significantly reducing total computation FLOP usage.” https://arxiv.org/abs/2404.04478
Neural operators and their ability to accelerate simulations and design https://rdcu.be/dD8BI [Nature Reviews Physics] Author summary: https://x.com/AnimaAnandkumar/status/1777433421880680756
A neural speech decoding framework leveraging deep learning and speech synthesis https://www.nature.com/articles/s42256-024-00824-8
Miscellaneous:
More about the XZ hack: “If it hadn’t been discovered, it probably would have eventually ended up on every computer and server on the internet…The ways the code evades detection in source form, how it lies dormant and undetectable until activated, and its immense power and flexibility give credence to the widely held assumption that a major nation-state is behind this.” https://www.schneier.com/blog/archives/2024/04/backdoor-in-xz-utils-that-almost-happened.html
On the nature of men and strategic self-deception: “Men will fake signals of long-term commitment to achieve their short-term mating goals: “I’ve never felt this way before!” But women are astute at detecting men’s bullshit. In turn, it would benefit men to hack this firewall.” https://x.com/Lucidly_Elias/status/1777538807652368484
Ukraine:
US General Cavoli: “Russia is reconstituting [its] force far faster than our initial estimates suggested. The army is actually now larger – by 15 percent – than it was when it invaded Ukraine. Over the past year, Russia increased its front line troop strength from 360,000 to 470,000. Regardless of the outcome of the war in Ukraine, Russia will be larger, more lethal, and angrier with the West than when it invaded. As of March 2024, the DPRK provided Russia with roughly 6,700 containers that could contain up to three million artillery shells. Iran has provided Russia with drones, artillery, and missiles that have enhanced Russia’s lethality in Ukraine.” [PDF] https://armedservices.house.gov/sites/republicans.armedservices.house.gov/files/USEUCOM%20GEN%20Cavoli%20CPS_HASC_2024.pdf
Ukraine will be outgunned by Russia 10 to 1 in weeks without US help, top Europe general says https://apnews.com/article/ukraine-russia-war-ammunition-military-b263dfaceef57fb2c1f74c53861734da
Russia fired over 80 missiles and drones at Ukraine overnight, primarily targeting critical civilian infrastructure. The Ukrainians energy company Centerenergo reports that the Trypilska Thermal Power Plant has been completely destroyed. The Tripilska Thermal Power Plant was the largest supplier of electricity to the Kyiv, Cherkasy, and Zhytomyr regions. Kharkiv, which is being pounded almost daily, was hit by 10 drones/missiles; more than 200,000 homes without power. https://x.com/Tendar/status/1778341445490856122
“Putin goes out of his way to hide losses from the Russian population. 20 vehicles attempted to break Ukrainian lines in Chasiv Yar but were obliterated over 5 hours. It's now a graveyard for Russian occupiers.” https://x.com/wartranslated/status/1778106359617069360
“Between 10 December and 10 April (4 months) Russia lost between 102 and 107 vehicles to advance 5km in the direction of Terny.” https://x.com/GeoConfirmed/status/1778071808840769692
“In the past three days alone: 16 tanks, *39* IFVs lost for Russia. Just an incredible pace of losses.” https://x.com/NeilPHauer/status/1778119646983475312
“In the last 4 days, Andrew has recorded some form of filmed damage/loss to 6 Russian SAM systems, 32 artillery systems, 40 tanks, 51 IFVs, 14 APCs, 52 trucks, 10 UTVs, 43x cars (mostly bukhankas), 9 EW systems, 2 comms systems, 2 engineering vehicles, and 1 boat.” https://x.com/Osinttechnical/status/1778253053637861717
“Robotyne, in a possible sign of growing equipment shortages, Russian forces attempted an assault on Ukrainian positions using a pair of lightly up-armored Ural-4320 transport trucks to cross open ground.” https://x.com/Osinttechnical/status/1778449016071622958
Ukraine’s parliament passes a controversial law to boost much-needed conscripts as war drags on https://apnews.com/article/ukraine-parliament-recruit-army-russia-war-5b7d9f58bb398b4ad1296311b8130b92