Links for 2024-01-31
AI:
SliceGPT: Compress Large Language Models by Deleting Rows and Columns — “SliceGPT can remove up to 25% of the model parameters (including embeddings) for LLAMA2-70B, OPT 66B and Phi-2 models while maintaining 99%, 99% and 90% zero-shot task performance…Our sliced models run on fewer GPUs and run faster without any additional code optimization…” https://arxiv.org/abs/2401.15024
Apple presents Rephrasing the Web: A Recipe for Compute and Data-Efficient Language Modeling https://arxiv.org/abs/2401.16380
Adept presents Fuyu-Heavy: A new multimodal model designed specifically for digital agents. World’s third-most-capable multimodal model, behind only GPT4-V and Gemini Ultra, which are 10-20 times larger. In particular, it outperforms Gemini Pro at both MMLU and MMMU. https://adept.ai/blog/adept-fuyu-heavy
Programming light propagation creates highly efficient neural networks https://spie.org/news/programming-light-propagation-creates-highly-efficient-neural-networks
Miscellaneous:
“The all-important meta-skills are not only left undeveloped by textbook problems, they’re actively sabotaged and undermined. This is why so many people who got straight As in school never amount to anything.” https://www.thepsmiths.com/p/review-the-education-of-cyrus-by
Seaweed as a Resilient Food Solution After a Nuclear War https://agupubs.onlinelibrary.wiley.com/doi/full/10.1029/2023EF003710
“How can we detect future pandemics? Sequencing wastewater could be promising: It allows us to monitor millions of people’s disease status at a single site. But this might require a LOT of sequencing and thus a lot of $. We estimated how much.” https://www.medrxiv.org/content/10.1101/2023.12.22.23300450v2
Mind Viruses: In Defense of An Analogy https://www.aporiamagazine.com/p/mind-viruses
Politics:
The Biden administration is putting billions into semiconductor manufacturing, targeting companies like Intel and TSMC to boost U.S. chip production. https://www.cnbc.com/2024/01/27/us-to-reportedly-announce-billions-of-dollars-in-subsidies-for-advanced-chips.html
"One of the great sins of developed civilizations is how little value we place on young people’s time. … learning that we warehouse young people in the prime of their lives … to little benefit to themselves or others, should provoke seething rage." https://www.richardhanania.com/p/critical-age-theory
The finding that students have poorer mental health while in school has been replicated in Sweden. https://www.aeaweb.org/articles?id=10.1257/pol.20220699
Ukraine:
New US-made longer-range bomb expected to arrive as soon as Wednesday in Ukraine https://www.politico.com/news/2024/01/30/new-us-made-longer-range-bomb-expected-to-arrive-as-soon-wednesday-in-ukraine-00138566
"Keeping the arms flowing will put Ukraine in a stronger position if an opportunity for serious negotiations emerges...For the United States to walk away from the conflict at this crucial moment and cut off support to Ukraine would be an own goal of historic proportions." https://www.foreignaffairs.com/united-states/cia-spycraft-and-statecraft-william-burns [https://archive.is/Gmuzh]
EU must defend Ukraine even if US reduces military support, Macron says https://www.theguardian.com/world/2024/jan/30/eu-defend-ukraine-if-us-reduces-military-support-emmanuel-macron-says
What air combat looks like in 2024. https://twitter.com/wartranslated/status/1752452692008472884
“Kropyva, the Ukrainian artillery battlefield management system, allows Ukrainian networked batteries to open counter-battery fire in 30 s, and has proved highly effective throughout the war” https://twitter.com/ChungTzuW/status/1752412571968356712
A report published in December by ISW said Ukraine and its partners were “executing a realistic plan to create a sustainable basis for Ukraine to be able to defend itself over the long term, with dramatically reduced foreign military assistance.” https://abcnews.go.com/International/secretive-ukrainian-arms-production-threat-russia-manufacturer/story?id=106707984
Meanwhile in Russia: experts on Vladimir Solovyov's show conceded that Russia may lose the war — unless the U.S. undermines itself first. https://youtu.be/CDfxzkMPR38
“Last night explosions occurred in Sankt Petersburg, which could be heard across the whole city.” https://twitter.com/Tendar/status/1752600152005611671 (see also: https://twitter.com/Tendar/status/1752619969215422849)
What Russia looked like at the peak of its strength: The Russian army enters the village of Khotin in the Sumy region on February 24, 2022. https://twitter.com/TheDeadDistrict/status/1752360088436625720