Links for 2024-09-29
AI:
“We trained a Looped Transformer that dynamically adjusts the number of iterations based on input difficulty—and it achieves near-perfect length generalization on various tasks!” https://sites.google.com/wisc.edu/looped-transformers-for-lengen/home
Discovering the Gems in Early Layers: Accelerating Long-Context LLMs with 1000x Input Token Reduction https://arxiv.org/abs/2409.17422
Anthropic reduced the error rate of RAGs by 67% https://www.anthropic.com/news/contextual-retrieval
Logic-of-Thought: Injecting Logic into Contexts for Full Reasoning in Large Language Models https://arxiv.org/abs/2409.17539
Mining Causality: AI-Assisted Search for Instrumental Variables https://arxiv.org/abs/2409.14202
LLaVA-3D: A Simple yet Effective Pathway to Empowering LMMs with 3D-awareness https://arxiv.org/abs/2409.18125
Fast Real-time Object Detection with High-Res Output https://github.com/SanshruthR/CCTV_YOLO
Diffusion-style annealing + sampling-based MPC can surpass RL, and seamlessly adapt to task parameters, all training-free! https://lecar-lab.github.io/dial-mpc/
Robot See Robot Do: Imitating Articulated Object Manipulation with Monocular 4D Reconstruction https://arxiv.org/abs/2409.18121
Investing FLOPs in data refinement actually helps SAVING computing FLOPs. https://arxiv.org/abs/2409.17115
“Llama 3.2 features 11B & 90B models, our first multimodal Llama models with support for vision tasks. These models can take in both image and text prompts to deeply understand and reason on inputs.” https://ai.meta.com/blog/llama-3-2-connect-2024-vision-edge-mobile-devices/
A pilot project in universal algebra to explore new ways to collaborate and use machine assistance? https://terrytao.wordpress.com/2024/09/25/a-pilot-project-in-universal-algebra-to-explore-new-ways-to-collaborate-and-use-machine-assistance/
XTX Markets announces plans for $2m progress prize for Artificial Intelligence Mathematical Olympiad https://aimoprize.com/updates/2024-09-23-second-progress-prize
The NYT got ahold of docs from the OpenAI funding round: 350 million people used Chat in August; huge user growth after anon Login; 10 mill active subscribers; sub going up to $2 by the end of the year, the sub will scale up to $44 by 2029; projected yearly rev by 2029: $100B https://www.nytimes.com/2024/09/27/technology/openai-chatgpt-investors-funding.html [no paywall: https://archive.is/lBj1Y]
Sam Altman told Nate Silver that recursively self-improving AI is so scary that OpenAI isn't working on it. https://www.lesswrong.com/posts/4oCh3x6EPHomEbcDJ/nikola-s-shortform#NiDr3gnLLmkjEqKGk
Bill Gates says AI is "the first technology that has no limit" and it will do both white and blue collar jobs in the next decade, raising the question of whether we can trust government to respond fast enough https://www.youtube.com/watch?v=DD4F5it7a5M
AI startups making money faster than equivalent highest-grossing SaaS companies: “We’re seeing lots of [AI] companies going from zero to tens of millions of dollars [in revenue] in a couple of years,” https://www.ft.com/content/a9a192e3-bfbc-461e-a4f3-112e63d0bb33 [no paywall: https://archive.is/vGpDS]
Emad Mostaque says compute will be the currency of the future and the foundation of the post-labor economic system as those with more compute to run AI agents outcompete those who do not https://youtu.be/VdoRV-odfiU?si=-_29xeaAW9oSiKCe&t=1757
Why is o1 so deceptive? https://www.lesswrong.com/posts/3Auq76LFtBA4Jp5M8/why-is-o1-so-deceptive
(Bio)Technology:
“Stem cells reverse woman’s diabetes — a world first. A 25-year-old woman with type 1 diabetes started producing her own insulin less than three months after receiving a transplant of reprogrammed stem cells.” https://www.nature.com/articles/d41586-024-03129-3
Axon-mimicking Materials for Computing https://engineering.tamu.edu/news/2024/09/axon-mimicking-materials-for-computing.html
An Ultrathin Graphene Brain Implant Was Just Tested in a Person https://www.manchester.ac.uk/about/news/inbrain-neuroelectronics-announces-worlds-first-human-graphene-based-brain-computer-interface-procedure/
Companies like Google have enough servers that extremely rare silent computational errors become an issue. https://research.google/pubs/cores-that-dont-count/
Beyond Displays: Liquid Crystals in Motion Mimic Biological Systems https://blog.seas.upenn.edu/beyond-displays-liquid-crystals-in-motion-mimic-biological-systems/
Miscellaneous:
The weight of evidence suggests genes matter far more than family environment. https://www.aporiamagazine.com/p/a-response-to-sasha-gusev-on-iq
Possible Cluster of Human Bird-Flu Infections Expands in Missouri https://www.nytimes.com/2024/09/27/health/bird-flu-cluster-missouri.html [no paywall: https://archive.is/ZhiiO]
Israel:
How Israeli spies penetrated Hizbollah https://www.ft.com/content/6638813e-e246-4409-9a38-95bf60a220a8 [no paywall: https://archive.is/rdIgu]
Ukraine:
Videos from Ukraine's 77th Airmobile Brigade (and National Guard's Bureviy Brigade) and 92nd Assault Brigade's Achilles Battalion showing strikes on large-scale Russian armored assaults on the Kupiansk front. https://x.com/moklasen/status/1839733723853664347
Russians ride along a supply road, with lots of destroyed Russian equipment, on the eastern front. Of which 2xTrucks; 1xBMP-2; 1xBTR-80; 2xBTR-82 are previously undocumented losses. https://x.com/bayraktar_1love/status/1840009127847715162
“Interesting footage of a Leopard 2 tank towing a T-72 from the battlefield in the Kursk region. The German-made tank receives a hit and the turret catches fire, but the automatic external fire fighting system suppresses the fire and enables the tank to complete the evacuation.” https://x.com/Tendar/status/1840370042971582526
Kursk: "One month later the situation changed a lot. The amount of Russian forces increased to 35 000 soldiers and, approximately, 90-100 tanks. A lot of forces were moved from Kramatorsk, Vovchansk and Oskil directions. Mostly elite forces." https://x.com/OSINTua/status/1840056547574976589
“In short, the problem isn’t a lack of willing Ukrainians, recruitment numbers are up, but rather a bizarre management decision on top” https://x.com/Tatarigami_UA/status/1839544994069405840
Orbán Aide Says Hungary Would Have Surrendered to Russian Invasion [These are the new “patriots” who like to boo those who fight for their freedom and the survival of their nation. Their thinking revolves around appeasing the enemy and surrendering. They cannot comprehend those who are willing to sacrifice everything to defend what they hold dear.] https://www.newsweek.com/viktor-orban-director-ukraine-military-surrender-hungary-anti-soviet-uprising-1959805 (See also: “Hungary’s leaders aren’t cozying up to Moscow, Beijing and Tehran in private. They’re doing it publicly and vocally as well.” https://x.com/daniel_freund/status/1839592934649241738)
Meanwhile in Russia: emboldened by Trump's rhetoric, state TV's experts urge Moscow not to stop at Ukraine and target Poland next. They fondly reminisce about taking Bialystok in 1939, when the Soviet Union attacked Poland in alliance with Nazi Germany. https://www.youtube.com/watch?v=a8fBbsjmqO8
Video of a Russian Shahed UAV striking a hospital in Sumy today. According to local officials, 10 people were killed and 22 injured today in Sumy from Russian strikes. https://x.com/RALee85/status/1840197082373665140
The Patrol Police have released a video of yesterday's Russian strike on a hospital in Sumy. https://x.com/wartranslated/status/1840332855559262261
Footage of the destruction of Toretsk. https://x.com/RALee85/status/1840194692194910449
Zelensky stated in an interview that Donald Trump 'is on Ukraine's side' and will support Ukraine if he becomes the U.S. president again. Zelensky emphasized that he received clear confirmation of this from Trump directly. https://www.foxnews.com/video/6362606133112
Moscow: Do you think Trump will stop the war? https://www.youtube.com/watch?v=_Ex4YSGcYuE