Links for 2024-08-31

AI:

1. Symbolic metaprogram search improves learning efficiency and explains rule learning in humans: “Here we show that symbolic search over the space of metaprograms—programs that revise programs—dramatically improves learning efficiency. On a behavioral benchmark of 100 algorithmically rich rules, this approach fits human learning more accurately than alternative models while also using orders of magnitude less search.” https://www.nature.com/articles/s41467-024-50966-x

2. Learning integral operators via neural integral equations: “From physics to biology, and beyond, our approach addresses a critical gap in ML for nonlocal operators.” https://www.nature.com/articles/s42256-024-00886-8

3. How to build a lensless camera https://learnandburn.ai/p/how-to-build-a-lensless-camera

4. Introducing NEO Beta. Designed for humans. Built for the home. NEO Specs: 5 feet 5 inches tall — 30 kg weight; Walking speed 2.5 miles/hour (1.12 m/s) — Running speed 7.5 miles/hour (3.35 m/s); 44 lb (20 kg) carry capacity — 2-4 hours run-time. https://www.youtube.com/watch?v=bUrLuUxv9gE

5. Ask Claude: Amazon turns to Anthropic's AI for Alexa revamp https://www.reuters.com/technology/artificial-intelligence/amazon-turns-anthropics-claude-alexa-ai-revamp-2024-08-30/

6. Dell’s AI Server Business Now Bigger Than VMware Used To Be https://www.nextplatform.com/2024/08/30/dells-ai-server-business-now-bigger-than-vmware-used-to-be/

7. ReKep: Spatio-Temporal Reasoning of Relational Keypoint Constraints for Robotic Manipulation https://rekep-robot.github.io/

8. You Only Cache Once: Decoder-Decoder Architectures for Language Models — Substantially reduces GPU memory demands, yet retains global attention capability. https://arxiv.org/abs/2405.05254

9. Smaller, Weaker, Yet Better: Training LLM Reasoners via Compute-Optimal Sampling https://arxiv.org/abs/2408.16737

10. Microsoft Research introduces AutoGen Studio, a low-code interface for rapidly prototyping AI agents. https://microsoft.github.io/autogen/docs/autogen-studio/getting-started/

11. Human brain organoid bioprocessors now available to rent for $500 per month https://www.tomshardware.com/pc-components/cpus/human-brain-organoid-bioprocessors-now-available-to-rent-for-dollar500-per-month

12. Machine Learning Potentials: A Roadmap Toward Next-Generation Biomolecular Simulations https://www.arxiv.org/abs/2408.12625

13. AI for Bio: State Of The Field https://www.lesswrong.com/posts/CGegZveogJRGCK3LA/ai-for-bio-state-of-the-field

14. Principles for the AGI Race https://www.lesswrong.com/posts/aRciQsjgErCf5Y7D9/principles-for-the-agi-race

15. Anthropic CEO Dario Amodei says big, powerful AI models will spawn and orchestrate smaller models to assist with tasks, creating a swarm intelligence that will decrease the need for human input https://www.youtube.com/watch?v=7xij6SoCClI

16. Instead of using an LLM to solve a problem set, flip the table and ask the student to TEACH the LLM how to solve the problem set. https://www.youtube.com/watch?v=om7VpIK90vE

17. WavTokenizer: an Efficient Acoustic Discrete Codec Tokenizer for Audio Language Modeling https://arxiv.org/abs/2408.16532

By Eliezer Yudkowsky: https://x.com/ESYudkowsky/status/1829313872429515190

7 signs your daughter may be an LLM:

1. Does she have trouble multiplying numbers beyond 2-3 digits if she's not allowed to write out the steps?

2. If you ask her a question whose answer she doesn't know, does she sometimes make something up?

3. Is she incapable of matching the heights of human intellect, not able yet to independently advance the frontiers of science and technology without outside assistance?

4. If asked to draw a photorealistic image of a person, do the resulting anatomical proportions or fine details sometimes look off on a close inspection?

5. Does her code sometimes contain bugs?

6. Does she start to forget exact details of what she's already read after the first 10 million tokens?

7. Does she sometimes claim to be conscious?

Miscellaneous:

1. David Reich – How One Small Tribe Conquered the World 70,000 Years Ago — "Human history has been again and again a story of one group figuring ‘something’ out, and then basically wiping everyone else out." https://www.youtube.com/watch?v=Uj6skZIxPuI

2. “Climate Tipping Points are Real, Stop Denying It” https://www.youtube.com/watch?v=HiO3M_cPeSo

3. The Terrifying Power of Mathematics https://www.math.columbia.edu/~woit/wordpress/?p=14113

4. The Netherlands plans to limit ASML Holding NV’s ability to repair and maintain its semiconductor equipment in China, a potentially painful blow to Beijing’s efforts to develop a world-class chip industry. https://www.bloomberg.com/news/articles/2024-08-29/the-netherlands-to-put-more-curbs-on-asml-s-china-chip-business [no paywall: https://archive.is/J9Eqk]

Ukraine:

1. “Ukrainian firms are now producing hundreds of armed one-way attack drones a month, at a fraction of the cost it takes to produce a similar drone in the West…the strategy is already creating huge dilemmas for Moscow. He believes that with extra investment, it will turn the tide of the war in Ukraine’s favour.” https://www.bbc.com/news/articles/c6240qepyppo

2. “Every day, more and more videos of Russian reconnaissance drones being intercepted by FPVs are being published. The total number of published videos alone already exceeds several hundreds. It is also good that we see more high-altitude interceptions like here: Two interceptions of Russian Orlan drones at the altitudes of 2.6km and 2.3km.” https://x.com/bayraktar_1love/status/1829637258661507206

3. Ukraine is developing the SkyFall kamikaze drone with vertical takeoff and landing, designed to target armored vehicles and fortifications. The system includes a control station and 3-5 attack drones, which work in tandem with a reconnaissance drone for target detection and communication. SkyFall can strike targets 40-60 km away, using a 5 kg Ukrainian-made warhead, which can be either high-explosive or shaped charge. https://mil.in.ua/en/news/skyfall-kamikaze-drone-is-being-developed-in-ukraine/

4. Destroyed column of Russian equipment that was supposed to build a pontoon crossing over the Seym River near the village of Zvannoe, Kursk region. https://x.com/bayraktar_1love/status/1829757862924423264

5. A Russian soldier walks to a position on a road where literally dozens of his comrades' bodies are scattered - a true apocalypse! No one even attempts to collect and bury the bodies. https://t.me/ButusovPlus/13227

6. “Currently, it seems that our front in Donbas has collapsed. The defense of the Armed Forces of Ukraine is disorganized, the troops are tired, weakened, and many units are demoralized.” https://x.com/DefMon3/status/1829196136051036554

7. “The situation in Pokrovsk is indeed severe but far from hopeless. Ukrainian command has the resources needed for stabilization, though this will require difficult and potentially unpopular decisions.” https://x.com/Tatarigami_UA/status/1829263352146866580

8. “Yesterday, I wrote about how false reporting and systematic lying have become a major problem, leading to a completely distorted understanding of the situation at the top. Today, Ukrainian activist and one of the largest FPV drone suppliers, Sternenko, provided more details” https://x.com/Tatarigami_UA/status/1829177390964064590

9. "Boomerang after the circus with mobilization." We have little chance to stop them, for the first time I see such an advantage in personnel, - interview with a military man https://nv.ua/ukr/ukraine/events/pokrovsk-u-zsu-malo-shansiv-zupiniti-rosiyu-cherez-cirk-z-mobilizaciyeyu-boyec-novini-ukrajini-50445981.html

10. “We cannot allow Russian bombers to be better protected than Ukrainian civilians are. Let's ask ourselves if we are being honest about how much we actually support Ukraine.” https://x.com/GLandsbergis/status/1829114319151206905