Links for 2024-06-11

AI:

1. Self-Tuning: Instructing LLMs to Effectively Acquire New Knowledge through Self-Teaching https://arxiv.org/abs/2406.06326

2. SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals — The proposed approach adaptively breaks down a high-level goal into a tree structure of practical subgoals during interaction with the environment. https://arxiv.org/abs/2406.04784

3. Husky: A Unified, Open-Source Language Agent for Multi-Step Reasoning — “Despite using 7B models, Husky matches or even exceeds frontier LMs such as GPT-4 on these tasks, showcasing the efficacy of our holistic approach in addressing complex reasoning problems.” https://arxiv.org/abs/2406.06469

4. “You can now build AI Web Agents that outperform Gemini and ChatGPT in information retrieval and share them with your community in less than 10 lines of code!” https://github.com/lavague-ai/LaVague

5. The Apple Intelligence announcement: “We're quickly heading into a world where you can open up your phone and just say stuff. It talks back and it knows you. And it just works.” https://x.com/karpathy/status/1800242310116262150

6. NVIDIA’s CEO, Jensen Huang, gives his AI predictions. — “All the factories will be robotic,” Huang said. “The factories will orchestrate robots, and those robots will be building products that are robotic.” https://qz.com/ai-next-wave-robots-nvidia-jensen-huang-blackwell-rubin-1851515953

7. Microsoft presents VALL-E 2: Achieves human parity zero-shot TTS performance for the first time https://arxiv.org/abs/2406.05370

8. “We reproduce the GPT-2 (124M) from scratch. This video covers the whole process: First we build the GPT-2 network, then we optimize its training to be really fast, then we set up the training run following the GPT-2 and GPT-3 paper and their hyperparameters…” https://www.youtube.com/watch?v=l8pRSuU81PU

9. The entire GPT architecture was recreated in a spreadsheet. https://github.com/dabochen/spreadsheet-is-all-you-need

10. GPT in 60 Lines of NumPy https://jaykmody.com/blog/gpt-from-scratch/

11. “So my current estimate is 3-5 years for AGI.” https://nonint.com/2024/06/03/general-intelligence-2024/

https://x.com/Austen/status/1800361179879252253

Neuroscience

1. “Many neurons exhibit “mixed selectivity,” meaning they can integrate multiple inputs and participate in multiple computations. Mechanisms such as oscillations and neuromodulators recruit their participation and tune them to focus on the relevant information.” https://picower.mit.edu/news/how-brain-flexible-enough-complex-world-without-being-thrown-chaos

2. Many children struggle to learn math—but it’s not well understood why. A new study finds links between brain structure, genes, and individual differences in mathematical abilities and predicts learning outcomes in two math tutoring cohorts. https://scim.ag/7gr

3. Effective cryopreservation of human brain tissue and neural organoids https://www.cell.com/cell-reports-methods/fulltext/S2667-2375(24)00121-8

Miscellaneous:

1. University of Houston lab reports breakthrough in cancer-detecting technology https://houston.innovationmap.com/cellchorus-university-of-houston-nature-cancer-2668463472.html

The faces are the same color: https://www.psy.ritsumei.ac.jp/akitaoka/saishin72e.html

Politics:

1. “Any system that is not explicitly pro-Weird Nerd will turn anti-Weird Nerd pretty quickly.” https://www.writingruxandrabio.com/p/the-weird-nerd-comes-with-trade-offs

2. The U.S. military plans a ‘Hellscape’ to deter China from attacking Taiwan https://www.washingtonpost.com/opinions/2024/06/10/taiwan-china-hellscape-military-plan/ [no paywall: https://archive.is/pQyM6]

Ukraine:

1. Destroyed Russian Pantsir-S1 air defense system. As said destroyed by HIMARS strike yesterday https://x.com/GloOouD/status/1800571149945843793

2. A Ukrainian UAV SHARK reconnaisance drone records a Russian BUK-M2 air defense system. Ukrainian SSO units destroyed it with an American Switchblade kamikaze drone https://x.com/bayraktar_1love/status/1800545332989960481

https://x.com/AndrewPerpetua/status/1800449085029097686