Links for 2024-06-11
AI:
Self-Tuning: Instructing LLMs to Effectively Acquire New Knowledge through Self-Teaching https://arxiv.org/abs/2406.06326
SelfGoal: Your Language Agents Already Know How to Achieve High-level Goals — The proposed approach adaptively breaks down a high-level goal into a tree structure of practical subgoals during interaction with the environment. https://arxiv.org/abs/2406.04784
Husky: A Unified, Open-Source Language Agent for Multi-Step Reasoning — “Despite using 7B models, Husky matches or even exceeds frontier LMs such as GPT-4 on these tasks, showcasing the efficacy of our holistic approach in addressing complex reasoning problems.” https://arxiv.org/abs/2406.06469
“You can now build AI Web Agents that outperform Gemini and ChatGPT in information retrieval and share them with your community in less than 10 lines of code!” https://github.com/lavague-ai/LaVague
The Apple Intelligence announcement: “We're quickly heading into a world where you can open up your phone and just say stuff. It talks back and it knows you. And it just works.” https://x.com/karpathy/status/1800242310116262150
NVIDIA’s CEO, Jensen Huang, gives his AI predictions. — “All the factories will be robotic,” Huang said. “The factories will orchestrate robots, and those robots will be building products that are robotic.” https://qz.com/ai-next-wave-robots-nvidia-jensen-huang-blackwell-rubin-1851515953
Microsoft presents VALL-E 2: Achieves human parity zero-shot TTS performance for the first time https://arxiv.org/abs/2406.05370
“We reproduce the GPT-2 (124M) from scratch. This video covers the whole process: First we build the GPT-2 network, then we optimize its training to be really fast, then we set up the training run following the GPT-2 and GPT-3 paper and their hyperparameters…” https://www.youtube.com/watch?v=l8pRSuU81PU
The entire GPT architecture was recreated in a spreadsheet. https://github.com/dabochen/spreadsheet-is-all-you-need
GPT in 60 Lines of NumPy https://jaykmody.com/blog/gpt-from-scratch/
“So my current estimate is 3-5 years for AGI.” https://nonint.com/2024/06/03/general-intelligence-2024/
Neuroscience
“Many neurons exhibit “mixed selectivity,” meaning they can integrate multiple inputs and participate in multiple computations. Mechanisms such as oscillations and neuromodulators recruit their participation and tune them to focus on the relevant information.” https://picower.mit.edu/news/how-brain-flexible-enough-complex-world-without-being-thrown-chaos
Many children struggle to learn math—but it’s not well understood why. A new study finds links between brain structure, genes, and individual differences in mathematical abilities and predicts learning outcomes in two math tutoring cohorts. https://scim.ag/7gr
Effective cryopreservation of human brain tissue and neural organoids https://www.cell.com/cell-reports-methods/fulltext/S2667-2375(24)00121-8
Miscellaneous:
University of Houston lab reports breakthrough in cancer-detecting technology https://houston.innovationmap.com/cellchorus-university-of-houston-nature-cancer-2668463472.html

Politics:
“Any system that is not explicitly pro-Weird Nerd will turn anti-Weird Nerd pretty quickly.” https://www.writingruxandrabio.com/p/the-weird-nerd-comes-with-trade-offs
The U.S. military plans a ‘Hellscape’ to deter China from attacking Taiwan https://www.washingtonpost.com/opinions/2024/06/10/taiwan-china-hellscape-military-plan/ [no paywall: https://archive.is/pQyM6]
Ukraine:
Destroyed Russian Pantsir-S1 air defense system. As said destroyed by HIMARS strike yesterday https://x.com/GloOouD/status/1800571149945843793
A Ukrainian UAV SHARK reconnaisance drone records a Russian BUK-M2 air defense system. Ukrainian SSO units destroyed it with an American Switchblade kamikaze drone https://x.com/bayraktar_1love/status/1800545332989960481



AI 12:
Austen Allred and his Bloom Tech academy is sus AF. Might wanna look more into him as that post of his is jank AF. He's basically advertising for his company.
https://www.reddit.com/r/codingbootcamp/comments/16szodm/bloomtech_in_2023/
https://news.ycombinator.com/item?id=40067939