Links for 2024-04-24
AI:
Achieving >97% on GSM8K: Deeply Understanding the Problems Makes LLMs Perfect Reasoners https://arxiv.org/abs/2404.14963
Meta AI with Vision on Ray-Ban Meta: “We’re rolling out Meta AI with Vision, so you can ask your glasses about what you’re seeing and get helpful information — completely hands-free.” https://about.fb.com/news/2024/04/new-ray-ban-meta-smart-glasses-styles-and-meta-ai-updates/ (Something along these lines could eventually become the killer applications for multimodal models. Get instant feedback on everything you see and hear. Maybe even automate small talk by having the AI clone your voice and respond while you use your VR/AR glasses to do something more interesting? 🤓)
WebLlama: Building agents that can browse the web by following instructions and talking to you https://github.com/McGill-NLP/webllama
A Survey on Self-Evolution of Large Language Models https://arxiv.org/abs/2404.14387
A neural network that makes neural networks https://learnandburn.ai/p/a-neural-network-that-makes-neural
AI “safety”:
Simple probes can catch sleeper agents: “In this post we present "defection probes": linear classifiers that use residual stream activations to predict when a sleeper agent trojan model will choose to "defect" and behave in accordance with a dangerous hidden goal.” https://www.lesswrong.com/posts/gknc6NWCNuTCe8ekp/simple-probes-can-catch-sleeper-agents-1
“Constitutional AI showed LMs can learn to follow constitutions by labeling their own outputs. But why can't we just tell a base model the principles of desired behavior and rely on it to act appropriately? Introducing SAMI: Self-Supervised Alignment with Mutual Information!” https://arxiv.org/abs/2404.14313
Compute:
AI Efficiency Breakthrough: How Sound Waves Are Revolutionizing Optical Neural Networks [PDF] https://mpl.mpg.de/fileadmin/user_upload/Pressemitteilungen/PM_Stiller_2024_Photonic_computation_with_sound_waves-eng.pdf
Skyrmions move at record speeds: a step towards the computing of the future. Anticipated as future bits in computer memory, these nanobubbles offer enhanced avenues for information processing in electronic devices. https://www.cnrs.fr/en/press/skyrmions-move-record-speeds-step-towards-computing-future
Implementing neural network based algorithms on smaller microcontrollers https://cpldcpu.wordpress.com/2024/04/24/implementing-neural-networks-on-the-10-cent-risc-v-mcu-without-multiplier/
Miscellaneous:
'Neutronic molecules': Study shows neutrons can bind to quantum dots https://phys.org/news/2024-04-neutronic-molecules-neutrons-quantum-dots.html
A new study finds brain size has steadily increased for people born after the 1930s: “This cross-sectional study found secular differences of larger cranial and brain volumes among individuals without dementia and history of stroke who were born during the decades spanning 1930 to 1970. Taken together with increases in IQ throughout the 20th century, these secular trends in [larger] brain volume may contribute to greater cognitive resilience.” https://health.ucdavis.edu/news/headlines/human-brains-are-getting-larger-that-may-be-good-news-for-dementia-risk/2024/03
Politics:
Ukraine:
A Ukrainian Brigade Disappeared, And A Russian Brigade Almost Broke Through: How The Battle For Ocheretyne Upended The War In Ukraine This Weekend — “A Russian breakthrough could have collapsed the entire Ukrainian line west of Avdiivka—and forced tens of thousands of Ukrainian troops and potentially hundreds of thousands of civilians to flee Donetsk Oblast…whatever went wrong with the 115th Mechanized Brigade appears to be somewhat systemic. It’s the second Ukrainian unit to collapse on the eastern front in just the last few weeks.” https://www.forbes.com/sites/davidaxe/2024/04/23/a-ukrainian-brigade-disappeared-and-a-russian-brigade-almost-broke-through-how-the-battle-for-ocheretyne-upended-the-war-in-ukraine-this-weekend/
DeepState: “The situation around the breakthrough near Ocheretyne has exposed a number of problems. Starting with the incompetence of some spokespersons who undermine the credibility of the military and political leadership by making statements that look extremely untrue against the backdrop of the enemy's visual presence in the centre of the village. Finally, they ignore a number of chronic problems in certain line formations of the Defence Forces, which are placed in responsible areas of the frontline. The commanders of the 115th Brigade is responsible for the collapse of defence in the entire area, causing significant losses in killed, wounded and missing soldiers. Ordinary soldiers should not be punished for the lack of organisation and cooperation in the brigade - they are already paying with their lives and health.” https://t.me/DeepStateUA/19309
“Overnight, Ukrainian drones hit an oil depot in the Smolensk region. Also in the Voronezh and Lipetsk regions, similar facilities were attacked.” https://x.com/NOELreports/status/1783001019699364146
“CNN reports the Biden Admin has informed Congress that they will provide "long-range" ATACMS to Ukraine. This would likely include the M39A1, M48, & M57. Doubtful that the newest M57E1s would be sent.” https://x.com/ColbyBadhwar/status/1782835293218845116
“Russian "blogger" describes the use of drones by Ukrainians from the words of a russian officer he knows. An interesting perspective.” https://x.com/wartranslated/status/1782809649982439618
“Krynky... left bank of the Kherson region. Or whatever is left of it. Ruins, nothing more.” https://x.com/NOELreports/status/1783094808262910457