Links for 2024-04-09
AI:
AutoCodeRover: An autonomous software engineer from Singapore. It can resolve 67 GitHub issues in less than ten minutes each with minimal LLM costs (~$0.5), whereas human developers spend more than 2.77 days on average. https://github.com/nus-apr/auto-code-rover
Claude 3 Opus generates arguments that don't statistically differ in persuasiveness compared to arguments written by humans. There is a clear scaling trend across model generations: each successive model generation is rated to be more persuasive than the previous. https://www.anthropic.com/news/measuring-model-persuasiveness
“Trained entirely in simulation, ViPlanner can be applied to real-world scenes in a zero-shot manner. Moreover, our experimental results demonstrate resistance to noise and a significant decrease in terms of traversability costs compared to purely geometric approaches.” https://www.youtube.com/watch?v=8KO4NoDw6CM
Social Skill Training with Large Language Models https://arxiv.org/abs/2404.04204
“We consistently find that, far from exhibiting "zero-shot" generalization, multimodal models require exponentially more data to achieve linear improvements in downstream "zero-shot" performance, following a sample inefficient log-linear scaling trend.” https://arxiv.org/abs/2404.04125
LLaMA Now Goes Faster on CPUs: “…between 30% and 500% faster when using F16 and Q8_0 weights on CPU.” https://justine.lol/matmul/
“Have you ever wanted to train LLMs in pure C without 245MB of PyTorch and 107MB of cPython? No? Well now you can! With llm.c” https://github.com/karpathy/llm.c
Mind and brain:
New paper marshals evidence that unique human abilities (compared to animals) result only from quantitative increases in information processing ability (not specialized adaptations for language or Theory of Mind etc). They relate improved info processing to scaling up the brain and prefrontal cortex ("scale is all you need"). https://www.nature.com/articles/s44159-024-00283-3
Deja-you, the recursive construction of self https://www.vectorsofmind.com/p/deja-you-the-recursive-construction
Technology:
KAIST researchers developed a novel ultra-low power memory for neuromorphic computing https://www.kaist.ac.kr/newsen/html/news/?mode=V&mng_no=36090&skey=mayorlab&sval=Emerging+Nano+Technology+and+Integrated+Systems&list_s_date=&list_e_date=&GotoPage=1
Revolutionizing Photonics: Researchers Achieve Unprecedented Upconversion Efficiency https://www.science.nus.edu.sg/blog/2024/02/22/photon-upconversion-steering-light-with-supercritical-coupling/
Google's new JPEG image encoder offers higher quality and saves on size and bandwidth https://opensource.googleblog.com/2024/04/introducing-jpegli-new-jpeg-coding-library.html
Ukraine:
Ukraine is developing artificially intelligent drones that will be harder for Russia to shoot down. The push to create an image recognition targeting system, which can autonomously hunt and strike targets, is backed by more than £200 million in Western finance from a UK-led drone coalition. https://www.telegraph.co.uk/world-news/2024/04/08/ukraine-developing-unstoppable-ai-powered-attack-drone/ [no paywall: https://archive.is/EfSvc]
“The remarkably high number of russian officer casualties in Ukraine is indicative of a significant overall toll.” https://x.com/ArturRehi/status/1777334028875555233
“ACHILLES unit within the 92nd assault brigade, destroyed Russian equipment on the approaches of Chasiv Yar. Among the losses are 5 BMD-2's, 4 BMP-2's, 1 DesertCross buggy and Russian personnel.” https://x.com/NOELreports/status/1777595258584346675
The Security Service of Ukraine (SBU) destroyed a batch of Russian air defense systems by loitering munition https://x.com/GloOouD/status/1777694340011147534