Links for 2024-06-12

AI:

1. ARC Prize: a $1,000,000 competition to create an AI that can adapt to novelty and solve simple reasoning problems. https://arcprize.org/ (Interview: https://www.dwarkeshpatel.com/p/francois-chollet)

2. Matrix Multiplication-Free LLMs cuts memory usage by 10x, boosts training speed by 25.6% https://arxiv.org/abs/2406.02528 (posted previously, signal boosting)

3. ShiftAddLLM: Accelerating Pretrained LLMs via Post-Training Multiplication-Less Reparameterization — 80% memory and energy reductions over the original LLMs https://arxiv.org/abs/2406.05981

4. New algorithm discovers language just by watching videos https://news.mit.edu/2024/denseav-algorithm-discovers-language-just-watching-videos-0611

5. Google presents Improve Mathematical Reasoning in Language Models by Automated Process Supervision https://arxiv.org/abs/2406.06592

6. Autoregressive Model Beats Diffusion: Llama for Scalable Image Generation https://github.com/FoundationVision/LlamaGen

7. BERTs are Generative In-Context Learners https://arxiv.org/abs/2406.04823

8. RLHF heavily reduces LLM creativity and output variety. https://arxiv.org/abs/2406.05587

9. Google presents Towards a Personal Health Large Language Model: A version of Gemini fine-tuned for text understanding and reasoning over numerical time-series personal health data for applications in sleep and fitness https://arxiv.org/abs/2406.06474

10. How to Build an AI Data Center https://www.construction-physics.com/p/how-to-build-an-ai-data-center

11. Whisper can run real-time transcription locally on your browser https://huggingface.co/spaces/Xenova/realtime-whisper-webgpu

Biotechnology:

1. How personalized cancer vaccines could keep tumours from coming back https://www.nature.com/articles/d41586-024-01717-x

2. A startup engineering microbes for Mars https://www.pioneer-labs.org/

Miscellaneous:

1. African elephants address one another with individually specific name-like calls https://rdcu.be/dKsyl

Archaeology:

1. “By the late 3rd century AD, all essential elements for constructing a steam engine were known by Roman engineers: steam power (in Hero's aeolipile), the crank and connecting rod mechanism (in the Hierapolis sawmill), the cylinder and piston (in metal force pumps), non-return valves (in water pumps) and gearing (in water mills and clocks)” https://en.m.wikipedia.org/wiki/Ancient_Roman_technology

2. Nemi ships: “…the larger ship was an elaborate floating palace, which contained quantities of marble, mosaic floors, heating and plumbing, and amenities such as baths. Both ships featured technology thought to have been developed historically later.” https://en.m.wikipedia.org/wiki/Nemi_ships

Ukraine:

1. US will send Ukraine another Patriot missile system after Kyiv’s desperate calls for air defenses https://apnews.com/article/ukraine-russia-patriot-missile-systems-us-aid-62deb8e2c4653dfc27949f81bfa43255

2. Russians destroyed at least 3x Ukrainian 5P851A S-300PT-1A TELs, and a 5N63-1/5N66M Radar on a 40V6M Mast. https://x.com/WarVehicle/status/1800817995306147851

3. Hit on a Ukrainian Su-27 at Myrhorod Air Base https://x.com/NOELreports/status/1800825152785260618

4. Russian serviceman filming a Ukrainian FPV flying into their vehicle, with simultaneous drone footage provided by the 109th Territorial Defence Brigade, MURAMASA unit. https://x.com/wartranslated/status/1800861575735304200

5. Ukrainian children found on Russian adoption sites https://www.ft.com/content/2d0013d2-a407-449f-b1e2-3d14fe65188f [no paywall: https://archive.is/A4VaN]