Links for 2024-03-18
AI:
VideoAgent: Long-form Video Understanding with Large Language Model as Agent https://arxiv.org/abs/2403.10517
Apple is ‘active’ talks to bring Gemini to the iPhone, and has also considered using ChatGPT. https://www.theverge.com/2024/3/18/24104626/apple-license-google-gemini-generative-ai-openai-chatgpt
Language models scale reliably with over-training and on downstream tasks https://arxiv.org/abs/2403.08540
This tiny swimming robot can think for itself https://www.science.org/content/article/tiny-swimming-robot-can-think-itself [archived version: https://archive.is/4A72t]
“What we learned in 6 months of working on a CodeGen dev tool GPT Pilot” https://blog.pythagora.ai/2024/02/19/gpt-pilot-what-did-we-learn-in-6-months-of-working-on-a-codegen-pair-programmer/
How much can LLM capabilities improve after pre-training via (a) finetuning/RLHF, (b) tools, (c) scaffolding/prompting? Finetuning (a) has a surprisingly large impact! https://metr.github.io/autonomy-evals-guide/elicitation-gap/
Technology:
How Ultrasound Became Ultra Small: With MEMS technology, all you need is one probe and a smartphone https://spectrum.ieee.org/mems-ultrasound-history
Using Fiber Optic Bundles to Miniaturize Vision-Based Tactile Sensors https://arxiv.org/abs/2403.05500
Psychology:
Banning the purchase of sex increases cases of rape. — “This paper leverages the timing of a ban on the purchase of sex to assess its impact on rape offenses. Relying on Swedish high-frequency data from 1997 to 2014, I find that the ban increases the number of rapes by around 44–62%.” https://link.springer.com/article/10.1007/s00148-024-00984-2
Creativity involves the subjective valuation of ideas via the Brain Valuation System. https://www.biorxiv.org/content/10.1101/2024.03.07.583926v1
“What if we lost our smartest 5%? How we treat and cultivate our most brilliant minds determines the majority of a nation’s successes and failures.” https://www.aporiamagazine.com/p/what-if-we-lost-our-smartest-5
Miscellaneous:
Moral Decision-Making Under Uncertainty https://plato.stanford.edu/entries/moral-decision-uncertainty/
Politics:
Analysis of the use of drones on a modern battlefield—that is, Ukraine—and the inability of the US Air Force to react to this change. https://warontherocks.com/2024/03/drones-the-air-littoral-and-the-looming-irrelevance-of-the-u-s-air-force/