Links for 2023-12-21
Apple announces LLM in a flash: "running models up to twice the size of the available DRAM, with a 4-5x and 20-25x increase in inference speed" https://arxiv.org/abs/2312.11514
Apple announces ProTIP: Progressive Tool Retrieval Improves Planning https://arxiv.org/abs/2312.10332
Tracking Any Object Amodally https://tao-amodal.github.io/
Jack of All Tasks, Master of Many: Designing General-purpose Coarse-to-Fine Vision-Language Model https://arxiv.org/abs/2312.12423
A mathematical perspective on Transformers: “In this article we observe that Transformers are in fact flow maps on the space of probability measures over a d-dimensional real vector space. Transformers evolve a mean-field interacting particle system…” https://arxiv.org/abs/2312.10794
“The only thing that AdamW 'wants' is to tweak matrices in the direction of minimizing predictive loss on the training data. This doesn't mean that's what the AI being built wants.” https://twitter.com/ESYudkowsky/status/1737263658885853659
SwitchHead: Accelerating Transformers with Mixture-of-Experts Attention https://arxiv.org/abs/2312.07987
Invariant Graph Transformer https://arxiv.org/abs/2312.07859
Machine learning predicts hit songs from brain responses with 97% accuracy. https://www.frontiersin.org/articles/10.3389/frai.2023.1154663/full
Pakistan’s former prime minister is using an AI voice clone to campaign from prison https://www.theverge.com/2023/12/18/24006968/imran-khan-ai-pakistan-prime-minister-voice-clone-elevenlabs
“Record your own voice or use a sample recording. The AI model will use this to generate speech in the style of this reference vocal style.” https://audiobox.metademolab.com/capabilities
Understanding Quake’s Fast Inverse Square Root https://betterexplained.com/articles/understanding-quakes-fast-inverse-square-root/
Update on Chinese IQ-related gene panels: "I've been reaching out to past coworkers, and they agree with my assessment that a polygenic database for the purpose of embryo selection would be easy and mostly cheap to do." https://www.lesswrong.com/posts/Rh5piTGuimhnspkvL/update-on-chinese-iq-related-gene-panels
Political links:
The Cultural Power of Elite Immigrants: A Slaveowner, a Nazi, a Lutheran, a Jew, and a Forty-Eighter Walk Into a Voting Booth https://www.cremieux.xyz/p/the-cultural-power-of-high-skilled
Xi Jinping bluntly told President Joe Biden during their recent summit in San Francisco that Beijing will reunify Taiwan with mainland China but that the timing has not yet been decided, according to three current and former U.S. officials https://www.nbcnews.com/news/china/xi-warned-biden-summit-beijing-will-reunify-taiwan-china-rcna130087
British Foreign Secretary David Cameron said that France and Britain will support Ukraine in its fight against the Russian invasion “for as long as it takes.” https://apnews.com/article/france-uk-russia-ukraine-war-us-aid-fc0acc3aa9ce815a9081ebc351837490
Watch Zelenskyi speaking to the media, answering various types of questions: "The General Staff proposed mobilizing an additional 450-500 thousand people. Mobilization in this format will cost the state 500 billion hryvnia. I would like to see calculations from the Cabinet of Ministers regarding such measures. A comprehensive plan will be prepared by the military and submitted to the Verkhovna Rada for consideration," Zelenskyi. https://www.youtube.com/live/uf8eQ9Ud0_A
Bakhmut under Russian occupation now. https://twitter.com/IAPonomarenko/status/1737450372489195607