Links for 2023-11-22
Sam Altman to return as CEO of OpenAI https://www.bbc.com/news/business-67494165
Exponentially Faster Language Modelling: Language models only really need to use an exponential fraction of their neurons for individual inferences. https://arxiv.org/abs/2311.10770
Orca 2: Teaching Small Language Models How to Reason — “With Orca 2, we continue to show that improved training signals and methods can empower smaller language models to achieve enhanced reasoning abilities, which are typically found only in much larger language models” https://www.microsoft.com/en-us/research/blog/orca-2-teaching-small-language-models-how-to-reason/
“Claude 2.1 offers an 200K token context window, a 2x decrease in hallucination rates, system prompts, tool use, and updated pricing.” https://www.anthropic.com/index/claude-2-1 (see also this test: https://twitter.com/GregKamradt/status/1727018183608193393)
AI system sharply cuts the number of missed early stage breast cancers. https://www.ft.com/content/d3b462a3-8085-43d7-9e37-a78564907d2c [https://archive.is/83dpY] (paper: https://www.nature.com/articles/s41591-023-02625-9)
Oxford-led study shows how AI can detect antibiotic resistance in as little as 30 minutes https://www.ox.ac.uk/news/2023-11-21-oxford-led-study-shows-how-ai-can-detect-antibiotic-resistance-little-30-minutes
A new age in protein design empowered by deep learning https://www.cell.com/cell-systems/fulltext/S2405-4712(23)00298-3
“I’ve written a report about whether advanced AIs will fake alignment during training in order to get power – a behavior I call “scheming” (also sometimes called “deceptive alignment”). I think it's disturbingly plausible.” https://joecarlsmith.com/2023/11/15/new-report-scheming-ais-will-ais-fake-alignment-during-training-in-order-to-get-power
Scientists Join Forces to Focus on Trillion Parameters Models https://tpc.dev/2023/11/10/tpc-announced-with-founding-partners/
ChatGPT Has Been Turned Into A Social Media Surveillance Assistant https://www.forbes.com/sites/thomasbrewster/2023/11/16/chatgpt-becomes-a-social-media-spy-assistant/ [https://archive.is/vXSyR]
“ChatGPT Voice rolled out for all free users. Give it a try — totally changes the ChatGPT experience” https://twitter.com/OpenAI/status/1727065166188274145
A Milestone in Computing: 2D In-Memory Processor With Over 1000 Transistors https://actu.epfl.ch/news/redefining-energy-efficiency-in-data-processing/
How to Win an Interstellar War: Star-sized phased array lasers, relativistic antimatter-fuelled missiles and the Ultra Relativistic Electron Beam all make an appearance. https://youtu.be/tybKnGZRwcU
Army Counter Drone System Pops Out Of A Shipping Container https://www.thedrive.com/the-war-zone/army-counter-drone-system-pops-out-of-a-shipping-container
The ‘Hispanic Paradox’ intrigues a new generation of researchers determined to unravel it — “For 40 years, researchers have unsuccessfully tried to explain...the Hispanic Paradox, the finding that Hisp Americans live several years longer than white Americans on average” https://www.statnews.com/2023/09/14/hispanic-paradox-life-expectancy-research/ [https://archive.is/59INd]
"There is a rational number between any two irrational numbers and an irrational number between any two rational numbers, but the cardinality (number of elements) of the rationals (ℵ₀) is lower than the cardinality of the irrationals (2^ℵ₀)." https://twitter.com/fermatslibrary/status/1716430835056808230
Political links:
Fighting all around the Kurdyumivka, Andriivka, Klishchiivka has been incredibly intense, with constant ground assaults. The video shows a glimpse into what these assaults look like. https://twitter.com/Teoyaomiquu/status/1726754890360197218
Unfortunate situation for the Russian marines in Krynky. https://twitter.com/wartranslated/status/1726975493235429589
Sweden is now a textbook case study in the failure of mass migration: https://www.ft.com/content/79f0d181-bdae-4c81-a971-861ccd8d512c [https://archive.is/k1IYB]