Links for 2023-10-16
“Welcome to the natural number game -- a part-book part-game which shows the power of induction.” https://www.ma.imperial.ac.uk/~buzzard/xena/natural_number_game/
A great new paper from Meta on a prompting technique to reduce hallucinations https://arxiv.org/abs/2309.11495
LLark: A Multimodal Foundation Model for Music https://arxiv.org/abs/2310.07160
Yann LeCun: Open source AI models will soon become unbeatable. Period. https://twitter.com/ylecun/status/1713304307519369704
Training an unbeatable AI in Trackmania https://www.youtube.com/watch?v=Dw3BZ6O_8LY
Bioprinted Skin Heals Wounds in Pigs With Minimal Scarring—Humans Are Next https://singularityhub.com/2023/10/09/bioprinted-skin-heals-wounds-in-pigs-with-minimal-scarring-humans-are-next/
Generalized Biomolecular Modeling and Design with RoseTTAFold All-Atom https://www.biorxiv.org/content/10.1101/2023.10.09.561603v1
Monkey survives for two years after gene-edited pig-kidney transplant https://www.nature.com/articles/d41586-023-03176-2
The future is passwordless https://blog.google/inside-google/googlers/ask-a-techspert/how-passkeys-work/
Is GPT just a stochastic parrot?
Ilya Sutskever: https://twitter.com/thealexker/status/1713368556618887670
To compress information really well, what the neural network learns is some representation of the process that produced the text. This text is a projection of the world...what the neural network is learning is aspects of the world...
See also:
1. “No, LLM's aren't mere stochastic parrots: Llama-2 contains a detailed model of the world, quite literally! We even discover a "longitude neuron".” — Max Tegmark https://arxiv.org/abs/2310.02207
2. "Reminder: *In principle*, minimizing prediction loss on Internet text could potentially grind *far* past human-level intelligence. Proof: Somewhere on the Net is a list of <hash, plaintext> pairs, in that order." https://twitter.com/ESYudkowsky/status/1615400125760950278
Ukraine links:
Avdiivka is becoming a graveyard. The fields are littered with Russian corpses: “While everyone was watching Gaza the Russians decided to attack Avdiivka (again) with multiple brigade sized elements and hundreds of armoured vehicles (again) without learning any lessons whatsoever (again) and took a tremendous L (again)” https://twitter.com/GloOouD/status/1713578448990404956
“Relatives of the mobilised men from Tatarstan are puzzled as to why the battalion was placed on the zero line in Svatove direction, and not in defence as promised, and is taking "colossal casualties" as a result.” https://twitter.com/wartranslated/status/1713484829356884433
SSO units found out about a Russian ZALA command post and destroyed it with HIMARS. https://twitter.com/RALee85/status/1713778824087851372
India Chief of Defence Staff Gen Anil Chauhan: "The geopolitical importance of Russia will go down in the times to come. It is in spite of it being a major nuclear power. The Wagner rebellion indicates the internal weakness and is indicative of what may lie in store for the future as far as Russia is concerned," https://twitter.com/ANI/status/1713075438497759653
Subscribe to Axis of Ordinary
Links and stuff