Links for 2024-04-07
AI:
GPT can downplay its abilities and mimic young children in a developmentally realistic way, in terms of both language complexity and performance on theory-of-mind tasks. https://journals.plos.org/plosone/article?id=10.1371/journal.pone.0298522
Transfer learning proves LLMs aren't stochastic parrots https://www.youtube.com/shorts/fk53dTErUzU
GPTs will never reach AGI? “…in short - given enough training, a GPT will learn a "baby_agi()" function, within its weights. So, are we back!? No; there is a problem: baby_agi() is now disputing space and computation with a colossal sea of hardcoded, task-specific functions…Whenever you ask GPT-4 something, all these functions activate, and share computing resources with our baby_agi(), which is then cornered and limited to run in a Nokia 3310, with 1 KB of memory, and limited to 50 clock cycles.” https://x.com/VictorTaelin/status/1776271375814054257
Long-context LLMs Struggle with Long In-context Learning https://arxiv.org/abs/2404.02060
“Shog Hub, an online platform where you can browse and download AI models, source code, datasets, and research papers from the decentralized Shoggoth Network.” https://shog.ai/
A new method that empowers an on-device 2B model to outperform GPT-4 in both accuracy and latency https://arxiv.org/abs/2404.01744
Compute:
“OpenAI and other AI leaders think new leaps in machine intelligence will require new forms of computer hardware. One proposal involves connecting GPUs with light.” https://www.wired.com/story/build-a-better-ai-supercomputer-let-there-be-light/ [no paywall: https://archive.is/YAuMD]
Will Liquid Circuits Enable Brain-Imitating Computers? New microchips shuffle around ions like synapses in the human brain https://spectrum.ieee.org/neuromorphic-computing-liquid-memristor
Neuroscience:
Universal Brain-Computer Interface Lets People Play Games With Just Their Thoughts https://news.utexas.edu/2024/03/29/universal-brain-computer-interface-lets-people-play-games-with-just-their-thoughts/
Whole-Brain Big Data Processing Enables VR via Optogenetic Control https://www.photonics.com/Articles/Whole-Brain_Big_Data_Processing_Enables_VR_via/a69848
World's most powerful MRI machine captures first stunning brain scans https://newatlas.com/medical/powerful-mri-brain-scans-iseult/
92% accuracy of predicting sexual orientation from MRI data. https://academic.oup.com/cercor/article-abstract/33/7/4013/6698690
Miscellaneous:
Interview with Michael Elowitz on synthetic biology. https://press.asimov.com/resources/synthetic-origins
A Mathematician On Creativity, Art, Logic and Language. https://www.quantamagazine.org/a-mathematician-on-creativity-art-logic-and-language-20240313/
Ukraine:
Drone Technology in Ukraine - Automation, Lethality & The (Scary) Development Race https://www.youtube.com/watch?v=iJnuTtUFiWM
“Ukrainian jet #drones (possibly 4) over Shebekino, Russia near Belgorod. Note how fast this drone flies. Also note how it turns.” https://x.com/DanielR33187703/status/1777006885067280555
“Video from Ukraine’s 25th Airborne Brigade showing a Russian tank hitting a mine. The shortage of tanks and armored vehicles means that Russian units will often fit as many soldiers on these vehicles as possible during assaults.” https://x.com/RALee85/status/1776697660331766253 (another example: https://x.com/moklasen/status/1776699549517561948)
Even more Banzai charges: “A Russian BMP-1M tried to land troops in Berdychi, Avdiivka direction. An FPV hit the soldiers sitting on top after which the BMP-1M bogged down. The whole unit was eliminated not much later.” https://x.com/NOELreports/status/1776905319467167925
Vladimir Solovyov insisted that Ukraine cannot be allowed to exist, explained why Russia should not negotiate with the West and promised, "We will kill all of them." https://www.youtube.com/watch?v=TfGk1MDMyXc