Links for 2023-10-06
“No, LLM's aren't mere stochastic parrots: Llama-2 contains a detailed model of the world, quite literally! We even discover a "longitude neuron".” — Max Tegmark https://arxiv.org/abs/2310.02207
Scientists regenerate neurons that restore walking in mice after paralysis from spinal cord injury https://www.uclahealth.org/news/scientists-regenerate-neurons-restore-walking-mice-after
Think before you speak: Training Language Models With Pause Tokens https://arxiv.org/abs/2310.02226
Can large language models provide useful feedback on research papers? A large-scale empirical analysis: >50% users found GPT-4 generated feedback helpful/very helpful and 82.4% found it more beneficial than feedback from at least some human reviewers https://arxiv.org/abs/2310.01783
Franco-German weapons maker KNDS began researching swarms of drones. Swarms make it possible to quickly deploy a large force at low cost and inflict significant damage on the enemy. https://twitter.com/NexterKNDS/status/1707438129223708755
Lee Cronin on how natural selection is rooted in physics. https://twitter.com/leecronin/status/1709613311879479349
How self-supervised learning of visual representations that are reusable for downstream Embodied AI tasks may be a unifying organizing principle to understand neural coding across multiple species and brain areas. https://cbmm.mit.edu/video/using-embodied-ai-help-answer%E2%80%9Dwhy%E2%80%9D-questions-systems-neuroscience
Why do we see motor signals in sensory areas of the brain? Control theory may have some answers. Internal feedback in the cortical perception–action loop enables fast and accurate behavior. https://www.pnas.org/doi/10.1073/pnas.2300445120
1000x More Precise: Breakthrough for Next Generation Atomic Clocks https://www.xfel.eu/news_and_events/news/index_eng.html?openDirectAnchor=2181&two_columns=0
“Bees generally can’t fly at night, they use the sun as a compass. Even if the sun is behind clouds, bees can infer it’s position using patterns of polarised light So they may sleep in flowers, many blossoms close up at night, creating a warm space” https://twitter.com/gunsnrosesgirl3/status/1707702795535569188
Adolescents get 237 notifications per day (median). 97% of them use their phones during the school day. https://www.nbcnews.com/health/health-news/teens-inundated-phone-prompts-day-night-research-finds-rcna108044
True. It will be literally breathtaking when the nanobots start converting the hemoglobin in your arteries into computronium.
Ukraine links:
The USA and the EU are working on legal procedures to transfer $300 billion of frozen Russian assets to Ukraine. https://www.state.gov/secretary-antony-j-blinken-during-a-conversation-at-the-university-of-texas-at-austin-moderated-by-former-u-s-ambassador-to-nato-kay-bailey-hutchison/
Incitement to war crimes and genocide on Russian TV https://www.youtube.com/playlist?list=PLLWQyEN3YRo7bpdyPlWscpvx2O8qSu0T1