Links for 2023-11-30
AI tool GNoME finds 2.2 million new crystals, including 380,000 stable materials that could power future technologies 💎 https://deepmind.google/discover/blog/millions-of-new-materials-discovered-with-deep-learning/
“We trained a small transformer (100M params) for basic arithmetic. W. the right training data it nails 12x12 digits multiplication w/o CoT (that's 10^24 possibilities, so no it's not memorization🤣).” https://arxiv.org/abs/2311.14737
ToolChain*: Efficient Action Space Navigation in Large Language Models with A* Search — Uses algorithms like A* to improve LLM answers, improving sota on both planning and reasoning tasks https://arxiv.org/abs/2310.13227
“Google DeepMind work creating agents that can mimic experts in goal-driven behaviour in real-time 3D environments. What sets their AI agent apart is its ability to learn from humans in real-time, adopting a third-person perspective. It mirrors the way we learn by observing others – quick and efficient!” [Note: The preprint was already published in March 2022] https://www.nature.com/articles/s41467-023-42875-2
Goodhart's law Example: Training Verifiers to Solve Math Word Problems https://www.lesswrong.com/posts/euwMMxwuBeS5QZkC4/goodheart-s-law-example-training-verifiers-to-solve-math
The Surprising Genius of Sewing Machines https://www.youtube.com/watch?v=RQYuyHNLPTQ
Nano-Sized Powerhouses: Ultrafast Laser Technology Miniaturized on Tiny Photonic Chips https://www.caltech.edu/about/news/ultrafast-lasers-on-ultra-tiny-chips
Antares is “building micro-sized nuclear reactors to provide power to remote off-grid locations,” with a vision of “abundant clean energy for all, from Earth to the asteroid belt” https://twitter.com/juliadewahl/status/1719448793027109114
FDA has agreed that Loyal’s first drug supports a reasonable expectation of large dog lifespan extension. https://loyalfordogs.com/posts/loyal-announces-historic-fda-milestone-for-large-dog-lifespan-extension-drug
In Continued Defense Of Effective Altruism https://www.astralcodexten.com/p/in-continued-defense-of-effective
In a sample of 259 extremely high IQ adolescents (from the top 0.01% of the population in intelligence), 37% had doctorates, 9% had patents, 39% had peer-reviewed publications, along with various other accomplishments. https://journals.sagepub.com/doi/abs/10.1177/0956797616644735