Links for 2023-03-11
Baldur: Whole-Proof Generation and Repair with Large Language Models — “This paper introduces a new method to automate formal verification: We use large language models, trained on natural language text and code and fine-tuned on proofs, to generate whole proofs for theorems at once, rather than one step at a time. We combine this proof generation model with a fine-tuned repair model to repair generated proofs, further increasing proving power. As its main contributions, this paper demonstrates for the first time that: (1) Whole-proof generation using transformers is possible and is as effective as search-based techniques without requiring costly search...Together, Baldur and Thor can prove 65.7% of the theorems fully automatically. This paper paves the way for new research into using large language models for automating formal verification.” https://arxiv.org/abs/2303.04910
“After 1.5 years of hard work, I am thrilled to share with you Φ-SO - a Physical Symbolic Optimization package that uses deep reinforcement learning to discover physical laws from data .” https://threadreaderapp.com/thread/1633645134934949888.html
Autonomous Aerial Defense: "Commercial, off the shelf drones continue to evolve in complexity and threaten military and civilian safety & disrupt operations. Anduril’s end-to-end cUAS system supports the entire kill chain in one, easy to use interface with precision, accuracy and reliability. Rogue drones are identified, tracked, and disabled in any environment, day or night." https://www.anduril.com/capability/counter-uas/
New in Nature Human Behavior, Meta AI researchers show how current language models differ from the human brain and highlight the role of long-range and hierarchical predictions. https://www.nature.com/articles/s41562-022-01516-2
Speeding up RL with LLMs reading instruction manuals. Requires 1000x less training frames than previous SoTA on hardest. https://arxiv.org/abs/2302.04449 (An AI Learned to Play Atari 6,000 Times Faster by Reading the Instructions https://singularityhub.com/2023/03/10/an-ai-learned-to-play-atari-6000-times-faster-by-reading-the-instructions/)
“Hey ChatGPT, give me a neat drum pattern!” https://twitter.com/naotokui_en/status/1632935345141714946
"AI tools like ChatGPT … anecdotal evidence has suggested that productivity improvements of 30%-80% are not uncommon across a wide variety of fields, from game design to HR." https://oneusefulthing.substack.com/p/secret-cyborgs-the-present-disruption
Learn the mathematical structure, not the conceptual structure: “What I learned was that QM is a game with rules. The rules are that the state of the system is given as an arrow, and that the dynamics of the arrow are given by a pretty straightforward linear differential equation, and that "measurements" were associated with linear operators (matrices), and the rules of measurement were that the state of the system would "collapse" to an eigenvector of the operator with probabilities given by dot products of the current state with the eigenvectors.” https://www.lesswrong.com/posts/Kir5oGHFDbN2M9gTf/learn-the-mathematical-structure-not-the-conceptual
Smaller, safer, cheaper? Modular nuclear plants could reshape coal country [Washington Post] https://archive.is/RcspV
Advanced Nuclear Power Could Transform U.S. Maritime Industry https://maritime-executive.com/editorials/advanced-nuclear-power-could-transform-u-s-maritime-industry
Scientists Discover How To Generate New Neurons in the Adult Brain https://scitechdaily.com/scientists-discover-how-to-generate-new-neurons-in-the-adult-brain/
China is in the midst of a quiet but stunning nationwide collapse of birthrates. [Washington Post] https://archive.is/3IGp3
Japan births fall to record low as population crisis deepens https://amp.cnn.com/cnn/2023/03/01/asia/japan-births-2022-record-low-intl-hnk/index.html
Ukraine is turning down hundreds of Afghan soldiers who want to join its war effort — “…a handful of Afghans did make it into the International Legion over the past year. She said the Office of the President told her their performance was mixed. Some allegedly treated Ukraine as a stopping point on the way to Europe, spoke poor English, or didn’t follow orders from commanders…But even the prospect of recruiting top soldiers with Americans ready to vouch for them hasn’t been enough to interest Ukrainian authorities…” https://www.semafor.com/article/03/08/2023/ukraine-is-turning-down-hundreds-of-afghan-soldiers-who-want-to-join-its-war-effort