Links for 2023-09-09
GPT Can Solve Mathematical Problems Without a Calculator: “With sufficient training data, a 2 billion-parameter language model can accurately perform multi-digit arithmetic operations with almost 100% accuracy without data leakage, significantly surpassing GPT-4 (whose multi-digit multiplication accuracy is only 4.3%). We also demonstrate that our MathGLM, fine-tuned from GLM-10B on a dataset with additional multi-step arithmetic operations and math problems described in text, achieves similar performance to GPT-4 on a 5,000-samples Chinese math problem test set.” https://arxiv.org/abs/2309.03241
Q-Transformer: A new RL approach that works at scale with large models and many tasks. https://q-transformer.github.io/
“$200M Series B at a $1B+ valuation to develop AI systems that reason! We believe reasoning is the main blocker to effective AI agents. We train large models tailor-made for reasoning on our ~10K GPU cluster. On top, we prototype agents we use every day.” https://twitter.com/kanjun/status/1699794157945208918
Gizmodo’s owner replaced its Spanish language journalists with AI https://www.theverge.com/2023/9/1/23856029/gizmodo-shuts-down-spanish-language-site-ai-translations
AI-powered tools for rappers, writers and wordsmiths. https://textfx.withgoogle.com/
Maccarone is an extension to VSCode that allows you to “delegate” blocks of Python code to AI (GPT-4). The portions of the code that are under AI control are automatically updated as needed when the surrounding code is changed. https://github.com/bsilverthorn/maccarone
Scientists discover spiral-shaped signals that organise brain activity https://www.sydney.edu.au/news-opinion/news/2023/06/16/scientists-discover-spiral-shaped-signals-that-organise-brain-activity.html
“Ingroup-outgroup biases aren't unique to humans; they're found in many vertebrates, and have similar neurobiological substrates across species. Individuals from out-groups present risks of pathogen exposure as well as being threats to resources, territory, and offspring. All of these threats function to promote in-group bias in humans and nonhumans. There are also striking similarities in the underlying neurobiological mechanisms mediating the responses to out-group threat and the expression of in-group bias.” https://www.journals.uchicago.edu/doi/10.1086/690838
"I knew not to try to quantify key aspects other than climate change in my research because it would dilute the story that prestigious journals like Nature and its rival, Science, want to tell." https://www.thefp.com/p/i-overhyped-climate-change-to-get-published
“With Azerbaijan building up troops on Armenia's borders and threatening a new war, Iran's IRGC releases a video highlighting Armenia's borders and showing Iranian forces targeting areas of Azerbaijani buildup” https://twitter.com/NeilPHauer/status/1700193321728008407 (Also remember that Azerbaijan imports the majority of its weapons from Israel and that the United States will hold joint military drills with Armenia. Making the situation even more complicated is that Turkey supports Azerbaijan. Meanwhile, Russia has no resources left to intervene on behalf of anyone.)
Ukraine links:
US likely to send long-range ATACMS missiles to Ukraine for the first time: Officials https://abcnews.go.com/Politics/us-send-long-range-atacms-missiles-ukraine-time/story?id=103031722
“It’s one of the most promising of a fleet of Ukraine’s long-range drones being developed. Super fast, long-range and with a really significant (classified) payload.” https://twitter.com/olliecarroll/status/1700200926747721730
“When I hear claims that the counter-offensive becomes impossible or very difficult after the summer ends, it's essential to remind: 2022 Kherson counter-offensive started on August 29th and concluded in November, resulting in the liberation of Kherson and the entire right bank.” https://twitter.com/Tatarigami_UA/status/1700162434575561160