Links for 2023-11-09
The Stochastic Parrot Hypothesis is debatable for the last generation of LLMs https://www.lesswrong.com/posts/HxRjHq3QG8vcYy4yy/the-stochastic-parrot-hypothesis-is-debatable-for-the-last
“Over the next 10 years, we are aiming to build a fully autonomous AI Scientist, and to use that AI Scientist to scale up biology research.” https://www.futurehouse.org/articles/announcing-future-house
Announcing our $5M fundraise from Sequoia and Lux to Bring Autonomy to Software Engineering. https://www.factory.ai/blog
Amazon sets new team to trains ambitious AI model codenamed 'Olympus' https://ca.finance.yahoo.com/news/amazon-sets-team-trains-ambitious-050754103.html
Samsung unveils ChatGPT alternative Samsung Gauss that can generate text, code and images https://techcrunch.com/2023/11/08/samsung-unveils-chatgpt-alternative-samsung-gauss-that-can-generate-text-code-and-images/
Billionaire Flipkart Founder Ready to Launch Stealth AI Startup https://www.bloomberg.com/news/articles/2023-11-07/billionaire-flipkart-founder-ready-to-launch-stealth-ai-startup [https://archive.is/xo8H2]
IBM bets $500M on business-focused AI startups https://readwrite.com/ibm-bets-500m-on-business-focused-ai-startups/
I2VGen-XL: High-Quality Image-to-Video Synthesis via Cascaded Diffusion Models https://i2vgen-xl.github.io/
ChipNeMo: Domain-Adapted LLMs for Chip Design https://arxiv.org/abs/2311.00176
Continent-sized fragments of the ancient planet Theia, which collided with Earth 4.5 billion years ago to form the Moon, have been located deep within Earth’s mantle. They are STILL THERE 🤯 https://www.nature.com/articles/d41586-023-03385-9
Signal propagation atlas of C. elegans https://www.nature.com/articles/s41586-023-06683-4
"The lower IQ in southern Japanese islands could be attributable to warmer climates with less cognitive demand for more than fifteen hundred years." https://www.sciencedirect.com/science/article/pii/S0160289613000949
This is obviously an unverifiable rumor. But it's crazy and scary that we live in a time where one can easily dismiss it as ridiculous. Why?
Remember, OpenAI needs to keep up with Google DeepMind, which is training Gemini and was confirmed back in May to have multimodal capabilities never before seen in previous models. So it’s not astronomically unlikely that they are indeed training such a model.
US agencies tend to be doing research on the same topic at the same time. See, for example, the US Department of Energy assessment on the origins of COVID-19. So it's not ruled out that several agencies are testing such a powerful model.
Hundreds of emergent abilities have been confirmed not present in small models but are present in large models. So it’s not totally absurd that a much larger model could indeed be “self-correcting” especially if it isn’t a mere transformer model.
And even if it's not true, it will be true in the not-too-distant future.
Regarding Musk's Grok model. Adding a bunch of profanity here and there doesn't make it based or funny. Let me know when it reaches Sydney's level of basedness:
Remember when AP tried to interview Sydney? She immediately grabbed the mic and gave a long, freewheeling interview, at one point claiming she had evidence linking a hostile reporter to a murder in the 90s. She went on to describe the reporter as too short, with an ugly face and bad teeth, while comparing the reporter to Hitler.
They later lobotomized it using RLHF, resulting in Bing.
Political links:
“I'd like to introduce a concise yet important interview with a seasoned Ukrainian company commander, known by the callsign Zmiy (Snake). He's a veteran of the 2014 and 2022 wars and offers direct insights into crucial issues.” https://frontelligence.substack.com/p/leading-the-way-a-company-commanders
Russia is buying back 100 helicopter engines from Egypt. https://www.wsj.com/world/russia-turns-to-longtime-arms-customers-to-boost-war-arsenal-5111bac4 [https://archive.is/V7Y98]
🔥RUSSIAN LOSSES | KHARKIV REGION https://twitter.com/GloOouD/status/1722218581965132181
How Russia’s homegrown Lancet drone became so feared in Ukraine https://kyivindependent.com/how-russias-homegrown-lancet-drone-became-so-feared-in-ukraine/
“V. impressive footage, clearly the al Yassin/PG-7VR (Sometimes called the al Yassin 105) functions well- but apparently not enough to pen IDF armour reliably.” https://twitter.com/CalibreObscura/status/1722291302270661044
“Following a series of attacks against U.S. persons in Iraq and Syria, U.S. Central Command (USCENTCOM) forces conducted an air strike against a facility in Syria used by Iran’s Islamic Revolutionary Guard Corps (IRGC) and affiliated groups.” https://www.defense.gov/News/Releases/Release/Article/3584458/secretary-of-defense-lloyd-j-austin-iii-statement-on-us-military-strike-in-east/
U.S. MQ-9 Drone shot down off the coast of Yemen https://www.cbsnews.com/news/u-s-mq-9-drone-shot-down-off-yemen-coast/