Links for 2023-06-23
Self-aware 3D printers use AI to detect and correct errors https://www.nature.com/articles/s41467-022-31985-y
The discovery that only GPT-4 can self-improve, while weaker models cannot, is very intriguing, indicating a new type of **emergent ability** (i.e. to improve upon natural language feedback) may only exist when the model is "mature" (large and well-aligned) enough: 1. https://arxiv.org/abs//2306.09896 2. https://arxiv.org/abs/2305.10142
Full parameter fine-tuning of a 65B model on a single machine with 8xRTX 3090, each with 24GB memory. https://arxiv.org/abs/2306.09782
Recurrent Memory Decision Transformer https://arxiv.org/abs/2306.09459
"The lab leak theory of COVID-19's origins gained tremendous legitimacy this week as The Wall Street Journal confirmed independent reports that the earliest outbreak occurred at the Wuhan Institute of Virology in November 2019." https://reason.com/2023/06/21/lab-leak-theory-confirmed-ben-hu-wuhan-china-covid/
Stalin knew of both Manhattan project and ULTRA (decryption of Enigma) years before Truman https://twitter.com/shashj/status/1670132285595607041
“Recidivism goes up the more offences you have committed. In one study of Philadelphians, after the seventh crime, there was an 80% chance of a further conviction. These five percent of heavy repeat offenders committed >70% of rapes, robberies, and murders.” https://twitter.com/bswud/status/1670786720722239488
"Of more than 2,000 [Chinese] respondents, a mere 1% wanted their country to mount a military assault on Taiwan (not just on its outlying islands) before the island’s presidential election in January 2024." https://www.economist.com/china/2023/06/19/when-it-comes-to-a-war-with-taiwan-many-chinese-urge-caution [https://archive.is/tqHt6]
Elon Musk and Mark Zuckerberg agree to hold cage fight https://www.bbc.com/news/business-65981876