Links for 2022-11-15
“…we find that human participants who interact with an unreliable large-language-model dialog assistant through chat -- a trivial baseline strategy for scalable oversight -- substantially outperform both the model alone and their own unaided performance.” https://arxiv.org/abs/2211.03540
“…we show three examples of prompted tasks with emergent performance: multi-step arithmetic, taking college-level exams, and identifying the intended meaning of a word. In each case, language models perform poorly with very little dependence on model size up to a threshold at which point their performance suddenly begins to excel…the emergence of new abilities as a function of model scale raises the question of whether further scaling will potentially endow even larger models with new emergent abilities.” https://ai.googleblog.com/2022/11/characterizing-emergent-phenomena-in.html
“While Paul was at OpenAI, they accidentally overoptimized a GPT policy against a positive sentiment reward model. This policy evidently learned that wedding parties were the most positive thing that words can describe, because whatever prompt it was given, the completion would inevitably end up describing a wedding party.” https://www.lesswrong.com/posts/t9svvNPNmFf5Qa3TA/mysteries-of-mode-collapse-due-to-rlhf
“Ultimately, what we’re doing when crafting a prompt is programming–but not the kind of programming we’re used to. The input is free form text, not a programming language as we know it. It’s natural language, or at least it’s supposed to be: there’s no formal grammar or syntax behind it.” https://www.oreilly.com/radar/formal-informal-languages/
Amazon’s New Robot Can Handle Most Items in the Everything Store [Wired] https://archive.ph/krJju
Do you need some unique music for your podcast or video? Soundraw is a music generator for creators. Select the type of music you want - genre, instruments, mood, length, etc - and let their AI generate beautiful songs and variants for you. https://soundraw.io/
Scientists Build Synthetic Molecular Machines That Can Read Data https://singularityhub.com/2022/11/07/scientists-build-synthetic-molecular-machines-that-can-read-data/
Student Infected With Debilitating Virus in Undisclosed Biolab Accident https://theintercept.com/2022/11/01/biosafety-lab-accident-chikungunya-virus/
Explaining Laser Weapons in Space Combat https://www.youtube.com/watch?v=DJWzvfnkwNQ