Links for 2022-12-06
Become a Proficient Player with Limited Data through Watching Pure Videos: Achieves SotA perf on 1 hour (50k steps) Atari and defeats EfficientZero by pretraining on action-free videos and using a two-phase training pipeline. https://openreview.net/forum?id=Sy-o2N0hF4f
“We can outperform prior multimodal models (like DALL-E, Flamingo, CM3) in both text-to-image and image-to-text generation, while using only <30% of training cost!” https://threadreaderapp.com/thread/1598431430283231233.html
“How can Transformers and other nets implement general-purpose learning algorithms in-context? Training on 2^14 tasks leads to strong generalization. Diff. to scaling laws, the memory size matters more than parameter count!” http://louiskirsch.com/gpicl
We need permitting reform for geothermal power https://www.slowboring.com/p/we-need-permitting-reform-for-geothermal
Combined Arms Breach Op: “This visualization was developed for the Maneuver Center of Excellence and is closely based upon the National Training Center Breach and Assault exercise executed circa 1990. This visualization demonstrates viable TTPs as discussed in ATTP 3-90-4 for the conduct of the combined arms breach against a hypothetical enemy.” https://www.youtube.com/watch?v=ZZ-sCT_maAQ
Network-crashing leap seconds to be abandoned by 2035, for at least a century https://arstechnica.com/science/2022/11/network-crashing-leap-seconds-to-be-abandoned-by-2035-for-at-least-a-century/
Tonga volcano sea floor map reveals 'mind-blowing' cavity left behind by eruption https://www.abc.net.au/news/2022-11-21/sea-floor-map-reveals-huge-cavity-left-behind-by-tonga-volcano/101674708
Flynn and anti-Flynn effects: Intelligence is rising in less developed countries, but stagnating or declining slowly in most prosperous countries. https://sciencedirect.com/science/article/abs/pii/S0160289622000897
"Both for genetic and non-genetic reasons, we believe that racial and ethnic groups should not be assumed to be equivalent, either in terms of disease risk or drug response." https://www.ncbi.nlm.nih.gov/pmc/articles/PMC139378/
A team of Cornell University researchers created the Notate interface to translate handwriting and sketches into computer code. https://news.cornell.edu/stories/2022/11/programming-tool-turns-handwriting-computer-code
Honduras to Suspend Some Constitutional Rights to Fight Gang Violence https://www.voanews.com/a/honduras-to-suspend-some-constitutional-rights-to-fight-gang-violence-/6861472.html
Completing Edward Teller's "Atom Alphabet" with ChatGPT https://www.reddit.com/r/unsong/comments/zckyg0/completing_edward_tellers_atom_alphabet_with/
"I gave ChatGPT the 117 question, eight dimensional PolitiScales test" https://www.reddit.com/r/ControlProblem/comments/zcsrgn/i_gave_chatgpt_the_117_question_eight_dimensional/ (see also: Applying Political Typology Quizes to a state-of-the-art AI Language model https://davidrozado.substack.com/p/the-political-orientation-of-the)
Ukraine attacks Engels-2 and Dyagilevo airbases deep within Russia proper believed to be responsible for attacking Ukrainian infrastructure. Several strategic bombers were damaged. [New York Times] https://archive.ph/vmfk6 (today Kursk airport in Russia was attacked as well: https://twitter.com/AricToler/status/1600002444670312448)
Prerequisites to understand the above:
1. Mesa-Optimizers https://astralcodexten.substack.com/p/deceptively-aligned-mesa-optimizers
2. Prompt injection attacks https://www.schneier.com/blog/archives/2022/09/prompt-injection-extraction-attacks-against-ai-systems.html
3. Slaughterbots https://en.wikipedia.org/wiki/Slaughterbots
4. Value drift https://www.lesswrong.com/posts/Kbm6QnJv9dgWsPHQP/schelling-fences-on-slippery-slopes
5. Large language models (LLMs) https://www.nvidia.com/en-us/deep-learning-ai/solutions/large-language-models/
Tweet: https://twitter.com/davidad/status/1598691073051672576
Related: