Links for 2023-05-10
Optical neural networks hold promise for image processing https://news.cornell.edu/stories/2023/04/optical-neural-networks-hold-promise-image-processing
Language models can explain neurons in language models: “We applied GPT-4 to interpretability — automatically proposing explanations for GPT-2's 300k neurons — and found neurons responding to concepts like similes, “things done correctly,” or expressions of certainty. We aim to use Al to help us understand Al” https://openai.com/research/language-models-can-explain-neurons-in-language-models
“ImageBind learns a joint embedding across six different modalities - images, text, audio, depth, thermal, and IMU data. It enables novel emergent applications ‘out-of-the-box’ including cross-modal retrieval, composing modalities with arithmetic, cross-modal detection and generation” https://ai.facebook.com/blog/imagebind-six-modalities-binding-ai/
Self-Edit: Fault-Aware Code Editor for Code Generation. Improves the average of pass@1 by 89% on APPS-dev, 31% on APPS-test, and 48% on HumanEval over nine popular code generation LLMs with parameter sizes ranging from 110M to 175B. https://arxiv.org/abs/2305.04087
LLM cognition is probably not human-like https://www.lesswrong.com/posts/rjghymycfrMY2aRk5/llm-cognition-is-probably-not-human-like
Using Large Language Models to Simulate Multiple Humans and Replicate Human Subject Studies https://arxiv.org/abs/2208.10264
Can Large Language Models Transform Computational Social Science? https://arxiv.org/abs/2305.03514
“Some simple things that could be done to reform Earth science from its present disaster state” https://twitter.com/ESYudkowsky/status/1650555229304426496
“One of the most famous psychology experiments of all time, lost for 85 years because it was never formally published—because scientific publishing standards were already snafued—finally rediscovered!” https://gwern.net/maze
"South Korea spent more than $200 billion subsidizing child care and parental leave over the past 16 years, President Yoon Suk Yeol said last fall. Yet the fertility rate fell from 1.1 in 2006 to 0.81 in 2021." https://reason.com/2023/05/02/storks-dont-take-orders-from-the-state/
“Women and agreeable people undermine academia by promoting the value of emotional well-being as what universities should be doing with their money.” https://twitter.com/KirkegaardEmil/status/1653212985697902594
Oldest-ever DNA shows mastodons roamed Greenland 2 million years ago [Nature] https://archive.is/tyZ51
"Mark Zuckerberg took home gold and silver medals at his FIRST-EVER Jiu Jitsu tournament" https://twitter.com/BleacherReport/status/1655647393776279553 (video: https://twitter.com/bloodyelbow/status/1655625209519517696)
Before you say silly things like, "But AI is still bad at physical tasks," stop right there and read about the amazing advances being made in robotics literally every week.
A small selection:
https://ai.facebook.com/blog/robots-learning-video-simulation-artificial-visual-cortex-vc-1/
https://ai.googleblog.com/2023/04/towards-ml-enabled-cleaning-robots.html