Links for 2023-04-24
Software²: A new generation of AIs that become increasingly general by producing their own training data https://thegradient.pub/software2-a-new-generation-of-ais-that-become-increasingly-general-by-producing-their-own-training-data/
Ask-Anything, tool for chatting about video with chatGPT, miniGPT4 and StableLM https://github.com/OpenGVLab/Ask-Anything
Learning to Program with Natural Language https://arxiv.org/abs/2304.10464
“Just this month, Chrome announced WebGPU's release. What does this mean? Near-native GPU speeds, from the web! I took the opportunity to build WebGPT: a package to run GPT models entirely on the browser.” https://twitter.com/willdepue/status/1649147091573432321
The Vector Grounding Problem: "...certain LLMs, particularly those fine-tuned with Reinforcement Learning from Human Feedback (RLHF), possess the necessary features to overcome the Vector Grounding Problem, as they stand in the requisite causal-historical relations to the world that underpin intrinsic meaning. We also argue that, perhaps unexpectedly, multimodality and embodiment are neither necessary nor sufficient conditions for referential grounding in artificial systems." https://arxiv.org/abs/2304.01481
RECLIP: Resource-efficient CLIP by Training with Small Images -- Achieves highly competitive zero-shot classification and imagetext retrieval accuracy with 6 to 8x less computational resources and 7 to 9x fewer FLOPs than the baseline. https://arxiv.org/abs/2304.06028
“Bark is a transformer-based text-to-audio model created by Suno. Bark can generate highly realistic, multilingual speech as well as other audio - including music, background noise and simple sound effects. The model can also produce nonverbal communications like laughing, sighing and crying.” https://github.com/suno-ai/bark
Efficient shallow learning as an alternative to deep learning https://www.nature.com/articles/s41598-023-32559-8
Nuclear power plants produce a low value product - commodity electricity. What if they produced high value aircraft fuel instead? https://austinvernon.site/blog/nuclearseparation.html
Furby source code https://archive.org/details/furby-source/page/n154/mode/1up
Near infrared, in situ imaging of chips: An inexpensive method to see inside certain types of integrated circuits. https://www.bunniestudios.com/blog/?p=6712
“I'm fascinated by the Inuit-Yupik-Unangan languages in Alaska, Canada and Greenland. There are many of these languages: they ring much of the Arctic Ocean. I just learned that they use a base 20 system for numbers, with a 'sub-base' of 5. That is, quantities are counted in scores (twenties) with intermediate numerals for 5, 10, and 15. This makes a lot of sense if you look at your fingers and toes.” https://mathstodon.xyz/@johncarlosbaez/110215432175491555
“Lisa Cook, FED board nominee, wrote a paper in 2014. It is lauded in this @paulmromer post, on Planet Money, and listed prominently on her Wikipedia. But the paper is completely flawed, and should have not even been published.” https://twitter.com/jonatanpallesen/status/1490248140389330944