Links for 2023-05-28
Impressive: GPT-4 Out-performs RL Algorithms by Studying Papers and Reasoning https://arxiv.org/abs/2305.15486 (apparently this was already known in 2012(!!!) but forgotten/ignored: http://people.csail.mit.edu/branavan/papers/acl2012.pdf)
We are on the cusp of a remarkable transformation in the way humans explore outer space—potentially the biggest change in spaceflight since the Soviet Union launched the Sputnik satellite in 1957. https://arstechnica.com/space/2023/05/at-long-last-the-glorious-future-we-were-promised-in-space-is-on-the-way/
“ImageBind brings machines one step closer to the human ability to bind together information from many different senses. It's the first AI model capable of binding data from six modalities at once.” https://ai.facebook.com/blog/imagebind-six-modalities-binding-ai/
AI is moving so fast, fintech startups are having to quickly pivot. [New York Times] https://archive.is/hBywW
Overview of LangChain — Motto: Building applications with LLMs through composability https://medium.com/technology-hits/overview-of-langchain-9f6362707cd0
RWKV: Reinventing RNNs for the Transformer Era https://arxiv.org/abs/2305.13048
Automatic Prompt Optimization with "Gradient Descent" and Beam Search https://arxiv.org/abs/2305.03495
Bayes is guaranteed to overfit, for any model, any prior, and every data point https://www.yulingyao.com/blog/2023/overfit/
Metalenses are finally moving into consumers’ hands — Future metalens applications will take advantage of the technology’s ability to detect polarized light. https://spectrum.ieee.org/metalens-2660294513
Noise is a secret destroyer of productivity. https://twitter.com/emollick/status/1660093233181933568
Standardized exams measure intrinsic ability, not racial or socioeconomic privilege https://milkyeggs.com/society/standardized-exams-measure-intrinsic-ability-not-racial-or-socioeconomic-privilege/
“…a large and robust negative relationship between length of Muslim rule and literacy” https://marginalrevolution.com/marginalrevolution/2023/05/islam-and-human-capital-in-historical-spain.html
If you go into an adversarial environment with the prior that it's inductive, you are the free energy.
The average man's opinions are much less foolish than they would be if he thought for himself.
— Bertrand Russell