Links for 2023-05-25
Meta Platforms Crafts Homegrown AI Inference Chip, AI Training Next https://www.nextplatform.com/2023/05/18/meta-platforms-crafts-homegrown-ai-inference-chip-ai-training-next/
The US Air Force Is Moving Fast on AI-Piloted Fighter Jets [Wired] https://archive.is/HWTNa
Anthropic secures $450M in Series C funding from Google, Salesforce and others https://venturebeat.com/ai/anthropic-secures-450m-in-series-c-funding-from-google-salesforce-and-others/
VC firm Sequoia is pulling out all the stops to dominate AI, insiders say. The firm is using everything from 'speed dating' to star studded summits to woo founders. [Business Insider] https://archive.is/QgHm8
Bob Carpenter says LLMs are intelligent: “You don’t plan out a route step by step then execute it…As you get to each part of the task (unlock the bike, carry the bike outside, put the kickstand up, get on the bike, etc.) are all easily cued by what you did last, so it barely requires any thought at all. ChatGPT does the same thing with language.” https://statmodeling.stat.columbia.edu/2023/05/24/bob-carpenter-says-llms-are-intelligent/
Purely Synthetic LLM Feedback Improves LLMs https://arxiv.org/abs/2305.13735
LIMA: Less Is More for Alignment — “…these results strongly suggest that almost all knowledge in large language models is learned during pretraining, and only limited instruction tuning data is necessary to teach models to produce high quality output.” https://arxiv.org/abs/2305.11206
“Can we guide LLMs to quote text from their pre-training data using prefixes like "According To ..", improving grounding and reducing hallucination? We discovered that LLMs do have this capability and can increase or decrease quoting on request” https://arxiv.org/abs/2305.13252
Multimodal Web Navigation with Instruction-Finetuned Foundation Models — Their 3B model outperforms the SoTA, PaLM-540B, on the WebShop benchmark. https://sites.google.com/view/mm-webnav/
What is the natural timescale for making a Dyson shell? https://aleph.se/andart2/space/what-is-the-natural-timescale-for-making-a-dyson-shell/
“How to Keep a Drone Alive: a thread. While the loss rate of UAVs in Ukraine - on both sides - is very high, it doesn’t have to be this way. Making UAVs survivable, however, comes with some trade-offs and support requirements.” https://twitter.com/Jack_Watling/status/1659856537169403906
The Journal of Individual Differences, which publishes research on differences in human intelligence and personality, has the highest replicability rate (an extraordinary 97%) in all of psychology. https://replicationindex.com/2022/01/26/rr21/
A prescient interview with John McCain from 2015: https://twitter.com/Den_2042/status/1661261771988975618
See also: Obama mocking Romney over his Russia opinion https://www.youtube.com/watch?v=T1409sXBleg
More people getting HBD-pilled: https://twitter.com/paulg/status/1660630231030300673
The special operation was launched for the sake of denazification and demilitarization…Through this denazification of Ukraine…we turned Ukraine into a nation that everyone everywhere knows about…like Greece and Rome at their height…Ukraine became a famous country literally everywhere. So much for denazification.
Now let's talk about demilitarization…if at the start of the special operation, they had roughly 500 tanks, they now have 5000. If they had 20,000 people that could fight, they now have 400,000. How have we demilitarized it? On the contrary, we've fucking militarized it!