Links for 2023-03-27
GPT-4 can display rudimentary self-reflection on whether its generated outputs make sense. — “Permit me the handwavy speculation here, but a LLM performing recursive self-reflection of its self-reflections may be the first glimmers of a bicameral mind. Feels like self-awareness literally pulling itself up by its bootstraps.” https://evjang.com/2023/03/26/self-reflection.html
The easiest way to work with large language models | Learn LangChain in 10min https://www.youtube.com/watch?v=kmbS6FDQh7c
Synthetic Data for AI Outperform Real Data in Robot-Assisted Surgery https://hub.jhu.edu/2023/03/20/synthetic-data-outperform-real-data-robot-assisted-surgery/
"Ultimately, with responsible and thoughtful implementation, these models have the potential to be a valuable tool in surgical science and clinical care by augmenting, not replacing, human expertise." https://academic.oup.com/bjsopen/article/7/2/zrad032/7085520
The Quantization Model of Neural Scaling. Attempts to explain the sudden emergence of new capabilities with scale. https://arxiv.org/abs/2303.13506
Editing 3D Scenes with Instructions https://instruct-nerf2nerf.github.io/
"Meet in the Middle: A New Pre-training Paradigm" for large language models (LLM). Developing a bidirectional LLM using the full sequence information during pretraining and using context from both sides during inference. https://arxiv.org/abs/2303.07295
“Sentence and word embeddings are the bread and butter of language models. Here is a very simple introduction to what they are.” https://txt.cohere.ai/sentence-word-embeddings/
Inside The Infrastructure That Microsoft Builds To Run AI https://www.nextplatform.com/2023/03/21/inside-the-infrastructure-that-microsoft-builds-to-run-ai/
“Around the wide world, all cultures share a few key features. Anthropologists debate the precise extent, but the basics are always there. Language. Tools. Marriage. Family. Ritual. Music. And penis-stealing witches.” https://astralcodexten.substack.com/p/book-review-the-geography-of-madness
CDC Warns of Deadly Fungus Spreading at Alarming Rate in U.S. Healthcare Facilities https://scitechdaily.com/cdc-warns-of-deadly-fungus-spreading-at-alarming-rate-in-u-s-healthcare-facilities/
“When China suddenly scrapped zero-COVID in December, people were bewildered by the country's lack of preparation. Millions of elderly were unvaccinated, they hadn't stockpiled antivirals. Why? We set out to find the answer.” https://twitter.com/dakekang/status/1638097037441761281
Thread about China’s efforts to increase ramp space, hardened and regular aircraft shelters at its airbases from the 2010s to 20s (not 20s to 30s) with a satellite image of 20 hardened, camo’ed shelters at XiaPu 230km from Taiwan opposite the Strait https://twitter.com/tshugart3/status/1638995381236256768
It's time to end the speed limit in US airspace: "Some of the research was glorious ... In 1964, over a period of six months, the FAA dropped 1,253 sonic booms over OKC in a study known as, and I’m not joking here, Operation Bongo II. These were not baby booms. They were full-sized, unabated N-waves." https://www.elidourado.com/p/50-years-supersonic-ban