Links for 2023-04-25
A new transformer architecture with 2 million 🚀 tokens (cf. GPT-4: 32K): https://arxiv.org/abs/2304.11062
This is large enough to fit a codebase into memory or a book series and ask it to write the next one.
Read more: https://twitter.com/hrishioa/status/1650356537771315202
Criticism and clarification:
Greg Brockman ChatGPT talk, mostly on plug-ins. https://www.ted.com/talks/greg_brockman_the_inside_story_of_chatgpt_s_astonishing_potential/
Using advanced generative AI and a massive dataset of Earth images, it’s possible to discover objects almost anywhere in just hours. https://www.defenseone.com/technology/2023/04/chatgpt-satellite-photos-already-exists/385305/
Anything-3D: Towards Single-view Anything Reconstruction in the Wild https://arxiv.org/abs/2304.10261
“For five-digit addition, tokenizing each digit separately results in 60% accuracy after finetuning, while regular tokenization results in 0% accuracy.” https://arxiv.org/abs/2304.10977
Linking Chips With Light For Faster AI — IEEE Spectrum's semiconductor expert Samuel K. Moore and the race to put fiber optics inside computers https://spectrum.ieee.org/photonics-and-ai
UW Off-road Autonomous Driving - All Terrain, All Weather | DARPA-funded Research https://www.youtube.com/watch?v=zGkgSrajcHw
Quadrupeds are good enough now that there are multiple viable use cases for them. https://www.youtube.com/watch?v=gvzljfK-PiU
An example of LLM prompting for programming https://martinfowler.com/articles/2023-chatgpt-xu-hao.html
The UK gov announced a £100 million taskforce to build the country's "sovereign" AI capabilities. https://www.gov.uk/government/news/initial-100-million-for-expert-taskforce-to-help-uk-build-and-adopt-next-generation-of-safe-ai
“How can you predict a high chance of imminent human extinction, if you can't even impress us with specific predictions of events between now and doom?” https://twitter.com/liron/status/1646301141196742656
“Global GDP is not exponential: it's superexponential” https://www.reddit.com/r/slatestarcodex/comments/12lf3pm/comment/jg7m4bj/
A neuromorphic bionic eye with filter-free color vision using hemispherical perovskite nanowire array retina https://www.nature.com/articles/s41467-023-37581-y
An engineered skin bacterium, swabbed gently on the head of a mouse, can unleash a potent immune response against a distant tumor. https://twitter.com/mfgrp/status/1646585149457580037
Is some alcohol good for you? Maybe, probably https://kirkegaard.substack.com/p/is-some-alcohol-good-for-you
New map shows all 85,000 volcanoes on Venus: https://source.wustl.edu/2023/03/scientists-share-comprehensive-map-of-volcanoes-on-venus-all-85000-of-them/