Links for 2023-11-12
“There is a paper by Google trending right now, that claims transformer in-context learning cannot generalize between two function classes...I have reproduced their experiment in a colab and come to a very different conclusion...” https://twitter.com/SamuelMullr/status/1722630954332946627
ChatGPT Continues to Be One of the Fastest-Growing Services Ever: “One hundred million people are using ChatGPT on a weekly basis, OpenAI CEO Sam Altman announced at its first-ever developer conference on Monday. Since releasing its ChatGPT and Whisper models via API in March, the company also now boasts over two million developers, including over 92 percent of Fortune 500 companies.” https://www.theverge.com/2023/11/6/23948386/chatgpt-active-user-count-openai-developer-conference
LLaVA-Plus: Large Language and Vision Assistants that Plug and Learn to Use Skills https://llava-vl.github.io/llava-plus/
CogVLM, a powerful open-source visual language foundation model that achieves SotA perf on 10 classic cross-modal benchmarks. https://arxiv.org/abs/2311.03079
OtterHD: A High-Resolution Multi-modality Model https://arxiv.org/abs/2311.04219
mPLUG-Owl2: Revolutionizing Multi-modal Large Language Model with Modality Collaboration https://arxiv.org/abs/2311.04257
GENOME: GenerativE Neuro-symbOlic visual reasoning by growing and reusing ModulEs https://arxiv.org/abs/2311.04901
Unveil ImageDream for 3D from a single image prompt. https://image-dream.github.io/
Consistent4D: Consistent 360° Dynamic Object Generation from Monocular Video https://consistent4d.github.io/
From connectome to effectome: learning the causal interaction map of the fly brain https://www.biorxiv.org/content/10.1101/2023.10.31.564922v1
“I'm super-proud of my PhD student Bhavik Mehta, who has formalized the remarkable breakthrough concerning diagonal Ramsey numbers…Thanks to this, the journal can forget about checking correctness and just decide whether the result is interesting enough, which is a no-brainer.” https://twitter.com/wtgowers/status/1721584389069410691
“First, we discovered that the mouse's visual system is globally organized to encode features in a manner invariant to the types of image transformations induced by self-motion.” https://www.biorxiv.org/content/10.1101/2023.11.03.565500v1
Genomic analysis finds that the skin color of the inhabitants of west Eurasia was almost entirely "dark" to "black" around 12,000 years ago. https://www.science.org/doi/10.1126/science.abq0755
A conversation between three people who, after spending hundreds of hours researching how many years will pass before transformative AI is built, ended up disagreeing significantly: https://www.lesswrong.com/posts/K2D45BNxnZjdpSX2j/ai-timelines
Generative AI is already taking white collar jobs: https://www.ft.com/content/b2928076-5c52-43e9-8872-08fda2aa2fcf [https://archive.is/qMJUg]
[W]ithin a few months of the launch of ChatGPT, copywriters and graphic designers on major online freelancing platforms saw a significant drop in the number of jobs they got, and even steeper declines in earnings.
Also: https://twitter.com/jburnmurdoch/status/1722938760185196800
Productivity shot up. And not only did AI-assisted consultants carry out tasks 25 per cent faster and complete 12 per cent more tasks overall, their work was assessed to be 40 per cent higher in quality than their unassisted peers.
Political links:
Ukraine is open to the possibility of attacking Russia’s oil and gas infrastructure if Moscow ramps up its targeting of Ukraine’s electric system this winter, Ukraine Energy Minister German Galushchenko said. https://www.politico.com/news/2023/11/10/ukraine-energy-russia-00126592
“This is one of the most ridiculously amazing feats I have ever seen from a drone pilot.” https://twitter.com/AndrewPerpetua/status/1723389362325402005
Very interesting: “QUICK THREAD on the Russian perceptions and analysis of weapons and systems that most influenced the course of war in Ukraine, and for other global conflicts going forward.” https://twitter.com/sambendett/status/1723369056714076552
The Royal Netherlands Air Force will operate dual-role F-35A jets that are able to draw from a shared NATO stockpile of B61-12 nuclear bombs. https://www.thedrive.com/the-war-zone/dutch-f-35s-gain-initial-certification-for-nuclear-strike-mission
Damn, the meat assaults continue unabated: 🔥RUSSIAN LOSSES | AVDIIVKA https://twitter.com/GloOouD/status/1723603640869343250