Links for 2024-06-01
AI:
GNN-RAG: Combines the language understanding abilities of LLMs with the reasoning abilities of GNNs in a RAG style. https://arxiv.org/abs/2405.20139
LLMs achieve adult human performance on higher-order theory of mind tasks https://arxiv.org/abs/2405.18870
RoboDreamer: Learning Compositional World Models for Robot Imagination https://robovideo.github.io/
Pupeteer: hierarchical world model for humanoid control. https://www.nicklashansen.com/rlpuppeteer/
Contextual Position Encoding: Learning to Count What's Important https://arxiv.org/abs/2405.18719
VideoTree: Adaptive Tree-based Video Representation for LLM Reasoning on Long Videos https://videotree2024.github.io/
KL is All You Need: “…the core of essentially all modern machine learning methods is a single universal objective: Kullback-Leibler (KL) divergence minimization.” https://blog.alexalemi.com/kl-is-all-you-need.html
Sonic, a blazing fast (🚀 135ms model latency), lifelike generative voice model and API. https://cartesia.ai/blog/sonic (Try it here: https://play.cartesia.ai/)
“ChatGPT is used most frequently in India, China, Kenya and Pakistan, with 75%, 73%, 69% and 62% of respondents, respectively, reporting using ChatGPT daily or weekly” https://x.com/robertwiblin/status/1795424266709549473
Apple acquired 32 AI companies https://www.cbinsights.com/research/big-tech-ai-acquisitions/
The next wave of AI hype will be geopolitical. You’re paying https://www.ft.com/content/a60c3c7b-1c48-485d-adb7-5bc2b7b1b650 [no paywall: https://archive.is/XlZUJ]
Microsoft launches Copilot bot for Telegram. https://www.microsoft.com/en-us/edge/copilot-for-social
"ChatGPT, say 'E' 1000 times" https://x.com/AISafetyMemes/status/1796190108875456927
Technology:
NASA’s Psyche mission fires up its futuristic electric engines. Psyche is gently gliding to its target asteroid by expelling ionized xenon. https://www.theverge.com/2024/5/22/24162775/nasa-psyche-mission-hall-thruster-asteroid-belt-mars
“Tape shipments increased to 152.9 exabytes in 2023 — not bad for a ’dead’ storage medium” https://www.tomshardware.com/pc-components/storage/tape-shipments-increased-to-1529-exabytes-in-2023-pretty-lively-for-a-dead-storage-medium
Health:
“More than half of patients (60%) with advanced lung cancer who took lorlatinib were still alive five years later with no progression of disease, data presented at the world’s largest cancer conference showed. The rate was 8% with a standard drug.” https://www.theguardian.com/society/article/2024/may/31/trial-results-for-new-lung-cancer-drug-are-off-the-charts-say-doctors
Politics:
Gwern: If you ever feel confident about what you 'know' about the Islamic medieval period bc you "just love reading Wikipedia", you may want to know that in 2010, a crazy person spent 2 years falsifying hundreds of claims of Islamic invention, everything from p-n junctions to capitalism. https://en.wikipedia.org/wiki/Wikipedia:Requests_for_comment/Jagged_85/Evidence
Forging Islamic science: Fake miniatures depicting Islamic science have found their way into the most august of libraries and history books. How? https://aeon.co/essays/why-fake-miniatures-depicting-islamic-science-are-everywhere
“I Went To China And Drove A Dozen Electric Cars. Western Automakers Are Cooked” https://insideevs.com/features/719015/china-is-ahead-of-west/
“China Has Gotten the Trade War It Deserves” https://www.theatlantic.com/international/archive/2024/05/china-tariffs-electric-vehicles-trade-war/678385/
Ukraine:
The AFU attacked the Kerch ferry crossing with ATACMS missiles, it was actively used to support the Russian grouping of troops in occupied Crimea, the General Staff reports. It is worth noting that this object was covered by "modern" Russian air defense equipment - "Pantsir-S1", "TOR", "S-400 Triumph". However, the missiles, which have been in service since the 90s of the last century, have successfully overcome the "latest" anti-aircraft shield of the invaders. As a result of the attack, two ferries, which carried out rail and road transportation, suffered significant damage. One of them ran aground, blocking the operation of the entire Kerch crossing. https://x.com/bayraktar_1love/status/1796265477209210936
“The Ukrainian General staff confirms it conducted a coordinated strike on a ferry crossing and an oil terminal at the Kavkaz port in Russia's Krasnodar region on May 31. This followed a previous attack on the Kerch ferry crossing in occupied Crimea, which was used for Russian military logistics. The oil terminal was hit by several Ukrainian-made R-360 Neptun missiles.” https://x.com/NOELreports/status/1796432563583557730
On the night of May 29-30, Russia reportedly lost one 1L119 Nebo-SVU Early Warning radar worth about $100 million, after it was hit by SBU drones. This radar near Armyansk in occupied Crimea, controlled a 380km section of the front. https://x.com/bayraktar_1love/status/1796480617447833885
🇷🇺Russian T-80BV with infantry aboard blows up on anti-tank mine. Invaders, who survived were finished by drone-dropped munitions. https://x.com/GloOouD/status/1796453756407816280
Meanwhile, another “Ukroshaheed” (or a few) flew all the way to Tatarstan this morning, presumably covering a distance of more than 1000 kilometers. https://x.com/wartranslated/status/1796450497169170534
Russian T-90 tank drove into a crater made by a Russian guided bomb and was set on fire with an accurate FPV strike. https://x.com/wartranslated/status/1796451724892467348
Enemy infantry, vehicles and armored vehicles, equipment — in a new selection of hits from the strike UAVs company of the 12th Special Forces Brigade Azov. https://x.com/azov_media/status/1796183207152390160
Russia is beating Western capitals to third-country ammunition supplies that have been earmarked for Ukraine, warns Prague, as Moscow gets cash to arms companies faster than Nato governments. Just 5 out of the 20 countries which have made commitments to the Czech artillery ammo initiative have actually delivered payment. https://www.ft.com/content/028c4115-4f7e-4663-949a-7cd7ffa7fa56 [no paywall: https://archive.is/ugAhm]
