Links for 2023-10-12
Fine-Tuning LLMs to Produce Agents https://arxiv.org/abs/2310.05915
Building general scientific foundation models https://polymathic-ai.org/
Breaking Through LLM Context Limits via Interactive Agent Reading https://arxiv.org/abs/2310.05029
DSPy: Compiling Declarative Language Model Calls into Self-Improving Pipelines https://arxiv.org/abs/2310.03714
How FaR Are Large Language Models From Agents with Theory-of-Mind? Boosts GPT-4’s performance from 50% to 71% on T4D, outperforming other prompting methods such as CoT and Self-Ask https://arxiv.org/abs/2310.03051
Fine-tuning ChatGPT: Surpassing GPT-4 Summarization Performance–A 63% Cost Reduction and 11x Speed Enhancement using Synthetic Data and LangSmith https://blog.langchain.dev/fine-tuning-chatgpt-surpassing-gpt-4-summarization/
Discovering General Reinforcement Learning Algorithms with Adversarial Environment Design https://arxiv.org/abs/2310.02782
Why Korea is Dying Out https://www.youtube.com/watch?v=LBudghsdByQ
By looking at the UK biobank researchers found that people with a greater number of damaged gene variants are more likely to be childless, with the effect much stronger in men than in women. https://www.biorxiv.org/content/10.1101/2020.05.26.116111v3.full
Is ACTION The Most Fundamental Property in Physics? https://www.youtube.com/watch?v=Q_CQDSlmboA
Israel links:
Hamas appears to have wiped out a detachment of ~20 Israeli Air Force special operations forces when they were helicoptered in to stop an attack on a Kibbutz. https://timesofisrael.com/testimonies-from-beeri-massacre-expose-deep-trauma-predating-israels-creation/
"'We spend billions and billions on gathering intelligence on Hamas,' said Yoel Guzansky, a former senior official at Israel’s National Security Council. 'Then, in a second,' he added, 'everything collapsed like dominoes.'" https://www.nytimes.com/2023/10/10/world/middleeast/israel-gaza-security-failure.html [https://archive.ph/uX0qu]
If I were responsible for Israel's ground invasion of Gaza, this is what I would be most concerned about: https://en.m.wikipedia.org/wiki/Mines_on_the_first_day_of_the_Somme
There are extensive tunnel networks under large parts of the Gaza Strip.
Ukraine links:
Great Britain will hand over MSI-DS Terrahawk Paladin to Ukraine as part of the air defence package. It is a platform which can track and destroy drones and protect critical national infrastructure. https://www.gov.uk/government/news/major-new-package-of-support-for-ukraines-counter-offensive-announced-by-grant-shapps
“The first 5000+ FPV drones from Operation Unity (A joint effort by UNITED24, Come Back Alive and Monobank) have arrived in Ukraine. The drones will be equipped with Ukrainian-made ammunition and handed over to the Ukrainian forces. In total, 10.000 FPV drones will be delivered.” https://twitter.com/NOELreports/status/1712028135825297599
Russia's attempt at a major advance at Avdiivka is still failing spectacularly. Videos show massive losses with around 15 tanks lost in one direction (https://twitter.com/GloOouD/status/1712117283227660500). Based on the amount of footage being spread (https://twitter.com/Tendar/status/1712162002024493340) with visible vehicle losses this could become the most costly Russian assault since the beginning of the war: 13 artillery pieces, 15 tanks, 33 IFV/APCs, 6 trucks, 14 cars/vans (https://twitter.com/Osinttechnical/status/1712341762860032128). See also this analysis: https://twitter.com/Tatarigami_UA/status/1712385378676514861
Gen. Mark Milley: “If Ukraine loses...I think you would be certainly increasing, if not doubling, your defense budget in the years ahead. And you will increase the probability of a great power war...I think it’ll be a very dangerous situation if Putin is allowed to win.” https://twitter.com/GOP4Ukraine/status/1711759743268671737