Links for 2024-07-19

AI:

1. Implicit meta-learning may lead language models to trust more reliable sources — “Our results suggest that during training, LLMs better internalize text that appears useful for predicting other text (e.g. seems reliable).” https://arxiv.org/abs/2310.15047

2. Weak-to-Strong Reasoning: A progressive learning framework that enables the strong model to autonomously refine its training data, without requiring input from either a more advanced model or human-annotated data. https://arxiv.org/abs/2407.13647

3. OpenAI: “We trained advanced language models to generate text that weaker models can easily verify, and found it also made these texts easier for human evaluation.” https://openai.com/index/prover-verifier-games-improve-legibility/

4. Towards intelligence too cheap to meter: OpenAI announced GPT-4o Mini. A powerful, lightweight, and cost-efficient model. 15 cents per million input tokens, 60 cents per million output tokens. https://openai.com/index/gpt-4o-mini-advancing-cost-efficient-intelligence/

5. “…it is possible to find multiple steering vectors in a language model that activate very similar behaviors while all being orthogonal.” https://www.lesswrong.com/posts/CbSEZSpjdpnvBcEvc/i-found-greater-than-800-orthogonal-write-code-steering

6. Goldfish: Vision-Language Understanding of Arbitrarily Long Videos https://arxiv.org/abs/2407.12679

7. “This method demonstrates significant improvements over traditional multimodal training on image-text pairs, while reducing training costs by approximately 95%.” https://arxiv.org/abs/2407.12580

8. Machine learning unlocks secrets to advanced alloys https://news.mit.edu/2024/machine-learning-unlocks-secrets-advanced-alloys-0718

9. What Could Conquer the Superweeds? Bayer and Others Turn to AI https://www.wsj.com/science/environment/super-weed-killer-ai-8105de6a [no paywall: https://archive.is/X5heZ]

10. How well can AI chatbots mimic doctors in a treatment setting? We put 5 to the test https://www.cnbc.com/2024/07/18/op-ed-how-well-can-ai-chatbots-mimic-doctors.html

11. Claude 3.5 system prompt for coding https://www.reddit.com/r/ClaudeAI/comments/1dwra38/sonnet_35_for_coding_system_prompt/

12. “Samsung’s new image-generating AI tool is a little too good” https://www.theverge.com/2024/7/17/24199005/samsung-galaxy-ai-z-fold-6-sketch-to-image

13. JPMorgan CEO Jamie Dimon says he’ll add thousands of jobs focused on AI in the next couple of years. https://www.businessinsider.in/artificial-intelligence/news/jpmorgan-ceo-jamie-dimon-says-hell-add-thousands-of-jobs-focused-on-ai-in-the-next-couple-of-years/articleshow/111823636.cms

14. Meta won't offer future multimodal AI models in EU, citing regulatory uncertainty. https://www.axios.com/2024/07/17/meta-future-multimodal-ai-models-eu

15. “Donald Trump says America is on the cusp of a new golden age which will require tremendous energy investments to power AI” https://x.com/tsarnick/status/1814149823765086384

Deepseek founder Liang Wenfeng: https://x.com/teortaxesTex/status/1813678889065238754

Miscellaneous:

1. “New study found that relative reproductive success (RLRS) is higher for people with high ADHD polygenic scores and lower for people with high education attainment and cognitive polygenic scores. People are becoming genetically more ADHD and genetically lower IQ” https://x.com/BronskiJoseph/status/1813571969536630999 (paper: https://link.springer.com/article/10.1007/s10519-024-10189-8]

2. New anti-ageing therapy extends life of mice by 25%, study finds https://www.nature.com/articles/s41586-024-07701-9

3. “We find no evidence for a negative association between COVID-19 infection and subsequent measures of cognitive functioning. The associations found in earlier studies may at least partly reflect reverse causation.” https://marginalrevolution.com/marginalrevolution/2024/07/good-news-on-covid-and-your-brain.html

4. “The Meiji government translated 10,000 technical books (applied science, industry, etc). Then, Japan became an industrial powerhouse. Must be the greatest industrial policy investment ever made! Once again: the importance of upper human capital.” https://x.com/whyvert/status/1814008181104029995 (paper: https://www.nber.org/papers/w32667)

Ukraine:

1. Germany plans to halve military aid for Ukraine https://www.bbc.com/news/articles/c0kr91zqp0lo

2. Article about the battle for Krynky. Ukrainian marine and TDF brigades who fought there sustained 262 KIA whose bodies were recovered and another 788 are MIA. https://www.slidstvo.info/english-stories/i-have-seen-hell-and-the-name-of-it-is-krynky-fighters-who-held-the-village-on-the-left-bank-and-disappeared-there/

3. Fighting in Krynky ongoing, but Ukrainian positions 'completely destroyed' https://kyivindependent.com/fighting-in-krynky-ongoing/

4. “The public response to Krynky has been absurd. I think the public lacks understanding of how many casualties occur in ukraine every single day. I'm not going to provide statistics, but losing 1000 men over 9 months is really not that bad. Especially in relation to the damage they inflicted. Ukraine would have been hit with all those bombs and tos and tanks regardless of where they were fighting. Krynky could have actually reduced the overall casualties for Ukraine bc they were dropping 100 bombs a day on like 15 guys instead of dropping them on large troop concentrations.” https://x.com/AndrewPerpetua/status/1813915988804460739