Links for 2024-03-27
AI:
Easy-to-Hard Generalization: Scalable Alignment Beyond Human Supervision — Strong evaluators enable generalizing to harder problems https://arxiv.org/abs/2403.09472
Unfamiliar Finetuning Examples Control How Language Models Hallucinate https://arxiv.org/abs/2403.05612
Data Mixing Laws: Optimizing Data Mixtures by Predicting Language Modeling Performance https://arxiv.org/abs/2403.16952
“MatX: we design hardware tailored for LLMs, to deliver an order of magnitude more computing power so AI labs can make their models an order of magnitude smarter. Our hardware would make it possible to train GPT-4 and run ChatGPT, but on the budget of a small startup.” https://www.bloomberg.com/news/articles/2024-03-26/ai-chip-startups-like-matx-storm-silicon-valley [no paywall: https://archive.is/GklSk]
RadSplat: Radiance Field-Informed Gaussian Splatting for Robust Real-Time Rendering with 900+ FPS https://m-niemeyer.github.io/radsplat/
3D-MoLM: Towards 3D Molecule-Text Interpretation in Language Models https://lsh0520.github.io/3D-MoLM/
AI generates high-quality images 30 times faster in a single step https://news.mit.edu/2024/ai-generates-high-quality-images-30-times-faster-single-step-0321
“Modern Transformers are AGI, and Human-Level” https://www.lesswrong.com/posts/gP8tvspKG79RqACTn/modern-transformers-are-agi-and-human-level
Psychology:
This 50-year study shows beyond reasonable doubt that intellectual output does not "plateau" at some level of IQ. It continues rising as IQ rises. An annotated fulltext bibliography of publications on the Study of Mathematically Precocious Youth (SMPY), a longitudinal study of high-IQ youth. https://gwern.net/smpy
“In the extreme right tail of the talent distribution, small differences in talent are associated with sizeable differences in long-term achievements, including getting a PhD, number of mathematics publications and cites, and being awarded a Fields medal.” https://cepr.org/voxeu/columns/invisible-geniuses-advancement-knowledge-frontier
The best predictor of job performance, based upon 85 years of research, is intelligence (or "general mental ability") [PDF] https://static1.squarespace.com/static/5b100920b105987b3e97fd32/t/5b36404a6d2a73fcad279e22/1530282064466/Schmidt+and+Hunter+article.pdf
"In a Representative [USA] Sample...intelligence contributes 48–90 times more than grit to educational success and 13 times more to job-market success...previous studies used nonrepresentative samples that were range restricted on intelligence" https://journals.sagepub.com/doi/10.1177/1948550620920531
Higher IQ at age 11 predicts lower mortality 68 years later from all major causes of death (N = 65,765). https://www.bmj.com/content/357/bmj.j2708
Ukraine:
“New evidence strengthens the commission’s previous findings that torture used by Russian authorities in Ukraine and in the Russian Federation has been widespread and systematic,” https://apnews.com/article/russia-ukraine-human-rights-torture-935c8b16e5958f297801297790f19420
“The cumulative impacts of repeated torture, ill-treatment, isolation and poor conditions in Russian captivity severely affected the physical and mental well-being of many POWs, with risk of long-lasting adverse effects. Moreover, during the reporting period, OHCHR received reports of the apparent execution of at least 32 recently captured Ukrainian POWs in 12 separate incidents. OHCHR verified three of these incidents in which Russian servicemen executed seven Ukrainian servicemen hors de combat.” [PDF] https://ukraine.un.org/sites/default/files/2024-03/2024-03-26%20OHCHR%2038th%20Periodic%20Report.pdf