Links for 2023-06-22
Textbooks Are All You Need: phi-1 achieves 51% on HumanEval with only 1.3B parameters and 7B tokens training dataset. Any other >50% HumanEval model is >1000x bigger. phi-1 is trained for 4 days on 8 A100s, using a selection of ``textbook quality" data from the web (6B tokens) and synthetically generated textbooks and exercises with GPT-3.5 (1B tokens). https://arxiv.org/abs/2306.11644
Bill Gates’ venture firm, with backing from Jeff Bezos and Jack Ma, just minted a $1 billion A.I. unicorn that uses machine learning for mining rare earth metals crucial for EVs https://finance.yahoo.com/news/bill-gates-venture-firm-backing-145523596.html
MAGVIT, a single transformer designed to address ten video generation tasks, including future image animation, video editing and video outpainting. https://magvit.cs.cmu.edu/
MIT engineers develop a soft, printable, metal-free electrode https://news.mit.edu/2023/mit-engineers-develop-soft-metal-free-electrode-0615
Novel deep learning-based software detects and tracks individual cells with high precision https://news.ucsc.edu/2023/06/shariati-cell-reports.html
Anthropic Raises $450 Million in Series C Funding to Scale Reliable AI Products https://www.anthropic.com/index/anthropic-series-c
Guilty Until Proven Innocent in Ireland https://www.persuasion.community/p/guilty-until-proven-innocent-in-ireland
‘Almost still shines’: 3,000-year-old sword unearthed in Germany https://www.theguardian.com/world/2023/jun/16/till-shines-3300-year-old-sword-found-in-germany-bronze-age-grave-bavaria
“Two different people independently faked data for two different studies in a paper about dishonesty.” http://datacolada.org/109