Links for 2024-04-01
AI:
ViTAR: Vision Transformer with Any Resolution https://arxiv.org/abs/2403.18361
Towards 1-bit Machine Learning Models https://mobiusml.github.io/1bit_blog/
Huawei presents DiJiang: Efficient Large Language Models through Compact Kernelization -- Achieves comparable performance with LLaMA2-7B on various benchmark while requiring only about 1/50 pretraining cost. https://arxiv.org/abs/2403.19928
“Is Attention all you need? Mamba, a novel AI model based on State Space Models (SSMs), emerges as a formidable alternative to the widely used Transformer models, addressing their inefficiencies” https://thegradient.pub/mamba-explained/
ObjectDrop: Bootstrapping Counterfactuals for Photorealistic Object Removal and Insertion https://objectdrop.github.io/
Explore until Confident: Efficient Exploration for Embodied Question Answering https://explore-eqa.github.io/
“My simple AGI investment & insurance strategy” https://www.lesswrong.com/posts/vvg6DmJSprDLNhW3v/my-simple-agi-investment-and-insurance-strategy
Maths and MI5: the calculations that keep the country safe — “MI5 is an organisation that needs to be resistant to hype, and even we would agree that recent advances in large language models and generative AI – supercharging neural network approaches using huge amounts of training data and ever-expanding processing power – are changing our world. Your world and my world alike.” https://www.mi5.gov.uk/news/director-general-speech-at-university-of-glasgow
Miscellaneous:
The Best Tacit Knowledge Videos on Every Subject https://www.lesswrong.com/posts/SXJGSPeQWbACveJhs/the-best-tacit-knowledge-videos-on-every-subject
“LessWrong is releasing an album! We collaborated with The Fooming Shoggoths to release it.” https://www.lesswrong.com/posts/YMo5PuXnZDwRjhHhE/the-story-of-i-have-been-a-good-bing
“Smarter soldiers are just better. r = 0.65 correlation between intelligence and general soldiering proficiency.” https://x.com/KirkegaardEmil/status/1774229346062053719
XZ Backdoor:
“Everything I Know About the Xz Backdoor” https://boehs.org/node/everything-i-know-about-the-xz-backdoor
Backdoor found in widely used Linux utility breaks encrypted SSH connections https://arstechnica.com/security/2024/03/backdoor-found-in-widely-used-linux-utility-breaks-encrypted-ssh-connections/
“Plans to literally "hack the planet" foiled due to 500ms of latency that Andres instinctually investigated.” https://x.com/haxrob/status/1773937085524979870
“Lots of analysis of the xz/liblzma vulnerability. Most skip over the first step of the attack: 0. The original maintainer burns out, and only the attacker offers to help (so the attacker inherits the trust of the project built by the maintainer).” https://x.com/robmen/status/1774067844785086775
Ukraine:
Russian losses near Terny in terms of heavy equipment and manpower. https://x.com/NOELreports/status/1774726946271748528
More large Russian losses in the Avdiivka direction. https://x.com/GloOouD/status/1774705966727979362
The company “Uralmashzavod” one of the Russia’s contributor of the industrial military complex is on fire. https://x.com/Tendar/status/1774746217626427806
Johnson says Ukraine aid will come up ‘right after’ recess and will include some ‘innovations’ https://thehill.com/homenews/house/4566836-johnson-says-ukraine-aid-will-come-up-right-after-recess-and-will-include-some-innovations/
Europe has entered 'pre-war era,' Poland's Tusk says https://www.dw.com/en/europe-has-entered-pre-war-era-polands-tusk-says/a-68702657