Links for 2024-05-12
AI:
How much LLM training data is there, in the limit? https://www.educatingsilicon.com/2024/05/09/how-much-llm-training-data-is-there-in-the-limit/
Fishing for Magikarp: Automatically Detecting Under-trained Tokens in Large Language Models https://arxiv.org/abs/2405.05417
Don't Trust: Verify -- Grounding LLM Quantitative Reasoning with Autoformalization https://arxiv.org/abs/2403.18120
RadOnc-GPT: Leveraging Meta Llama for a pioneering radiation oncology model https://ai.meta.com/blog/radonc-gpt-meta-llama-2-mayo-clinic/
From LLMs to Actions: Latent Codes as Bridges in Hierarchical Robot Control https://arxiv.org/abs/2405.04798
“openai search this, openai voice that, this is what i am really holding my breath for” https://x.com/ericjang11/status/1789574686205980724
Nuclear power:
The Dual Fluid Fission Reactor: Our most promising way to solve the world’s energy problems? https://www.neimagazine.com/features/featurereinvented-the-dual-fluid-principle-9952766/
“Since … 1948, U.S. Navy nuclear program has developed 27 different plant designs, installed them in 210 nuclear-powered ships, taken 500 reactor cores into operation, & accumulated over 5,400 reactor years of operation.” https://en.wikipedia.org/wiki/United_States_naval_reactors
Technology:
Few- and single-molecule reservoir computing experimentally demonstrated with surface-enhanced Raman scattering and ion gating https://www.science.org/doi/10.1126/sciadv.adk6438
Miscellaneous:
Contextual and combinatorial structure in sperm whale vocalizations https://www.nature.com/articles/s41467-024-47221-8
What is Closed Form? The Horse Numbers are an illustration https://blog.computationalcomplexity.org/2024/05/what-is-closed-form-horse-numbers-are.html
Politics:
Autism & the Internet will defeat the Monoculture https://www.writingruxandrabio.com/p/autism-and-the-internet-will-defeat
Ukraine:
“If they manage to do it via cutting the E40 — they will have two more armies and at least one tank division in «reserve» (for immediate advance at another direction). If they create a buffer zone I see no chance how can we destroy them and make them retreat. Their logistics is perfect in that area. I don’t really see any forces from our side which can attack in the future and make the enemy retreat.” https://x.com/OSINTua/status/1789571410999878139
The Russians simply walked in: "For 2 years, concrete fortifications of minus 3 floors were supposed to stand on the Ukrainian border. And there were not even mines. We come to the opinion that this is either a crazy theft or deliberate sabotage." https://www.bbc.com/news/articles/c72p0xx410xo
“russian assaults in northern Kharkiv region mostly happen using infantry without mechanized forces. Problem Ukraine is facing right now is thick vegetation that makes drones much less effective.” https://x.com/Teoyaomiquu/status/1789657899112804502
Almost every day now, Ukraine is attacking Russian oil refineries and depots. And it's only going to get worse for Russia as Ukraine continues to ramp up its drone and missile production. The only way to stop this would be to conquer all of Ukraine. Which is a long way off, if at all possible. https://x.com/Tendar/status/1789542685931438161
FPV drone strike on a Russian vehicle in the Bilhorod region. https://x.com/NOELreports/status/1789568170157576527
Turtle Tanks, "Cope Cages" & Modified Vehicles in Ukraine - Purpose, Evolution & Effectiveness https://www.youtube.com/watch?v=hhfGspOIg24