Links for 2023-06-05
Bytes Are All You Need: Transformers Operating Directly On File Bytes https://arxiv.org/abs/2306.00238
“GPT4 and GPT3.5 can both track a chess game indefinitely deep into the game, if data is presented to them in a specific way. The moves produced are sometimes very high quality, and draws can be obtained at low rates against Stockfish 8(With the help of an external program coded by GPT4 that produces more detailed natural language descriptions, than shown in the examples. SF8 runs on a single core with 0.5 seconds to think, 16MB hash).” https://twitter.com/kenshinsamurai9/status/1662510532585291779
Fine-Tuning Language Models with Just Forward Passes: Proposes a memory-efficient zeroth-order optimizer, MeZO, adapting the classical ZO-SGD to operate inplace, thereby fine-tuning LMs with the same memory footprint as inference. https://arxiv.org/abs/2305.17333
TaleCrafter: Interactive Story Visualization with Multiple Characters https://arxiv.org/abs/2305.18247
3D Printing Paves Way for “Designer” Titanium Alloys https://www.theguardian.com/science/2023/jun/01/australian-scientists-create-new-class-of-titanium-alloys
50 years ago the still secret National Reconnaissance Office was using their satellites to photograph the damaged Skylab station in orbit. The resulting image is still classified https://thespacereview.com/article/4588/1
Deciphering Brain Coding: The Last Frontier https://www.bbvaopenmind.com/en/science/bioscience/deciphering-brain-coding-the-last-frontier/
One-third of galaxy’s most common planets could be in habitable zone https://news.ufl.edu/2023/05/exoplanet-habitability-/
Military innovations, like cavalry and iron weapons, enabled societies to over-power rivals and build strong, bureaucratized states, according to new research. https://www.science.org/content/article/does-warfare-make-societies-more-complex-controversial-study-says-yes
A glimpse of what the legal profession will look like when it becomes majority female https://twitter.com/herandrews/status/1637487501500637184
Socialist enterprises pay their workers 14 percent *less* than comparable capitalist companies https://web.stanford.edu/~pista/coopssept04.pdf