Links for 2022-11-30
137 emergent abilities of large language models: “In Emergent abilities of large language models, we defined an emergent ability as an ability that is “not present in small models but is present in large models.” Is emergence a rare phenomena, or are many tasks actually emergent?” https://www.jasonwei.net/blog/emergence
“The number of key changes in hit songs was about 20% from 1960-2000. Now close to 0. Why? Because 1. rap - vocal is spoken so no real key 2. digital composition - encourages building songs from copy/pasting loops, less on structural changes by section.” https://tedium.co/2022/11/09/the-death-of-the-key-change
Mechanical neural networks: Architected materials that learn behaviors https://scitechdaily.com/huge-potential-new-ai-material-learns-behaviors-and-adapts-to-changing-conditions/
Anton Howes on why we waited so long for the optical telegraph https://progressforum.org/posts/SkmWuaBisAp6fH5L4/age-of-invention-the-beacons-are-lit
South Korea in the 60s and 70s. Some villages were divided by clans, others not. Less divided ones had more growth, more public goods, and were more cohesive. https://threadreaderapp.com/thread/1593786768439922688.html
Dimming the Sun to Cool the Planet Is a Desperate Idea, Yet We’re Inching Toward It https://www.newyorker.com/news/annals-of-a-warming-planet/dimming-the-sun-to-cool-the-planet-is-a-desperate-idea-yet-were-inching-toward-it
Stable Diffusion 2.0 and the Importance of Negative Prompts for Good Results https://minimaxir.com/2022/11/stable-diffusion-negative-prompt/
Meet Unstable Diffusion, the group trying to monetize AI porn generators https://techcrunch.com/2022/11/17/meet-unstable-diffusion-the-group-trying-to-monetize-ai-porn-generators/
“When it comes to human behavior, there mostly aren’t systematic differences between what your lying eyes tell you and what The Science says. There’s a continuum between anecdote, anecdata, and data. If there’s a strong statistical pattern in the numbers, you should be able to come up with vivid real-life examples of it. And if you can think of several examples suggesting a pattern, you might well be able to find large-scale data for it.” https://www.takimag.com/article/what-if-im-right-2/
Make-A-Story: Visual Memory Conditioned Consistent Story Generation https://arxiv.org/abs/2211.13319
A poem about the Russo-Ukrainian War by GPT-3:
Ukraine's cries echo far and wide Of an enemy that's crept inside But still Ukraine stands in unity Unwavering amidst the tyranny The people of Ukraine, they suffer in pain, From the wave of terror that came like a train The brave hearts of Ukraine they won't be broken Though the forces of evil come like a token They refused to be conquered, and their spirit rose Putin's forces could not quell their hopes In the city of Kiev the soldiers did stand To repel the forces of their foe's hand Though the odds are against them, they still persist To save their home, they'll never desist For freedom and justice they will fight Until their foe is vanquished from sight The people of Ukraine will never give in In their fight for freedom and justice, they will win