On the Edge #21
This week ee were at “The Futurists' Corner Berlin - LongBio, Crypto-Finance & Startup Cities“ by Infinita VC and met many new amazing startups in crypto and web3. It was a good sign that the community is evolving around real problems instead of just speculative prices.
"But where is everybody?" Fermi Paradox
The simplest, fastest repository for training/finetuning medium-sized GPTs . reproduces GPT-2 (124M) on OpenWebText, running on a single 8XA100 40GB node in 38 hours of training. link
Large language models are more capable than we think. Governments will get into it like supercomputers and every company that builds a LLM will be a platform to host many other applications. LLMs are like new computers and there will be new kind of application using them. For example, this customization on a pre-existing model in Google to add medical question-answering capabilities. link . (92.6% of Med-PaLM answers was aligned with scientific consensus, versus 92.9% for clinician-generated answers.) A key component of customizations like this or ChatGPT, is their training process with new inputs, which is getting more systematic.
New Midjourney model has drastically improved:
Stories that start other stories link
I wrote that disrupting science is getting slower and it’s a big deal, here’s a deep dive by Matt Clancy link
In case you missed it, battery powered stoves are hot (!) link
Didn’t know about this fuckup! link
I went to a small jazz performance by Johannes Barthelmes, which I found randomly. No ads, no posters. But the artist was mind-blowingly amazing. His friends told me his story that he puts aside music becuase of an injury, and doesn’t play and starts to do photography. Then five years age he comes back to playing music while he was 65 link. Their best piece was called “Moon River”.
Eight Books to Comfort You When You’re Lonely link
Another reel , lets dance link
I started Das Boot and didn’t expect such good quality. Although there was extreme points in the story that I’m not sure about, but the series was one of the best I’ve seen recently.
I also listened to this new artist, FKJ