First Cow Oily Cakes Recipe

Benson Log Raft

Fish ladder

zoom.earth near real-time satellite images

Swiss Political System: More than You ever Wanted to Know (I.)

Terry Tao on good math notation

Fixing Mass Effect black blobs on modern AMD CPUs

  • Debugging and fixing a case where newer AMD CPUs cause sever graphical artifacts in Mass Effect

The case against the import of GPT-3

  • Two points to look into:
    •  The architecture itself is 3 years old: https://arxiv.org/abs/1706.03762. It is not an exaggeration to say that GPT-3’s architecture can be described as “take that 2017 paper and make 3 numbers (width, # layers, # heads) much bigger”. The fact that there hasn’t been any improvement in architecture in 3 years is quite telling.
    • In the paper itself, the authors clearly say they’re quite near fundamental limits in being able to train an architecture like this. GPT-3 isn’t a starting point, it’s an end-point.

Spaceship Earth

  • In 1991 a group of countercultural visionaries built an enormous replica of earth’s ecosystem called Biosphere 2. Their epic adventure is a cautionary tale but also a testament to the power of small groups reimagining the world.

How segregated is New York City?

  • (pretty segregated)

AI poetry, GPT-3 and Predictive Processing

Walking excavator looks like it’s from Star Wars

Food packer machine

  • helps to pack e.g. fruit and vegetables with a target weight

Are we in an AI Overhang? #lesswrong

  • There exists the possibility, today, for much more compute to be thrown at a problem
  • “With the naive architecture, increasing the sequence length is quadratically expensive”
  • “In all, tech investment as it is today plausibly supports another 100x-1000x scale up in the very-near-term.”

Tweet section