or: Invisible Social Consensus is Real And Can Hurt You

Related: Annoyingly Principled People, and what befalls them, both in terms of the claim being made, and in that I a...

The intelligence explosion could concentrate power through several mechanisms. At one extreme, AI-enabled coups could let a small group—people in frontier labs, governments, or both—permanently entrench their power. But less extreme scenarios could also concentrate political and/or economic power:

Epistemic status: Left as an exercise for the reader.

I was thinking of EA outreach and its optics this week. And was inspired to glance at a specific part: What does EA look like from the lens of a Slytherin?

Surprise means your model has error. I'll point out the confusions. First confusion:

I recently spent some time at Constellation, exploring ways in which I can contribute to safety. Given my experience, I naturally look for commercial applications. I asked several people about their thoughts on whether commercial approaches to safety are viable. Nobody denied that an intersection probably exists, but I detected skepticism.

One example that I think would...