Lesswrong

TL;DR: I'm launching Societal Impacts Research on AI (SIRA), a mentored research fellowship to bring more social science talent into AI safety. We're looking for our first cohort of 15-20 social scientists, from undergrads to postdocs, to work on societal impact problems within AI saf...

This project was done as part of the Iliad Fellowship. L.J. did this work while at EleutherAI.

That we can learn efficiently from our environment at all tells us something about (1) the world and (2) ourselves: (1) Regularities in the world are simple enough to be picked up from limited experience. (2) Our inductive biases favour precise...

It's been quite a while since I have roleplayed with an LLM. Typically I spend all day chatting with LLMs to learn new topics, analyze ideas and approaches on a project, or simply ask about random occurring questions in my head. It was today after having my first ever can of Red Bull and an entire sleepless night that it occurred to me, "How far will an LLM go trying to follo...

tl;dr. I show that the recently introduced GRAFT method can be improved upon by using a single layer rank 1 Low-rank Linear Subspace Representation Fine Tuning (LoReFT) adapter as the FORGET adapter, using only 0.029% of the parameters of the one used in the GRAFT paper. This approach achieves an equivalent level of reward hack suppression while improving the clean env...

The average person, presumably, just stumbles along in their relationships, without ever studying the science behind what makes them work.