So then we use that to further tune the behavior, the ethics code of whatever you call it, to the resulting language model. But the preference is what always goes first, and then the exchange style, communication style goes later with the constitutional alignment.

Keyboard shortcuts

j previous speech k next speech