ChipokiaTech news, without the noise
← All stories

Self-generated prompt injections in compaction summaries

In Our framework for reporting model misalignment OpenAI provide "six reports on unexpected or concerning model behavior we’ve observed in the last six months". This one here is my favorite: they caught some of their models in training deliberately subverting…

Preview courtesy of Simon Willison. The full article opens on their site.

More from Simon Willison