It’s beginning to look like Anthropic’s recent interpretability research didn’t just uncover a “golden gate feature” in their production model, but some kind of “sensations related to the golden gate” feature.

I’m excited to see what more generative exploration of the model variation with that feature vector maximized ends up showing.

I have a suspicion that it’s the kind of thing that’s going to blow minds as it becomes clearer.