One thing I've had a really hard time understanding, probably because it's kind of arbitrary, is what stuff it knows about—even vaguely or incorrectly. Like, I know it read the entire internet, but presumably part of being a model is dimensionality reduction and e.g. it doesn't know who I am. In particular, I'm surprised that it knows about this area that has some papers about it, but, and correct me if I'm wrong, isn't a big thing