I think it's because evaluating when someone's understood something is quite hard. For better and worse, education is kind of a mass production system for the most part. To really understand something, you have to go on your own individual journey with it

I think the machine learning people (industry and academia) are currently divided between here and Twitter. I'm hoping more of us shift here in time

What's the takeaway from all this? Honestly? I don't know. But ChatGPT seems to be able to spot this trivial logical contradiction I came up with now I guess?

For comparison, this is what the older ChatGPT models responded with. It certainly failed at this completely trivial reasoning riddle. I can't remember when I took this screenshot, but it must've been a year or 2 ago

So I asked it the same question, but without using chain of thought. It seemed to now solve this problem in one step, which is a tad odd. Especially considering in the last response, it said "people often answer playfully", implying this is might be in its training data. So it might be memorising

Kraut, that's not codfish liver. That's a really common Chinese fish thing.

It's a sort of fried fish in oil mixed with salted fermented soybeans.

I absolutely loved it as a child, and I still kind of like it. It's somewhat expensive here in the UK.

Here's me holding my can of it