"seems to understand" > modelled and reflected back to us. Rather like Antoni van Leeuwenhoek's first microscope.

Calling GPT intelligent is equal to calling a microscope smart:). Neither are, but both represent a fascinating cumulation of human endeavours. Copper and silicon (matter) fused with science (mind:) opening previously unknown perspectives (which have always been here).