Abstract
Language models such as GPT-3 have caused a furore in the research community. Some studies found that GPT-3 has some creative abilities and makes mistakes that are on par with human behaviour. This paper answers a related question: Who is GPT-3? We administered two validated measurement tools to GPT-3 to assess its personality, the values it holds and its self-reported demographics. Our results show that GPT-3 scores similarly to human samples in terms of personality and - when provided with a model response memory - in terms of the values it holds. We provide the first evidence of psychological assessment of the GPT-3 model and thereby add to our understanding of this language model. We close with suggestions for future research that moves social science closer to language models and vice versa.
Original language | English |
---|---|
Title of host publication | Proceedings of the fifth workshop on Natural Language Processing and Computational Social Science (NLP+CSS) |
Place of Publication | Abu Dhabi, UAE |
Publisher | Association for Computational Linguistics |
Pages | 218-227 |
Number of pages | 10 |
Publication status | Published - 2022 |