Abstract
Language models such as GPT-3 have caused a furore in the research community. Some studies found that GPT-3 has some creative abilities and makes mistakes that are on par with human behaviour. This paper answers a related question: Who is GPT-3? We administered two validated measurement tools to GPT-3 to assess its personality, the values it holds and its self-reported demographics. Our results show that GPT-3 scores similarly to human samples in terms of personality and - when provided with a model response memory - in terms of the values it holds. We provide the first evidence of psychological assessment of the GPT-3 model and thereby add to our understanding of this language model. We close with suggestions for future research that moves social science closer to language models and vice versa.
| Original language | English |
|---|---|
| Title of host publication | Proceedings of the fifth workshop on Natural Language Processing and Computational Social Science (NLP+CSS) |
| Place of Publication | Abu Dhabi, UAE |
| Publisher | Association for Computational Linguistics |
| Pages | 218-227 |
| Number of pages | 10 |
| Publication status | Published - 2022 |
Fingerprint
Dive into the research topics of 'Who is GPT-3? An exploration of personality, values and demographics'. Together they form a unique fingerprint.Cite this
- APA
- Author
- BIBTEX
- Harvard
- Standard
- RIS
- Vancouver