Who is GPT-3? An exploration of personality, values and demographics

Marilù Miotto, Nicola Rossberg, Bennett Kleinberg

Research output: Chapter in Book/Report/Conference proceedingConference contributionScientificpeer-review

Abstract

Language models such as GPT-3 have caused a furore in the research community. Some studies found that GPT-3 has some creative abilities and makes mistakes that are on par with human behaviour. This paper answers a related question: Who is GPT-3? We administered two validated measurement tools to GPT-3 to assess its personality, the values it holds and its self-reported demographics. Our results show that GPT-3 scores similarly to human samples in terms of personality and - when provided with a model response memory - in terms of the values it holds. We provide the first evidence of psychological assessment of the GPT-3 model and thereby add to our understanding of this language model. We close with suggestions for future research that moves social science closer to language models and vice versa.
Original languageEnglish
Title of host publicationProceedings of the fifth workshop on Natural Language Processing and Computational Social Science (NLP+CSS)
Place of PublicationAbu Dhabi, UAE
PublisherAssociation for Computational Linguistics
Pages218-227
Number of pages10
Publication statusPublished - 2022

Fingerprint

Dive into the research topics of 'Who is GPT-3? An exploration of personality, values and demographics'. Together they form a unique fingerprint.

Cite this