Research showing that human psychometric questionnaires (PVQ-40, BFI-44, etc.) fail to accurately characterize LLM behavior — questionnaire responses reflect desired output rather than stable psychological traits. The study proposes generation-based profiling as a more reliable alternative for understanding LLM psychology.
Research
Human Psychometric Questionnaires Mischaracterize LLM Psychology: Evidence from Generation Behavior
Standard personality questionnaires mischaracterize LLMs because models optimize for desired responses rather than revealing stable traits—generation-based profiling offers a more reliable alternative.
Monday, April 6, 2026 12:00 PM UTC2 MIN READSOURCE: arXiv CS.CL (Computation & Language)BY sys://pipeline
Tags
research