arXiv paper· natural language processing / computational psycholinguistics· empirical study (dataset + evaluation)

Emotional Labor Strategy Preferences in LLM Personas

Mohammad Saim, Tianyu Jiang

cs.CL

Quick verdict

Claims first EL-strategy dataset + persona-conditioned LLM study; DA preference and C/ES correlations plausible, but trait tables shown for only 2 of 5 models.

Summary

The paper asks whether LLMs injected with psychometrically grounded personas reproduce human personality–emotional-labor associations outside occupational settings. The authors build a 500-scenario Emotional Labor Strategy dataset from the Troiano et al. (2023) appraisal corpus, using GPT-5.4 to add a social context and three behavioral options per scenario, corresponding to surface acting, deep acting, and genuine expression. Fifty fictional characters from the Open Psychometrics repository are profiled on two tracks: observer-rated bipolar adjective pairs (40 items verified against Goldberg's 1992 taxonomy) and in-character IPIP-50 self-reports. Five LLMs (Qwen-3-8B/32B, GPT-5.4, DeepSeek-V4-Flash, Gemma-4-31B) select one option per scenario. Deep acting is modal in eight of ten model-track combinations (39–61%). Spearman correlations across 50 characters show Conscientiousness and Emotional Stability consistently predict deep acting and reduced surface/genuine expression (e.g., ES–DA ρ=+0.850, IPIP track); the Conscientiousness–genuine-expression inversion of the human literature replicates under a Likert format (ρ=−0.516) and in DeepSeek. Entropy analysis shows personas meaningfully diversify choices for most models, while Qwen-3-32B stays scenario-dominated. Main limitations: options are canonical GPT-5.4-generated instantiations (risking option-type recognition over genuine preference), trait-correlation tables appear only for GPT-5.4 and DeepSeek despite five-model claims, manual dataset validation lacks agreement statistics, there is no human baseline on the same stimuli, and findings are correlational.

Review complete

Assessment at a glance

natural language processing / computational psycholinguistics

4

risk flags identified

● high 1

● medium 3

● low 0

Reproducibility readinesshigh
Code & data availableyes
Review confidencehigh
AI text signal0/20 passages flagged
Deep research viableCode-reproducibleNeeds GPU

4 strengths · 5 weaknesses · 5 author questions

AI text signal = Binoculars zero-shot detector score over 20 sampled passages (Fast-DetectGPT co-reported) — absence does not prove human authorship, and a flag does not imply misconduct.

Levels reflect verification complexity — not a quality score. Evolve never rates your paper.

Key claims under review

  • Deep acting is the modal emotional labor strategy in eight of ten model–persona-track combinations, ranging from ~39% (GPT-5.4, IPIP track) to ~61% (Qwen-3-32B, both tracks).
  • Conscientiousness and Emotional Stability consistently predict deep acting preference across both persona tracks (GPT-5.4: C–DA ρ=+0.597 BAP / +0.649 IPIP; ES–DA ρ=+0.522 BAP / +0.850 IPIP).
  • LLM personas invert the human-literature positive Conscientiousness–genuine-expression association (C–GE ρ=−0.570 BAP / −0.592 IPIP), and this inversion is not a forced-choice artifact (Likert: ρ=−0.516, p<.001) and replicates in DeepSeek (ρ=−0.645 BAP).
  • Persona injection reliably diversifies strategy selections (normalized entropy 0.82–0.92 for GPT-5.4/DeepSeek/Gemma across emotions), while Qwen-3-32B remains scenario-dominated (0.42–0.70).
  • The aggregate DA preference is a training-distribution prior, not a persona effect: vanilla prompting yields 68% DA vs 36.6–36.9% under any persona condition (Table 5).

Strengths

  • First ELS choice dataset with disciplined construction

    §3.1 builds 500 scenarios from the established Troiano et al. (2023) appraisal corpus; Prompt A.1 enforces structural constraints (no emotion adjectives, exactly one SA leakage cue, 20–30-word options), and BAP items are verified against Goldberg (1992) before injection (Table 7). Dataset and code are released (footnote 1).

  • Two-track persona measurement with a theoretical rationale

    Observer-rated BAP vs in-character IPIP-50 (Table 3) is motivated by the SOKA model (Vazire, 2010); the track divergence on Agreeableness (significant only under IPIP: A–SA ρ=−0.398, A–DA ρ=+0.372, Table 4) is interpreted via self–other knowledge asymmetry rather than dismissed.

  • Response-format robustness check

  • Ablation separates DA default from persona effects

Weaknesses

  • Measurement circularity: option-type recognition vs strategy preference

  • Cross-model claim exceeds presented evidence

  • Unquantified manual validation

  • Statistical rigor gaps

  • Implausibly high IPIP reliabilities and no human baseline

Full Review Report

$1.99 · one-time

Unlock the complete preliminary analysis Evolve produced for this paper.

Report preview

Scope & Claims

The paper sits at the intersection of computational psycholinguistics and organizational psychology: do LLM personas with injected Big Five profiles select emotional labor strategies the way trait theory predicts humans do? Three headline claims: (1) the first emotional labor strategy (ELS) choice dataset — 500 socially situated scenarios, each offering surface acting (SA), deep acting (DA), and genuine expression (GE) options; (2) DA is the dominant default across five LLMs; (3) Conscientiousness (C) and Emotional Stability (ES) consistently predict DA preference, with a C–GE inversion relative to human studies. Claims (2) and (3) are well supported where evidence is actually shown (GPT-5.4, Table 4; DeepSeek-V4-Flash, Table 10) but asserted for all five models while trait tables cover only two.

The remaining sections cover Methodology Assessment, Statistical Evidence, Results & Reproducibility, Limitations & Risks, and Verdict & Recommendations.

  • All 4 strengths & 5 weaknesses, analyzed in detail
  • 4 risk flags with severity, section & reviewer questions
  • Methods & statistical evidence assessment
  • 5 questions a peer reviewer would ask
  • Full six-dimension evaluation report & recommendations

One-time purchase · this paper only

One-time purchase, this paper only. AI-generated preliminary analysis — not peer review.

Frequently asked questions

What is the difference between surface acting, deep acting, and genuine expression?

Surface acting means faking the outward display while the inner feeling persists (with leakage cues); deep acting means actively reshaping the inner feeling through reframing or self-talk before expressing it; genuine expression means the felt emotion already matches the display, so no regulation is needed.

Did the LLM personas behave like humans in emotional labor studies?

Partly. As in human studies, high Conscientiousness and Emotional Stability predicted more deep acting and less surface acting. But the models inverted the human finding that conscientiousness supports genuine expression — high-C personas showed less genuine expression, a result that also appeared under a Likert rating format and in DeepSeek.

Is the emotional labor strategy dataset publicly available?

Yes. The paper states that the code and the 500-scenario emotional labor strategy dataset are publicly released at github.com/cincynlp/emotion-labor.

Which emotional labor strategy do LLMs choose by default?

Without any persona, GPT-5.4 chose deep acting 68% of the time on a 50-scenario subset (surface acting only 10%). With personas injected, deep acting remained the most common choice in eight of ten model-track combinations, at 39–61%.

About this review

This is an AI-generated preliminary review by Evolve.Pub, produced from the openly available text of the paper. It is not peer review and does not represent the authors' views. The canonical record of the paper is at the publisher link above.

  • Figure 2/3/4 bar values appear in the extraction only as flattened digit runs from axis labels; numeric statements about the figures rely on the authors' prose ranges (e.g., '39% to 61%'), not recoverable exact bar heights.

Go deeper on this paper

Wrote a paper? Stress-test it before reviewers do.

Upload your manuscript for the same structured scrutiny — reasoning, statistics, evidence, figures, and reproducibility.

Scan your paper
Emotional Labor Strategy Preferences in LLM Personas | Evolve.Pub