From Utterances to Networks: Modelling Slang Adoption and Diffusion Across Subreddits
Xiaoning Wang, Ted Underwood, Zhewei Sun
cs.CL
Quick verdict
LLM slang annotation plus fixed-effects and survival models tie Reddit slang spread to network position and context; sound, with survivorship caveats.
Summary
The paper asks how social-network position and linguistic context jointly shape slang adoption and diffusion on Reddit. The authors first release a benchmark of 1,333 human-annotated Reddit comments from 23 subreddits for community-specific slang detection and word-sense disambiguation (Fleiss' κ = 0.783), evaluating four small open LLMs; Gemma-4-E4B-it performs best, reaching 93.44 F1 on Single-WSD and 83.98 F1 on the harder List-WSD task. They then use this model to annotate roughly 100 million utterances (ConvoKit, 2008–2018) across 54 glossary-bearing subreddits, covering 3,965 terms. A fixed-effects negative binomial model of monthly adoption counts, controlling for subreddit, period, subreddit×period, and slang term, finds positive effects of adopters' mean betweenness centrality (β = 0.103) and negative effects of mean degree centrality (β = −0.506), effective topics (β = −0.018), and semantic dispersion (β = −0.215). A Monte Carlo sensitivity analysis retains signs and significance across simulations, though corrected median effects shrink substantially (e.g., dispersion −0.215 to −0.064). A Cox model at the user level shows degree centrality accelerates adoption (HR 1.209) while betweenness slows it (HR 0.884); semantic dispersion speeds adoption (HR 1.059) while effective topics slow it (HR 0.926). Main limitations, acknowledged by the authors: an observational design without causal claims; adoption measured as production only; and restriction to glossary-documented, already-successful slang, introducing survivorship bias.
Review complete
Assessment at a glance
5
risk flags identified
● high 0
● medium 4
● low 1
5 strengths · 5 weaknesses · 5 author questions
AI text signal = Binoculars zero-shot detector score over 20 sampled passages (Fast-DetectGPT co-reported) — absence does not prove human authorship, and a flag does not imply misconduct.
Levels reflect verification complexity — not a quality score. Evolve never rates your paper.
Key claims under review
- Slang terms whose current users have higher average betweenness centrality gain more new adopters the following month, while higher average degree centrality predicts fewer (Table 2: β=0.103 vs β=−0.506).
- At the user level, degree centrality speeds slang adoption (HR 1.209) and betweenness centrality slows it (HR 0.884), implying that network positions aiding transmission differ from those aiding adoption.
- Contextual diversity is not unitary: effective topics slows both community-level adoption (β=−0.018) and individual hazard (HR 0.926), whereas semantic dispersion slows community-level counts (β=−0.215) but speeds individual adoption (HR 1.059).
- Small open LLMs suffice as scalable slang annotators: Gemma-4-E4B-it reaches 93.44 F1 on Single-WSD and 83.98 F1 on List-WSD, enabling annotation of ~100 million Reddit utterances.
Strengths
Novel naturalistic benchmark for community-specific slang WSD
1,333 real Reddit comments across 23 subreddits with sentence-level slang-sense labels, context metadata, and Fleiss' κ = 0.783 among three authors on 50 shared samples (Table 4, Appendix A.3); fills a real gap vs subtitle-based (Sun et al., 2024) or binary-classification (Aloraini, 2025) prior data.
Diagnostic task decomposition localizes the LLM bottleneck
Single-WSD vs List-WSD separates disambiguation from term retrieval: best model Gemma-4-E4B-it scores 93.44 F1 vs 83.98 F1 (Table 1), showing the difficulty lies in long-context instruction following rather than WSD itself.
Careful confound control for this literature
Explicit label-error robustness analysis
Two-level design yields an interpretable stage dissociation
Weaknesses
Benchmark bookkeeping is internally inconsistent
Unsupported cross-feature importance claim
Label correction shrinks headline effects substantially
Possible missing exposure term in the count model
Cox model dependence structure and leakage unclear
Full Review Report
$1.99 · one-timeUnlock the complete preliminary analysis Evolve produced for this paper.
Report preview
Scope & Claims
The paper asks how social-network structure and linguistic context jointly shape slang adoption on Reddit, making three claims: (1) small open LLMs can reliably detect subreddit-specific slang, enabling annotation at ~100M-utterance scale; (2) at the slang level, adopters in bridging positions (betweenness) predict more new adopters next month while dense local connectedness (degree) predicts fewer; (3) at the user level, well-embedded users adopt faster whereas brokers adopt slower, and contextual diversity splits — semantic dispersion speeds individual adoption (HR 1.059) while effective topics slow it (HR 0.926). Note the abstract's claim that wider contextual usage lengthens time-to-adoption maps only to the effective-topics result; dispersion actually accelerates individual adoption, an asymmetry the abstract glosses over.
The remaining sections cover Methodology Assessment, Statistical Evidence, Results & Reproducibility, Limitations & Risks, and Verdict & Recommendations.
- All 5 strengths & 5 weaknesses, analyzed in detail
- 5 risk flags with severity, section & reviewer questions
- Methods & statistical evidence assessment
- 5 questions a peer reviewer would ask
- Full six-dimension evaluation report & recommendations
One-time purchase · this paper only
One-time purchase, this paper only. AI-generated preliminary analysis — not peer review.
Frequently asked questions
What is the main finding of this paper about slang spreading on Reddit?
Across 54 subreddits, a slang term gains more new users next month when its current users occupy bridging (high-betweenness) network positions, and gains fewer when they are densely locally connected (high degree). Individually, well-embedded users adopt slang faster while brokers adopt more slowly; usage across many distinct topics slows adoption, while varied but coherent semantic usage speeds it up.
How does the paper detect slang automatically at large scale?
It prompts the open-source model Gemma-4-E4B-it (via vLLM, temperature 0) with a subreddit's slang glossary, the comment, and the parent/grandparent context, asking which glossary terms are used in their slang sense. The model was validated on 1,333 human-annotated Reddit comments (F1 93.44 when the target term is given; 83.98 when it must be found in the glossary), then applied to roughly 100 million utterances from ConvoKit (2008–2018).
Is the slang annotation benchmark and code publicly available?
Yes. The paper states code and data are available at xiaoningwang.ca/projects/slang. The benchmark comprises 1,333 Reddit comments from 23 subreddits with sentence-level slang sense labels (inter-annotator Fleiss' κ = 0.783), built on the publicly available ConvoKit Reddit corpus.
What are the main limitations of the study?
The authors note it is observational, so no causal claims are made; adoption is measured only as observable production, not comprehension or learning; and only slang documented in moderator glossaries is studied, meaning failed slang is underrepresented (survivorship bias). LLM annotation errors may also propagate, though a Monte Carlo sensitivity analysis shows the coefficient signs are robust.
About this review
This is an AI-generated preliminary review by Evolve.Pub, produced from the openly available text of the paper. It is not peer review and does not represent the authors' views. The canonical record of the paper is at the publisher link above.
- Figures 1–8 and the fixed-effects diagram were extracted as raw text; only captions were verifiable, not the plotted content.
- The extracted text shows PDF artefacts (e.g., the Figure 1 example utterance merged into the caption), and one apparent typo ('March 2026' for r/wow data in a corpus ending 2018); some citation years (Yang et al., 2026 = arXiv:2505.15291) are internally inconsistent.
- The extraction appears complete through references and both appendices, so coverage is good; judgments rest on the numbers as printed.
Go deeper on this paper
Wrote a paper? Stress-test it before reviewers do.
Upload your manuscript for the same structured scrutiny — reasoning, statistics, evidence, figures, and reproducibility.