arXiv paper· building energy systems / AI for built environment· systematic review

Large Language Models for HVAC Operations in Building Energy Systems: A Critical Review of Methods, Applications, and Deployment Readiness

Alexander Neubauer, Tianzhen Hong, Han Li, Mengbo Yu, Amin Darbandi, Yannick Fürst, Martin Kriegel

cs.AI · cs.CL · eess.SY

Quick verdict

Claims LLMs fit HVAC as semantic layers not controllers: 66 studies, 0 ready-now; credible review, but limited by single-coder Scopus-only corpus.

Summary

This systematic review codes 66 peer-reviewed studies (2023–March 2026) on large language models for HVAC operations across five application families (fault detection, load forecasting, building energy modelling, control, comfort) and three method families (prompting/fine-tuning, context-grounded orchestration, multimodal input). Using a Scopus search (142 records screened to 66 included, PRISMA-documented), each study was additionally coded for evidence realism, deployment readiness, and responsibility boundary. Results show heavy concentration in building energy modelling (32/66 papers; dominant cell A3×M2 with 15), only four pilot-level studies corresponding to three distinct field deployments, and no sustained operational deployment; readiness coding yields zero ready-now, three near-term, and 63 research-only studies. The authors conclude LLMs are best positioned as semantic and workflow layers — point-name normalisation, document-grounded operator support, BEM assistance, advisory wrappers around MPC/RL — while conventional ML, MPC, RL and ontology tools remain preferable for high-frequency control and short-horizon forecasting. Limitations include single-reviewer coding without inter-rater reliability, a Scopus-only corpus that misses the arXiv capability frontier, sparse cells (forecasting n=3), and a near-term tier resting essentially on one deployment programme.

Review complete

Assessment at a glance

building energy systems / AI for built environment

5

risk flags identified

● high 0

● medium 3

● low 2

Reproducibility readinessmedium
Code & data availableyes
Review confidencemedium
Deep research viable

5 strengths · 5 weaknesses · 5 author questions

Levels reflect verification complexity — not a quality score. Evolve never rates your paper.

Key claims under review

  • No LLM-for-HVAC study in the 66-paper peer-reviewed corpus qualifies as ready-now for industry adoption; only three are near-term and 63 are research-only (Sections 5.3, 6.1).
  • Current evidence supports LLMs primarily as bounded semantic and workflow layers (point-name normalisation, document-grounded support, BEM assistance, advisory wrappers), not as autonomous HVAC controllers (Abstract, Section 6.4).
  • Conventional ML, MPC, RL and ontology-based tools remain the better choice for high-frequency control, short-horizon forecasting and well-posed ontology mapping (Abstract, Table 6).
  • Six recurring failure modes (FM1–FM6, Section 6.5) — reasoning brittleness, semantic hallucination, 'executable but wrong' BEM output, unfaithful explanations, latency, proprietary-model dependence — are not captured by standard metrics (F1, R², savings %).
  • The field's binding constraints are field validation, safety architecture and governance rather than raw model capability (Section 7, FW1–FW4).

Strengths

  • Transparent, auditable review protocol

    Section 3.1 gives the verbatim Scopus query, date stamps (search 1 April 2026, index cutoff 31 March 2026), full screening counts (142 → 104 → 66) and a PRISMA flow (Fig. 3); the complete paper-level coding for all 66 studies is released as supplementary XLSX (S1), which is uncommon for this literature.

  • Novel and practically useful assessment framework

    The triad of evidence realism, deployment readiness and responsibility boundary (Table 2 operational definitions; Section 6.2 four-level boundary taxonomy; Fig. 9 cyber-physical stack) goes beyond the usual A×M taxonomy and directly addresses the safety/governance question most LLM-in-HVAC surveys skip.

  • Honest, contrarian headline finding

  • Fit-for-purpose boundary against conventional methods (RQ4)

  • Rare cost and latency reporting

Weaknesses

  • Single-reviewer coding without reliability checks

  • Scopus-only corpus misses the capability frontier

  • Near-term tier rests on essentially one programme

  • Sparse cells invite overgeneralisation in both directions

  • No quantitative meta-analysis or effect aggregation

Full Review Report

$1.99 · one-time

Unlock the complete preliminary analysis Evolve produced for this paper.

Report preview

Preliminary Review: LLMs for HVAC Operations (arXiv 2609.05314)

The remaining sections cover Methodology Assessment, Statistical Evidence, Results & Reproducibility, Limitations & Risks, and Verdict & Recommendations.

  • All 5 strengths & 5 weaknesses, analyzed in detail
  • 5 risk flags with severity, section & reviewer questions
  • Methods & statistical evidence assessment
  • 5 questions a peer reviewer would ask
  • Full six-dimension evaluation report & recommendations

One-time purchase · this paper only

One-time purchase, this paper only. AI-generated preliminary analysis — not peer review.

Frequently asked questions

Are LLMs ready to control HVAC systems in real buildings today?

According to this review of 66 peer-reviewed studies (2023–March 2026), no. Zero studies qualified as 'ready-now', three as 'near-term', and 63 as 'research-only'. The only real-office field evidence comes from one programme (Office-in-the-Loop, ≈7.5 weeks across two periods, 47.9% energy savings in the LLM-only condition), and it remained human-in-the-loop. The authors recommend LLMs only in bounded, human-supervised roles: point-name cleanup, document-grounded operator support, building-energy-modelling assistance, and advisory interfaces around physics-based controllers (MPC/RL).

What are LLMs actually good for in building operations, per this review?

The strongest supported uses are semantic and workflow tasks where language reasoning bridges fragmented information: mapping heterogeneous BAS point names to Brick/Haystack schemas (with human validation), answering operator questions grounded in manuals and building documents via RAG, generating and debugging EnergyPlus building models (e.g., expert authoring time cut from 4 hours to 9 minutes in one study), and explaining or tuning physics-based controllers. For high-frequency closed-loop control, sub-second actuation, and short-horizon load forecasting, conventional ML, MPC and RL remain the better-supported choice.

How was this review conducted and can I check its coding?

The authors ran a single reproducible Scopus query (LLM/GPT/RAG terms AND HVAC/building-energy terms; articles, reviews, conference papers; 2023 to 31 March 2026), screening 142 records down to 66 primary studies with a PRISMA flow diagram. Each paper was coded by one reviewer across application family (A1 FDD, A2 forecasting, A3 building energy modelling, A4 control, A5 comfort), method family (M1 prompting/fine-tuning, M2 context-grounded orchestration, M3 multimodal), evidence realism, deployment readiness and responsibility boundary. The complete paper-level coding is published as a supplementary XLSX (66 studies), so the assignments are auditable, though no second-coder reliability statistics are reported.

Why does the review say load forecasting conclusions are weak?

Only three primary-coded studies address energy load forecasting (A2, n=3), all on retrospective field data, which the authors explicitly state is too sparse for subfield-level conclusions. The one direct comparison in the corpus found classical time-series models (PatchTST) outperforming LLM-based approaches at short horizons, with relative performance possibly changing at longer horizons — but with three papers, neither the gap nor any LLM advantage can be established robustly.

About this review

This is an AI-generated preliminary review by Evolve.Pub, produced from the openly available text of the paper. It is not peer review and does not represent the authors' views. The canonical record of the paper is at the publisher link above.

  • The provided text is a sampled excerpt with explicit '[...sampling gap...]' markers; Sections 4.2 and 4.3 (forecasting and BEM detail), the start of Section 6.1, part of Section 6.6 (FW3/FW4), and the tail of the reference list were skipped, so judgements about those parts rely on the visible surrounding text and cross-references only.
  • Per-study outcomes of the five-criterion quality rubric (Table 3) are described but their per-paper results were not visible in the excerpt; the reproReadiness and weakness judgements do not account for that unseen material.
  • The abstract as given ends mid-sentence ('Current ev'), so any abstract-only conclusions beyond that point were not verified against the excerpt.

Go deeper on this paper

Reproduce ResultsNot feasible for this paper — the core results cannot be re-derived by sandboxed code simulation.

Wrote a paper? Stress-test it before reviewers do.

Upload your manuscript for the same structured scrutiny — reasoning, statistics, evidence, figures, and reproducibility.

Scan your paper
Large Language Models for HVAC Operations in Building Energy Systems: A Critical Review of Methods, Applications, and Deployment Readiness | Evolve.Pub