arXiv paper· hardware security for machine learning (edge AI runtime monitoring)· method paper

TERMon: Detecting Persistent Behavioral Threats in Edge AI via Hardware-Native Ternary Runtime Monitor

Arish Sateesan, Edlira Dushku

cs.CR · cs.AI

Quick verdict

Honest FPGA monitor flags behavior-changing weight faults (mean 88.1%) but not OOD/adversarial; solid design, yet single-model evaluation limits generality.

Summary

TERMon is a lightweight hardware runtime monitor that detects behavioral anomalies in edge-AI inference without re-executing or verifying the model. It watches eight scalar features spanning input statistics, intermediate activations, and output confidence, and checks each against per-class trusted ranges learned offline from clean inferences at a 1% false-positive budget. The ranges are encoded as ternary patterns (value plus care-mask) matched in parallel against a thermometer-coded 160-bit fingerprint, so the check reduces to a TCAM-style masked comparison; a two-of-three sequential rule aggregates flags for persistent threats. A PYNQ-Z2 FPGA prototype uses 3,733 LUTs, no block RAM or DSPs, with two-cycle decision latency. On a CIFAR-10 CNN, the ternary encoding reproduces the unquantized range decision exactly. Harmful random weight corruptions (accuracy drops of 49.6-73.7 percentage points) are flagged on 66.5-100% of inferences (mean 88.1%), while benign corruptions stay near the 1.03% clean false-positive rate. The paper is unusually candid about limits: SVHN and CIFAR-10-C shifts are largely missed except contrast corruption, and successful FGSM/PGD examples are essentially undetectable, so no adversarial robustness is claimed. Main limitations: one small CNN, uniformly random faults, three correlated fault trajectories, and feature extraction still running in software.

Review complete

Assessment at a glance

hardware security for machine learning (edge AI runtime monitoring)

5

risk flags identified

● high 0

● medium 2

● low 3

Reproducibility readinessmedium
Code & data availablenot stated
Review confidencehigh
AI text signal0/20 passages flagged
Deep research viableCode-reproducible

5 strengths · 4 weaknesses · 5 author questions

AI text signal = Binoculars zero-shot detector score over 20 sampled passages (Fast-DetectGPT co-reported) — absence does not prove human authorship, and a flag does not imply misconduct.

Levels reflect verification complexity — not a quality score. Evolve never rates your paper.

Key claims under review

  • The thermometer/ternary encoding reproduces the unquantized class-conditional range decision exactly, so the hardware representation adds no detection loss (verified on every evaluated inference, §7.3).
  • TERMon detects weight corruptions in proportion to their behavioral impact: benign flips flag near the 1.03% clean FPR while accuracy-degrading flips (49.6–73.7 pp) flag on 66.5–100% of inferences, mean 88.1% (§7.2).
  • The eight monitored features are insufficient for reliable per-input detection of OOD inputs or successful FGSM/PGD examples at a 1% false-positive operating point — an explicit negative result (§7.4).
  • The monitor is realizable at tiny hardware cost: 3,733 LUTs (7.02% of a Zynq-7020), no BRAM or DSPs, two-cycle decision latency (§6.2).

Strengths

  • Impact-proportional detection is a genuinely useful, well-demonstrated property

    Table 4 (§7.2): benign FP32 corruptions flag at 1.0–1.1% vs 1.03% clean FPR, while harmful ones (Δacc 49.6–73.7 pp) flag at 66.5–100% (mean 88.1%). This contrasts with integrity checks (HASHTAG, RADAR) that flag any weight change regardless of behavioral impact.

  • Clean ablation logic separating encoding limits from feature limits

    §5/§7.3: the ternary test aligns with the unquantized range test on every inference across clean, OOD, and all corrupted sets, and a Mahalanobis reference at matched 1% FPR (66.4% vs 66.5% on faults) attributes misses to features rather than the hardware representation.

  • Deployment-relevant negative results, honestly reported

  • Real hardware artifact with complete implementation data

  • Design-lessons section generalizes beyond this artifact

Weaknesses

  • External validity rests on a single small model and dataset

  • Weak fault model relative to the cited threat

  • Monitor isolation not realized end-to-end in the prototype

  • No uncertainty quantification

Full Review Report

$1.99 · one-time

Unlock the complete preliminary analysis Evolve produced for this paper.

Report preview

Scope & Claims

TERMon (AISec '26) is a hardware runtime monitor for edge-AI inference that checks eight scalar behavioral features — input mean/std, post-ReLU mean and sparsity at Conv1, max activation at FC1, and top-1 probability, top1–2 margin, and entropy at the output (Table 1, §4.1) — against class-conditional trusted ranges learned offline at a 1% false-positive budget (α/2d per tail, Definition 1, §4.2). Ranges map to ternary value/care-mask patterns matched in parallel against a thermometer-coded 160-bit fingerprint (§4.3); a 2-of-3 window aggregates flags for persistent threats (§4.4). The paper claims: (i) exact equivalence of the ternary encoding with the unquantized range decision; (ii) impact-proportional detection of weight faults; (iii) an explicit negative result — OOD and successful adversarial inputs are largely invisible in these features at 1% FPR; and (iv) tiny hardware cost (3,733 LUTs, no BRAM/DSP, two-cycle latency on PYNQ-Z2). Claims are carefully scoped; Table 5's evaluated-vs-effective split is an unusually honest framing for this venue.

The remaining sections cover Methodology Assessment, Statistical Evidence, Results & Reproducibility, Limitations & Risks, and Verdict & Recommendations.

  • All 5 strengths & 4 weaknesses, analyzed in detail
  • 5 risk flags with severity, section & reviewer questions
  • Methods & statistical evidence assessment
  • 5 questions a peer reviewer would ask
  • Full six-dimension evaluation report & recommendations

One-time purchase · this paper only

One-time purchase, this paper only. AI-generated preliminary analysis — not peer review.

Frequently asked questions

What is TERMon and what does it detect?

TERMon is a lightweight FPGA hardware monitor for edge-AI systems. It extracts eight simple statistics from each inference (input mean/std, activation mean/sparsity/max, top-1 probability, top-1/top-2 margin, output entropy) and checks them against per-class ranges learned from clean inferences. It reliably detects weight corruption that actually changes model behavior (e.g., memory bit flips), flagging harmful cases on 66.5–100% of inferences while benign corruption stays near the 1.03% false-positive baseline.

Can TERMon detect adversarial examples or out-of-distribution inputs?

Not reliably, per the authors' own evaluation. At a strict 1% false-positive rate it flags only 13.6% of SVHN inputs, 16.1% of successful PGD examples, and 1.3% of successful FGSM examples. The paper explicitly makes no adversarial-robustness claim and treats per-input OOD detection as out of reach for this feature set; it argues windowed aggregation helps for sustained drift instead.

How much hardware does TERMon require?

The PYNQ-Z2 (Zynq-7020) prototype uses 3,733 LUTs (7.02% of the device) and 6,121 flip-flops, no block RAM and no DSP slices, with a two-cycle decision latency at up to 136 MHz and ~151 mW estimated on-chip power (47 mW dynamic). Configuration data totals 5,760 bits; excluding the AXI-Lite wrapper the core is 2,335 LUTs.

How is TERMon different from checksum-based weight-integrity defenses like HASHTAG or RADAR?

Integrity checks verify that stored weights are unmodified and flag every detected change. TERMon instead observes inference behavior, so it flags only corruptions that actually affect predictions (impact-proportional detection) — useful when recovery is expensive, e.g., satellites — and it can also be evaluated against threats that leave weights intact, such as distribution shift, though its OOD/adversarial detection is weak.

About this review

This is an AI-generated preliminary review by Evolve.Pub, produced from the openly available text of the paper. It is not peer review and does not represent the authors' views. The canonical record of the paper is at the publisher link above.

  • Figures 1–5 were available only as text extraction; chart values (Figure 4/5) were read from embedded labels and could not be visually verified.
  • Tables were extracted as flattened text; Table 4's dense per-cell values were parsed carefully but layout ambiguity is possible.
  • No code or artifact release is mentioned in the text; reproducibility is judged from the method description alone.
  • The text appears complete (references and generative-AI disclosure present); no truncation observed.

Go deeper on this paper

Wrote a paper? Stress-test it before reviewers do.

Upload your manuscript for the same structured scrutiny — reasoning, statistics, evidence, figures, and reproducibility.

Scan your paper
TERMon: Detecting Persistent Behavioral Threats in Edge AI via Hardware-Native Ternary Runtime Monitor | Evolve.Pub