RESEARCH LITERACY / VNS STUDIES

How to read a vagus nerve stimulation study

A study headline can tell you whether a result was positive. It cannot tell you whether the method was reproducible, the comparator credible, the effect precise, or the finding relevant to another device. This guide shows what to check before you carry a result forward.

The practical answer

Four rules before you repeat a study conclusion

01

Name the research question and design before judging the conclusion.

02

Reconstruct the exact population, device, site, protocol and comparator rather than relying on the acronym VNS or taVNS.

03

Read effect estimates, confidence intervals, missing data and harms—not only p values or the word significant.

04

Keep target engagement, physiological markers, meaningful outcomes and product-specific evidence as separate layers.

12-STEP READING FRAMEWORK

Twelve checks before a VNS result becomes a conclusion

Use the same sequence for a randomized trial, mechanistic paper, safety study or systematic review. Some checks carry different weight by design, but none should disappear.

01

Research question and design

Question
What exact question was the study designed to answer?
Why it matters
Mechanism, feasibility, safety and efficacy questions need different designs and outcomes.
Warning sign
The conclusion answers a broader question than the design can support.

02

Participants and setting

Question
Who was studied, where, and under which eligibility rules?
Why it matters
Age, health status, diagnosis, exclusions and setting determine who the result may apply to.
Warning sign
A small healthy-volunteer study is presented as evidence for every user group.

03

Exact intervention and device

Question
Which device, anatomical site, electrode and delivery method were used?
Why it matters
VNS, cervical nVNS and auricular taVNS are method families, not interchangeable products.
Warning sign
The paper uses only an acronym and omits the actual hardware or placement.

04

Stimulation protocol

Question
What frequency, pulse width, waveform, intensity, duty cycle and session exposure were delivered?
Why it matters
Protocol details shape dose, sensation, safety, target engagement and reproducibility.
Warning sign
A result is generalized without the settings needed to reproduce it.

05

Comparator or sham

Question
What did the control group receive, and could it have been biologically active?
Why it matters
A credible control helps separate intervention effects from expectation, attention, sensation and natural change.
Warning sign
The sham is poorly described or may stimulate a relevant site.

06

Randomisation and blinding

Question
How were groups assigned, concealed and kept unaware of allocation?
Why it matters
Randomisation and blinding reduce predictable differences and biased outcome assessment.
Warning sign
The paper says ‘randomized’ but gives no allocation or blinding detail.

07

Outcomes and timing

Question
Which outcome was primary, how was it measured, and when?
Why it matters
Prespecified outcomes and time points reduce selective emphasis on whichever result looks best.
Warning sign
A secondary, subgroup or exploratory result is presented as the main answer.

08

Effect estimate and uncertainty

Question
How large was the difference, and how precise was the estimate?
Why it matters
Effect sizes and confidence intervals show magnitude and uncertainty that a p value alone cannot show.
Warning sign
Statistical significance is treated as proof of a meaningful or certain benefit.

09

Missing data and analysis

Question
Who entered the analysis, who dropped out, and how were missing data handled?
Why it matters
Attrition and analysis choices can change the observed effect and the population the result represents.
Warning sign
Only completers are analysed without explaining the consequences.

10

Harms and tolerability

Question
How were adverse events defined, collected, compared and linked to discontinuation?
Why it matters
Benefit claims are incomplete without the tested safety exposure and quality of harms reporting.
Warning sign
‘Well tolerated’ appears without denominators, severity or control-group data.

11

Registration, bias and interests

Question
Was the study registered, were plans accessible, and who funded or influenced it?
Why it matters
Protocols, analysis plans and conflicts help readers detect selective changes and interpret incentives.
Warning sign
Outcomes changed after the study began or conflicts are unclear.

12

Applicability and evidence transfer

Question
Does this exact device, protocol, population and intended use match the new claim?
Why it matters
Generalisation must be argued from similarity, not assumed from the words VNS or taVNS.
Warning sign
Field-level evidence is presented as proof for another product or use case.

1 / START WITH THE QUESTION

Study design tells you what kind of answer is possible

Begin with the research question, not the abstract conclusion. A mechanistic study can show that a pathway or marker changed. A feasibility study can show that a procedure was workable. A safety study can describe adverse events at a tested exposure. A randomized trial can estimate a between-group effect. Those answers are useful, but they are not interchangeable.

Common designs in the VNS literature
DesignWhat it can help answerWhat to inspectWhat it cannot establish alone
Randomized parallel trialWhether outcomes differ between assigned groupsAllocation, concealment, blinding, prespecified outcomes, missing dataUniversal effectiveness or relevance to another protocol
Crossover trialWithin-person differences between conditionsSequence, washout, carryover, period effects, blindingLong-term effects without suitable follow-up
Mechanistic or neuroimaging studyWhether stimulation changes a proposed pathway or physiological signalTiming, site, control, signal definition, multiplicityClinical or everyday benefit
Safety or tolerability studyWhich events occurred at a tested exposureCollection method, denominators, severity, causality, discontinuationEfficacy or safety outside the tested population and dose
Systematic review or meta-analysisWhat a defined body of studies shows togetherSearch, eligibility, risk of bias, compatibility, missing evidenceQuality beyond the included studies or product equivalence

2 / RECONSTRUCT WHAT WAS TESTED

Name the population, device, site and full stimulation exposure

The label taVNS is not a complete intervention description. Readers need the participant group, exact device, electrode, anatomical site, side of stimulation, waveform and total exposure. Farmer and colleagues proposed tVNS-specific minimum reporting standards because incomplete method descriptions prevent replication and responsible comparison.

  1. Define the population: age, health or diagnosis, baseline severity, setting, exclusions and sample size.
  2. Identify the exact hardware and software: manufacturer, model, electrode, coupling medium, channel and control interface.
  3. Locate stimulation precisely: cervical or auricular, left or right, named ear region, active and reference electrode positions.
  4. Reconstruct dose: current or intensity rule, frequency, pulse width, waveform, duty cycle, ramping, session duration, number of sessions and follow-up.
  5. Check what was actually delivered, not only what the protocol planned, including adherence, modifications and fidelity.
Protocol details that should remain visible
DomainExamplesWhy it changes interpretation
Anatomy and contactNeck or ear site, side, electrode geometry, skin preparationChanges current paths, sensation and the assumed neural target
Electrical parametersFrequency, pulse width, waveform, amplitude or titration ruleChanges delivered charge, comfort and physiological response
ExposureOn/off cycle, session duration, schedule, total sessionsChanges cumulative dose and the time window for benefits or harms
Delivery and fidelityOperator, app, training, adherence, actual settingsShows whether participants received the planned intervention
Co-interventionsMedication, therapy, usual care, lifestyle changesCan create or obscure differences between groups

3 / WHAT WAS THE COUNTERFACTUAL?

A sham condition is part of the intervention question, not a footnote

A controlled study estimates a difference between conditions. The interpretation therefore depends on what the comparison group experienced. In electrical stimulation research, sham may imitate contact, sound, attention or sensation, but it can also produce somatic or physiological effects. ‘Sham-controlled’ is not enough detail by itself.

CREDIBILITY

Could participants tell the groups apart?

Compare sensations, device appearance, session contact and guesses about allocation. Blinding can fail even when the protocol says double-blind.

BIOLOGICAL ACTIVITY

Could the control influence a relevant pathway?

Low intensity, another ear site or brief stimulation may be less active, but biological inactivity should not simply be assumed.

EQUAL ATTENTION

Did both groups receive the same contact and co-interventions?

Differences in staff attention, app guidance, expectation or usual care can contribute to observed outcomes.

ANALYSIS

Was blinding success examined without overinterpreting it?

Allocation guesses can be informative, but they are influenced by both sensations and whether a participant improved.

4 / READ THE NUMBER, NOT ONLY THE LABEL

Primary outcomes, effect sizes and uncertainty matter more than the word positive

Definition

Primary outcome

The outcome intended to answer the main research question, ideally prespecified with a defined measure, time point and analysis.

Definition

Effect estimate

The measured difference, ratio or change used to describe the magnitude and direction of the observed effect.

Definition

Confidence interval

A range showing the precision of the estimate under the statistical model. A wide interval can include materially different conclusions.

A p value addresses compatibility with a statistical model under a null hypothesis. It does not tell you whether an effect is large, useful, precise, unbiased or relevant to a new product. Read the estimate, interval, units, baseline risk and outcome scale together.

Read each result in four layers
LayerQuestionCommon error
OutcomeWas this primary, secondary, exploratory or post hoc?Promoting an exploratory signal to the main conclusion
MagnitudeHow large was the absolute and relative difference?Using only percentage change or a p value
PrecisionWhat range of effects remains compatible with the data?Treating a wide interval as a settled estimate
MeaningWould the difference matter to participants or decisions?Equating statistical significance with practical importance

5 / KEEP THE EVIDENCE LAYERS SEPARATE

Target engagement, biomarkers and clinical outcomes answer different questions

Target engagement asks whether an intervention affected its predicted target. A biomarker or imaging response may support that question. A clinical or lived-experience outcome asks whether participants improved in a meaningful way. One layer can strengthen a mechanistic argument without proving the next layer.

DELIVERY

The device delivered stimulation

Electrical output, contact or perceived sensation can confirm delivery conditions, but not selective neural engagement.

TARGET

The intended target was affected

A prespecified, credible measure should show the predicted change in a molecular, neural, physiological or behavioral target.

MEDIATION

Target change related to the outcome

A stronger causal chain tests whether change in the target is associated with or mediates change in the meaningful outcome.

OUTCOME

Participants experienced a relevant benefit

The outcome should be suitable, prespecified, measured at an appropriate time and interpreted with effect size and uncertainty.

6 / LOOK FOR WHAT COULD DISTORT THE RESULT

Bias, missing data and harms reporting can change the conclusion

Risk of bias is not a general impression of whether a paper looks scientific. It asks whether features of the design, conduct, analysis or reporting could systematically move the result away from the truth. RoB 2 organizes this for randomized trials across randomisation, deviations from intended interventions, missing outcomes, outcome measurement and selection of the reported result.

  1. Compare the trial registry, protocol or analysis plan with the published outcomes and analyses.
  2. Check whether allocation was concealed and whether baseline differences suggest a problem with randomisation.
  3. Identify deviations from the assigned intervention and whether analyses matched the effect the study intended to estimate.
  4. Count missing outcomes and compare dropout reasons between groups; do not rely only on the percentage who completed.
  5. Ask whether outcome assessors could be influenced by knowledge of allocation or by participant expectations.
  6. Check whether harms were actively solicited, defined, timed, graded and reported with group denominators and discontinuations.
  7. Read funding, device supply, author conflicts, data access and the role of the sponsor without assuming that disclosure alone resolves bias.

7 / MOVE FROM ONE PAPER TO THE BODY OF EVIDENCE

A systematic review is a method; a meta-analysis is a calculation; certainty is a judgment

A systematic review uses explicit methods to identify, select and appraise relevant studies. A meta-analysis statistically combines compatible effect estimates. A review may use narrative synthesis instead when studies are too different. Neither label guarantees that the underlying evidence is complete, unbiased or directly applicable.

Do not collapse these evidence concepts
ConceptWhat it describesWhat to inspect
Systematic reviewA transparent method for finding and synthesising a defined body of evidenceQuestion, search, eligibility, duplicate processes, risk of bias, missing evidence
Meta-analysisA statistical summary of compatible study resultsEffect measure, model, heterogeneity, weighting, sensitivity analyses, small-study effects
Certainty of evidenceConfidence in an effect estimate across a body of evidence for a defined outcomeRisk of bias, inconsistency, indirectness, imprecision and publication bias
RecommendationA judgment that also considers benefits, harms, values, resources and contextWho made it, for which population, and with what strength and certainty

8 / DECIDE WHAT THE STUDY CAN TRAVEL TO

Evidence transfer requires a defensible bridge from study to claim

The last step is not ‘Was the study positive?’ It is ‘What exactly can this result support?’ Applicability depends on the match between participants, intervention, comparator, outcome, setting and follow-up. Product transfer adds another layer: hardware, placement, protocol, intended use and regulatory context should be relevant to the new device and claim.

  • A finding from implanted VNS does not automatically support cervical or auricular non-invasive stimulation.
  • A finding from one taVNS device or ear site does not automatically support another electrode, waveform or dose.
  • A physiological or imaging response does not automatically support a symptom or wellness claim.
  • A clinical population and indication do not automatically support general wellness use in healthy consumers.
  • A field-level review can map the category while still providing no product-specific evidence for Neuvago.
  • A negative or inconclusive study can be informative about the target, protocol, comparator, measurement or limits of the hypothesis.

Worked examples

Four studies, four different evidence questions

Use the same reading framework while keeping the design-specific lesson visible.

MECHANISM / HUMAN fMRINeuroimaging study

Frangos et al. 2015

The study examined brain responses during electrical stimulation at an external-ear location associated with auricular vagal pathways.

Reading lesson

Read it for pathway and target-engagement context. Do not relabel an imaging response as proof of symptom improvement or of another device’s effect.

Open study summary
SAFETY / EVIDENCE SYNTHESISSystematic review and meta-analysis

Kim et al. 2022

The review synthesised adverse-event reporting across human taVNS studies and assessed the wider safety literature.

Reading lesson

Read the pooled safety picture together with protocol variation, inconsistent event collection, study exclusions and the tested exposure window.

Open study summary
PHYSIOLOGY / HRVSystematic review

Soltani et al. 2023

The review assessed taVNS studies measuring heart rate variability and highlighted variation in protocols and HRV methods.

Reading lesson

Read HRV as a physiological outcome with methodological limits. It is not automatically target engagement, clinical benefit or a product claim.

Open study summary
CLINICAL OUTCOMES / SLEEPSystematic review and meta-analysis

de Oliveira et al. 2025

The review combined a small clinical evidence base on taVNS and insomnia-related outcomes.

Reading lesson

Read pooled findings together with certainty of evidence, study quality, protocol compatibility and the distinction between the tested devices and a consumer wellness product.

Open study summary

PRACTICAL APPRAISAL

A reusable 12-point VNS study checklist

Record what is reported, what remains unclear, and whether each limitation changes the claim you are willing to repeat.

Check 01

Research question and design

What exact question was the study designed to answer?

Check 02

Participants and setting

Who was studied, where, and under which eligibility rules?

Check 03

Exact intervention and device

Which device, anatomical site, electrode and delivery method were used?

Check 04

Stimulation protocol

What frequency, pulse width, waveform, intensity, duty cycle and session exposure were delivered?

Check 05

Comparator or sham

What did the control group receive, and could it have been biologically active?

Check 06

Randomisation and blinding

How were groups assigned, concealed and kept unaware of allocation?

Check 07

Outcomes and timing

Which outcome was primary, how was it measured, and when?

Check 08

Effect estimate and uncertainty

How large was the difference, and how precise was the estimate?

Check 09

Missing data and analysis

Who entered the analysis, who dropped out, and how were missing data handled?

Check 10

Harms and tolerability

How were adverse events defined, collected, compared and linked to discontinuation?

Check 11

Registration, bias and interests

Was the study registered, were plans accessible, and who funded or influenced it?

Check 12

Applicability and evidence transfer

Does this exact device, protocol, population and intended use match the new claim?

Frequently asked questions

Research labels do not remove the need for interpretation

Does randomized mean the result is definitive?

No. Randomisation can reduce confounding, but reliability still depends on allocation concealment, blinding where feasible, protocol fidelity, outcome measurement, missing data, analysis choices, sample size and selective reporting.

Does p < 0.05 prove that a VNS intervention works?

No. A p value does not show effect size, precision, practical importance, bias or applicability. Read the estimate and confidence interval, the prespecified outcome, the comparison used and the wider evidence.

Is a meta-analysis automatically the strongest evidence?

No. A meta-analysis is a statistical synthesis. Its value depends on the review methods, risk of bias, compatibility of studies, missing evidence, model choices and certainty of evidence for each outcome.

Can a sham condition be biologically active?

Yes. Electrical stimulation at low intensity or another site can create sensation and may influence somatic or physiological pathways. The sham must be described and its credibility and possible activity considered.

Does a change in HRV or fMRI prove a meaningful benefit?

No. HRV and fMRI can provide physiological or mechanistic information. They do not automatically establish target engagement, symptom improvement, clinical importance or a product-specific benefit.

Can a taVNS study be used as proof for Neuvago?

Only if a defensible product-specific bridge exists. The exact device, electrode, placement, protocol, population, intended use and outcome must be relevant. General field research remains educational context unless that bridge is documented.

Source basis

Reporting standards and methods used for this guide

Reporting guideline2025

CONSORT 2025 statement: updated guideline for reporting randomised trials

Hopewell S, Chan A-W, Collins GS, et al.

BMJ

Current reporting standard for randomised trials, including registration, protocols, harms, missing data, intervention delivery and limitations.

DOI: 10.1136/bmj-2024-081123

Open source
Reporting guideline2025

CONSORT 2025 explanation and elaboration: updated guideline for reporting randomised trials

Hopewell S, Chan A-W, Collins GS, et al.

BMJ

Explains why complete reporting is necessary before readers can judge the reliability and validity of a trial.

DOI: 10.1136/bmj-2024-081124

Open source
Systematic-review guidance2021

The PRISMA 2020 statement: an updated guideline for reporting systematic reviews

Page MJ, McKenzie JE, Bossuyt PM, et al.

BMJ / PRISMA Executive

Reporting framework for systematic reviews, including search, selection, synthesis and transparent flow of included evidence.

DOI: 10.1136/bmj.n71

Open source
Systematic-review guidance2025

Cochrane Handbook for Systematic Reviews of Interventions, version 6.5 with 6.5.1 corrections

Higgins JPT, Thomas J, Chandler J, et al., editors

Cochrane

Methods reference for effect measures, heterogeneity, missing evidence, meta-analysis and interpretation of intervention evidence.

Open source
Risk-of-bias tool2019

RoB 2: a revised tool for assessing risk of bias in randomised trials

Sterne JAC, Savović J, Page MJ, et al.

BMJ / Risk of Bias tools

Structured assessment of bias arising from randomisation, deviations, missing outcomes, outcome measurement and selective reporting.

DOI: 10.1136/bmj.l4898

Open source
Evidence framework2024

GRADE Book: official guidance for assessing certainty of evidence

GRADE Working Group

GRADE Working Group

Living official resource for judging confidence in an effect estimate across a body of evidence; chapters are being added and unreplaced sections still refer readers to the original GRADE Handbook.

Open source
Methods paper2021

International consensus based review and recommendations for minimum reporting standards in research on transcutaneous vagus nerve stimulation (version 2020)

Farmer AD, Strzelczyk A, Finisguerra A, et al.

Frontiers in Human Neuroscience

tVNS-specific reporting recommendations for anatomy, device, electrodes, parameters, controls, participants, outcomes and safety.

DOI: 10.3389/fnhum.2020.568051

PMID: 33854421

Open source
Methods paper2014

Better reporting of interventions: template for intervention description and replication (TIDieR) checklist and guide

Hoffmann TC, Glasziou PP, Boutron I, et al.

BMJ

Shows why intervention and comparator details must be complete enough for replication, including dose, delivery, tailoring and fidelity.

DOI: 10.1136/bmj.g1687

PMID: 24609605

Open source
Official guidance2013

NIMH’s New Focus in Clinical Trials

National Institute of Mental Health

National Institute of Mental Health

Defines target engagement as verification that an intervention affected its predicted target and keeps that question separate from clinical outcomes.

Open source

Continue reading

Move between methods, studies and definitions

Research hub

Start with the wider Neuvago evidence layer and its boundaries.

Open research hub

Scientific studies library

Apply the framework to individual VNS, taVNS, HRV, safety and sleep papers.

Browse studies

VNS research overview

Place one paper inside the broader implanted and non-invasive VNS field.

Explore VNS research

Transcutaneous VNS research

Review tVNS and taVNS protocol variables, controls and target-engagement limits.

Explore tVNS research

Auricular VNS research

Connect study interpretation with outer-ear anatomy, electrodes, sham and placement.

Explore auricular research

Safety and tolerability

Read adverse-event evidence with exposure, exclusions and reporting quality visible.

Review safety research

Randomized controlled trial

Use the glossary definition before interpreting trial labels.

Open definition

Systematic review

Distinguish a transparent review method from a general narrative overview.

Open definition

Meta-analysis

Understand pooling, heterogeneity and why precision can be misleading.

Open definition

Certainty of evidence

Separate confidence in a body of evidence from the design label of one paper.

Open definition

Sham stimulation

Review why a control condition can affect both blinding and physiology.

Open definition

Target engagement

Keep target verification separate from clinical and wellness outcomes.

Open definition

Research principle

A better reading process produces narrower, stronger claims

The goal is not to distrust every study. It is to identify the exact question, method, estimate and boundary before evidence is carried into another context.