Skip to main content
U.S. flag

An official website of the United States government

Here’s how you know

Dot gov

Official websites use .gov
A .gov website belongs to an official government organization in the United States.

HTTPS

Secure .gov websites use HTTPS
A lock ( Lock A locked padlock ) or https:// means you’ve safely connected to the .gov website. Share sensitive information only on official, secure websites.

  • Environmental Topics
  • Laws & Regulations
  • Report a Violation
  • About EPA
Risk Assessment
Contact Us

Evaluating the consistency of heterogeneous results: important determinants of inconsistency in epidemiological evidence

On this page:

  • Overview
The examples of using sensitivity analysis to evaluate inconsistency in evidence will be presented in a poster to illustrate the value of analyzing the impact of bias and other aspects of studies that could influence the magnitude and direction of associations with health effects in epidemiological studies. The consistency of a set of results is examined via forest plots presenting effect estimates (e.g., risk ratios, odds ratios) stratified by ratings for the domains that comprise the IRIS study evaluation tool including participant selection, exposure, outcome, confounding, analysis and sensitivity. Additional factors are analyzed including exposure (low vs high) and overall study confidence. The case examples include studies from a variety of exposure settings (i.e., population-based and occupational studies) that appear to have considerable heterogeneity across studies for specific outcomes. However, when the effect estimates are stratified by exposure level and setting, and overall confidence in the exposure-outcome association, a more consistent pattern emerges.

Impact/Purpose

The evidence on associations of health effects with chemical exposures that have an extensive research history often includes studies with heterogeneous results, complicating the ability to draw conclusions about whether a hazard is indicated. This case study discusses the impact of bias and other aspects of studies that could influence associations with health effects, and illustrates an approach to analyzing their impact using examples from systematic reviews conducted in the IRIS Program. While the specific determinants may vary, sensitivity analyses that examine potential determinants of heterogeneity in study results are essential to analyses of evidence consistency as part of the integration of evidence in systematic reviews.

Citation

Glenn, B., E. RadkeFarabaugh, AND A. Kraft. Evaluating the consistency of heterogeneous results: important determinants of inconsistency in epidemiological evidence. NAS Evidence Integration Workshop, District of Columbia, Washington, June 03 - 04, 2019.
  • Risk Assessment Home
  • About Risk Assessment
  • Risk Recent Additions
  • Human Health Risk Assessment
  • Ecological Risk Assessment
  • Risk Advanced Search
    • Risk Publications
  • Risk Assessment Guidance
  • Risk Tools and Databases
  • Superfund Risk Assessment
  • Where you live
Contact Us to ask a question, provide feedback, or report a problem.
Last updated on June 16, 2021
United States Environmental Protection Agency

Discover.

  • Accessibility Statement
  • Budget & Performance
  • Contracting
  • EPA www Web Snapshots
  • Grants
  • No FEAR Act Data
  • Privacy
  • Privacy and Security Notice

Connect.

  • Data
  • Inspector General
  • Jobs
  • Newsroom
  • Open Government
  • Regulations.gov
  • Subscribe
  • USA.gov
  • White House

Ask.

  • Contact EPA
  • EPA Disclaimers
  • Hotlines
  • FOIA Requests
  • Frequent Questions

Follow.