A comprehensive item bank of internal validity issues of relevance to in vitro toxicology studies
Methods
We derived the item bank from seven literature sources (one existing item bank created from a systematic review of assessment criteria for in vitro studies, and six purposively sampled study appraisal tools) and the transcripts of three focus groups. Assessment criteria plausibly relating to internal validity were abstracted from the literature sources and focus group transcripts, disaggregated into individual criteria, then normalised to express in the simplest achievable language the core issue in each criterion – an “item bank” of assessment concepts. The items were then mapped onto a set of bias domains. We conducted simple descriptive statistical analyses and visualisations to describe patterns in the dataset and developed recommendations for the use and development of the item bank.
Results
The item bank contains 405 items of potential relevance to evaluating the internal validity of in vitro toxicology studies.
Discussion
To our knowledge, this is the second item bank of any kind to have been created for toxicology studies, and the first to use focus groups as a data source alongside literature analysis. The large number of items contributed by focus group discussions suggests this is an efficient method for capturing internal validity issues that are not easily identifiable in the literature. We believe our item bank and methodology for its creation will be a useful resource for supporting the development of appraisal tools. Due to the broad applicability of many items in the item bank, it may be informative for study designs beyond the in vitro domain.