Skip to main content
Download PDF

Trial registration and selective outcome reporting in 585 clinical trials investigating drugs for prevention of postoperative nausea and vomiting

BMC Anesthesiology volume 21, Article number: 249 (2021) Cite this article

Abstract

Background

Selective outcome reporting in clinical trials introduces bias in the body of evidence distorting clinical decision making. Trial registration aims to prevent this bias and is suggested by the International Committee of Medical Journal Editors (ICMJE) since 2004.

Methods

The 585 randomized controlled trials (RCTs) published between 1965 and 2017 that were included in a recently published Cochrane review on antiemetic drugs for prevention of postoperative nausea and vomiting were selected. In a retrospective study, we assessed trial registration and selective outcome reporting by comparing study publications with their registered protocols according to the ‘Cochrane Risk of bias’ assessment tool 1.0.

Results

In the Cochrane review, the first study which referred to a registered trial protocol was published in 2004. Of all 585 trials included in the Cochrane review, 334 RCTs were published in 2004 or later, of which only 22% (75/334) were registered. Among the registered trials, 36% (27/75) were pro- and 64% (48/75) were retrospectively registered. 41% (11/27) of the prospectively registered trials were free of selective outcome reporting bias, 22% (6/27) were incompletely registered and assessed as unclear risk, and 37% (10/27) were assessed as high risk. Major outcome discrepancies between registered and published high risk trials were a change from the registered primary to a published secondary outcome (32%), a new primary outcome (26%), and different outcome assessment times (26%). Among trials with high risk of selective outcome reporting 80% favoured at least one statistically significant result. Registered trials were assessed more often as ‘overall low risk of bias’ compared to non-registered trials (64% vs 28%).

Conclusions

In 2017, 13 years after the ICMJE declared prospective protocol registration a necessity for reliable clinical studies, the frequency and quality of trial registration in the field of PONV is very poor. Selective outcome reporting reduces trustworthiness in findings of clinical trials. Investigators and clinicians should be aware that only following a properly registered protocol and transparently reporting of predefined outcomes, regardless of the direction and significance of the result, will ultimately strengthen the body of evidence in the field of PONV research in the future.

Peer Review reports

Background

It is imperative to report results of clinical research on patients transparently, completely and not selectively. Non-publication of trials and selective reporting of outcome results, termed as publication bias [1] and selective reporting bias [2], respectively, can distort the evidence available for clinical decision making.

A cornerstone in ensuring transparency of clinical research and accountability in the planning, conduct and reporting of clinical trials is the introduction of trial registers [3]. Prospective registration of trials, which means registration before enrolment of patients, can protect not only against non-publication of trials, but also against selective reporting of outcome results. Selective decisions on outcome reporting are frequently driven by the statistical significance of outcome results and can lead to a change, introduction, or omission of at least one primary outcome [4]. Selective reporting of outcomes in published clinical trials occurred in 40 to 62% of studies [5].

Another crucial step towards improving transparency is provided by the International Committee of Medical Journal Editors (ICMJE), which has announced in 2004 that journals should require, as a precondition of publication, prospective registration in a public trials registry [6]. The full advantages of registration can only be achieved when trials are fully registered including all 20 items recommended in the WHO Minimum Trial Registration Data Set [7]. Finally, the AllTrials initiative (All Trials Registered | All Results Reported) was launched in January 2013 to draw attention to the issue of unreported trial data. It calls for all past and present clinical trials to be registered and their results reported (http://www.alltrials.net).

Despite all these movements towards complete transparency in registering and reporting of clinical studies, Al-Durra et al. showed that among all RCTs published in PubMed indexed journals in 2018 and registered in any WHO trial registry only 42% complied with prospective trial registration [8]. Trials in anaesthesiology research are registered less often and mostly inadequate, i.e. after the first patient was enrolled into the study and without a clearly defined primary outcome [9]. To the best of our knowledge, there is no large study investigating trial registration and selective outcome reporting in trials published in a specific field of clinical anaesthesia research in a broad range of different journals.

In this study, we analysed the 585 RCTs included in the recently published Cochrane review on drugs for prevention of postoperative nausea and vomiting (PONV) [10, 11] in terms of trial registration and selective outcome reporting. The underlying Cochrane Review was performed by the same study group that conducted this study. We aim to identify current limitations in trial registration and reporting of outcomes in PONV trials and to draw attention of clinical trial authors to these important issues when planning and conducting their future studies.

Methods

This retrospective study was part of a recently published Cochrane systematic review with network meta-analysis on antiemetic drugs that was registered in the Cochrane Database of Systematic Reviews [10, 11], (PROSPERO CRD42017083360). This study examines the identical study set as included in the Cochrane systematic review.

Eligibility criteria for article selection and information sources

The Cochrane review included RCTs that were reported as full-text publication in any journal or as comprehensive clinical study report, published in any language. Studies investigated adult participants undergoing any type of surgery with general anaesthesia; and compared single or multiple pharmacological intervention(s) with antiemetic action belonging to one of the six drug classes (5-HT3 receptor antagonists, D2 receptor antagonists, NK1 receptor antagonists, corticosteroids, antihistamines (histamine 1 receptor antagonists), and anticholinergics) versus each other, versus no treatment, or versus placebo.

We searched the Cochrane Central Register of Controlled Trials (CENTRAL), MEDLINE, Embase, CINAHL, study registers (ClinicalTrials.gov, WHO ICTRP), and the reference lists of relevant systematic reviews for eligible trials in November 2017. Details of the search strategy are provided in the Cochrane review [10, 11].

Study selection and data extraction

The review team independently, and in duplicate, assessed trials for inclusion and extracted data. In brief and relevant for this study on selective outcome reporting, we extracted the trial registration number, the start (date of first participant’s enrolment) and duration of the study, and study’s outcomes with details. We have defined a primary outcome as that which was explicitly reported as such in the published article or the clinical study report. If none was explicitly reported, we used the outcome chosen for the sample size calculation. If none was identified this way, the study was assessed as not evaluable for analysis of selective outcome reporting. Furthermore, information on the funding source, the number of involved centres, and the study location was extracted.

Assessing trial registration

All trials reporting a registration number in the published article were deemed as registered. To identify additional registered trials that were unpublished yet or registered trial protocols that were not referenced in the published study, we manually compared the search results of the registries with the electronic database search of published studies. To assess whether trial registration occurred pro- or retrospectively we compared the reported date of first participant’s enrolment (in some registers called “study start”) and the date of trial registration (in some registers called “first posted”). If the date of trial registration was before or at the same date of first participant’s enrolment, the trial was deemed as prospectively registered, otherwise as retrospectively.

Assessment of the journals policies

We systematically examined in August 2020 (day of assessment) whether the journals having published an eligible trial followed the ICMJE recommendation that clinical trials should be prospectively registered in a trial register. The date of incorporation the ICMJE recommendation in the editorial policy was determined based on the list date reported on the ICMJE website (http://www.icmje.org/journals-following-the-icmje-recommendations/). If the journal was not listed there, the “Instructions for authors” on the journals’ homepage were checked for any information and dates. If there was no information available, we assumed that following the ICMJE recommendation is not a prerequisite for publication in this journal. We compared the list date of adopting the ICMJE recommendation in the journal’s policy with the publication date and the registration status of the trial to assess whether adopting this recommendation increased the number of prospective registrations. We limited this comparisons to the trials published between 2004 and 2017, the time in which trial registration of eligible studies occurred.

Risk of bias

In the course of the Cochrane review, we assessed the study’s risk of bias using the Cochrane ‘Risk of bias’ assessment tool 1.0. The Cochrane risk of bias domains includes sequence generation, allocation concealment, blinding of participants and personnel, blinding of outcome assessment, incomplete outcome data, selective outcome reporting and ‘other issues’. As detailed in the Cochrane review, the overall risk of bias for each study was assessed by reference to the judgements of the domains ‘sequence generation’, ‘blinding of participant, personnel, and outcome assessors’, and ‘incomplete outcome data’. For the current study, we used and reported in detail the results of the domain ‘selective outcome reporting’.

Selective outcome reporting

Prospective trial registration was the basis for the risk assessment of selective reporting of outcome results. All non-registered and retrospectively registered trials were assessed as ‘unclear risk’ of selective outcome reporting bias. In all prospectively registered trials, we compared the type and order of outcomes (primary versus secondary) and the times of assessments reported in the trial protocol along with the published outcomes. We used the information on outcomes provided in the latest protocol version. As part of the Cochrane risk of bias assessment, we considered selective outcome reporting as ‘low risk of bias’ if a prospectively registered trial protocol was available and the primary outcome was clearly described and reported in the published trial as pre-specified in the protocol. We judged selective outcome reporting as ‘high risk of bias’ if at least one of the predefined primary outcomes in the registered protocol differed from those in the published study report.

Studies labelled as ‘high risk of bias’ for selective outcome reporting were further investigated for major discrepancies between the registered and published outcomes according to Chan et al. [4] and Mathieu et al. [12]:

  1. 1.

    The registered primary outcome was reported as a secondary outcome in the published article.

  2. 2.

    The registered primary outcome was omitted in the published report.

  3. 3.

    A new primary outcome was introduced in the published article.

  4. 4.

    The published primary outcome was registered as a secondary outcome.

  5. 5.

    The timing of assessment of the registered and published primary outcomes differed.

All prospectively registered trials with major outcome discrepancies (high risk trials) were investigated according to statistical significance of the results [4, 12]. We considered results of the primary outcomes as statistically significant if they reached a significance level of p ≤ 0.05 or if they were declared as such by the authors of the published article. If the published study did not provide any information on statistical significance of the primary outcome result, the discrepancy was described as not evaluable. Discrepancies were considered to favour statistically significant results, if:

  1. 1.

    a new statistically significant primary outcome was introduced in the published article, or

  2. 2.

    a non-significant registered primary outcome was defined as non-primary in the published article or omitted.

Statistical analysis

We calculated median and interquartile ranges (IQR) for continuous variables, and presented absolute and relative frequencies for categorical variables, including overall risk of bias, funding source, and the study location. We used the Pearson’s Chi-squared test when considering single independent variables. P ≤ 0.05 was considered statistically significant. Statistical analyses and graphs were produced using RStudio (Integrated Development for R. PBC, Boston, MA).

Results

A total of 585 RCTs on antiemetic drugs were included and referenced in the Cochrane review [10, 11]. Of these 585 trials, 75 were registered at a clinical study registry (Supplementary File 1 and 2); 58 registered trials have referenced a trial registration number in the journal publication, 11 trials have not referenced any registration number [13,14,15,16,17,18,19,20,21,22,23], and six trials without a full text journal publication have reported results in the trial register or a clinical study report [24,25,26,27,28,29] (Supplementary File 3). Considering all trial protocols, 83 registrations at 11 different registries were retrieved, taking into account that eight RCTs were registered twice at different registries (Supplementary File 3). The majority of the trials were registered at ClinicalTrials.gov (50/83) followed by the EU Clinical Trials Register (11/83).

Among the 75 registered trials, 36% (27/75) were prospectively and 64% (48/75) retrospectively registered (Supplementary File 3).

Trials of the Cochrane review were published between 1965 and 2017 (Fig. 1a). From 1996 onwards, more than 15 trials have been published annually. The first trial [30] was registered in 2002 and published in 2004. After 2004, the number of registered studies increased over time, with the number of retrospective registrations increasing more than prospective registrations (Fig. 1b). We used the study pool from 2004 to 2017 for further analyses as study authors were less familiar with trial registration before 2004.

Fig. 1
figure 1

Annual numbers of publications of all included trials (n = 585) from 1965 to 2017 (a) and of all registered trials (n = 75) from 2004 to 2017 (b). The first registered trial was published in 2004

Full size image

The proportion of registered trials among all trials published from 2004 onwards, the time of announcing trial registration as an important prerequisite for publication by the ICMJE, amounts to 22% (75/334) with 8% (27/334) prospective registrations.

Sixty-three percent (47/75) of the registered trials compared to 49% (127/259) of the non-registered trials (2004 to 2017) were published in journals that follow the ICMJE policy of prospective trial registration at the day of assessment (p = 0.051; Chi2 = 3.802, df = 1). Of the 47 registered trials published in journals that follow the ICMJE recommendation, half of the trials were published before (24/47) and the other half (23/47) after the date the ICMJE recommendation was included in the editorial policies (Supplementary File 4). In contrast, the majority of non-registered trials (120/127) was published before the journals included the ICMJE recommendation. The ICMJE recommendation was included on average two years earlier in the policies of journals publishing registered trials (2014 (IQR 2010 to 2017)) compared to journals publishing non-registered trials (2016 (IQR 2014 to 2018)). Among the registered trials published in journals that follow the ICMJE policy, the proportion of prospective registrations increased from 25% (6/24) prior to the date of adopting the ICMJE recommendation by the journal to 48% (11/23) after adopting (Supplementary File 4).

Selective outcome reporting bias could be evaluated for prospectively registered trials only. Non-registered (259/334) and retrospectively (48/334) registered trials were assessed as unclear risk of selective outcome reporting bias. Of the 27 prospectively registered trials, 41% (11/27) were assessed as ‘low risk’ of selective outcome reporting bias (Supplementary File 3). About one-fifth of the trials (6/27) were assessed as unclear risk of bias due to missing information on outcomes (Supplementary File 3). The remaining 37% of trials (10/27) were assessed as ‘high risk’ of selective outcome reporting bias and were subject to further assessment on the type of major outcome discrepancies between the trial protocol and the publication (Table 1). The 10 ‘high risk’ studies contained a total of 19 major discrepancies (Table 1, Supplementary File 5). About one third (6/19) of all major discrepancies appeared as a switch of the registered primary outcome into a reported secondary outcome in the published articles. In 26% of studies, a new primary outcome was introduced in the published article (5/19) or the timing of assessment of the registered and published primary outcomes differed (5/19). Two trials omitted the registered primary outcome in the published article. Upgrading from a secondary outcome in the protocol to a primary outcome in the published article occurred only once.

Table 1 Discrepancies of registered and reported (published) outcomes
Full size table

Fifteen out of 19 major discrepancies could be evaluated regarding a relation to the statistical significance of the result (Table 1, Supplementary File 3 and 5). Altogether, 12 out of 15 evaluable discrepancies favoured a statistically significant outcome result. With respect to all trials with ‘high risk of bias’ for selective outcome reporting, 80% (8/10) favoured at least one statistically significant result.

We set out to compare registered and non-registered trials in terms of their ‘overall risk of bias’ assessed with the Cochrane Risk of Bias assessment tool, their source of funding, and their geographical location of the study conduct.

The proportion of trials rated as overall low, unclear or high risk of bias according to the Cochrane Risk of Bias assessment was different in registered and non-registered trials published between 2004 and 2017 (p < 0.001; Chi2 = 33.894, df = 2). Registered trials were more often assessed as ‘overall low risk of bias’ compared to non-registered trials (64% vs. 28%) (Fig. 2a). In contrast, non-registered trials were more frequently assessed as ‘overall unclear risk of bias’ (53% vs. 23%). No difference was detectable in the distribution of the ‘overall risk of bias’ assessment between pro- and retrospectively registered trials (p = 0.80; Chi2 = 0.44, df = 2) (Fig. 2b).

Fig. 2
figure 2

Association between registration status and risk of bias (a, b), or funding source (c, d) of included trials. Relative frequency (%) of all published trials (a and c, n = 334) and of all registered trials (b and d, n = 75) from 2004 to 2017. Risk of bias assessment according to “low”, “unclear”, and “high”. Funding source according to industry, non-industry (non-ind), and not determined (ND)

Full size image

There was a significant difference in the source of funding reported in registered and non-registered trials published between 2004 and 2017 (p < 0.001; Chi2 = 57.543, df = 2). Registered trials declared their funding source more often compared to non-registered trials (73% vs. 30%) (Fig. 2c). The proportion of studies with industry and non-industry funding among registered trials was 33% (25/75) and 40% (30/75), respectively, and among non-registered trials 7% (17/259) and 23% (60/259), respectively (Fig. 2c). There was no difference detectable in the distribution of the funding source in pro- and retrospectively registered trials (p = 0.06; Chi2 = 5.60, df = 2) (Fig. 2d).

About half of the studies included in the Cochrane review were from Asia (298/585), followed by North America (96/585) and Europe (148/585). There was a significant difference in the geographic distribution of registered and non-registered trials published between 2004 and 2017 (p < 0.001; Chi2 = 47.293, df = 4). Among registered trials the proportion of Asian studies was lower and the proportion of multi-center studies conducted in different continents was higher compared to non-registered trials (Fig. 3a). In total, 92% (11/12) multi-center studies were registered, but only 15% (32/219) Asian studies (Fig. 3b). There was no difference detectable in the geographic distribution of pro- and retrospectively registered trials (p = 0.30; Chi2 = 4.84, df = 4). In total, 55% (6/11) multi-continental studies were prospectively registered, but only 25% (8/32) Asian studies.

Fig. 3
figure 3

Association between registration status and geographic location of all included trials from 2004 to 2017 (n = 334). Relative frequency (%) plotted for registered and non-registered trials (a) and plotted for geographic location (b). Asia (asi), Europe (eu), North America (nam), multi-continental locations (multi), and other

Full size image

Discussion

To evaluate trial registration and selective outcome reporting bias in anaesthesiology trials, we analysed the 585 trials included in the recently published large Cochrane review on drugs for prevention of PONV [10, 11]. In 2004, the first registered trial was published [30]. In the same year, the ICMJE initiative calling for a prospective registration of clinical trials was announced [6]. After the ICMJE announcement 334 included trials were published, but only 22% (75/334) trials were registered. The majority of registered trials were retrospectively registered and only 36% (27/75) of the registrations occurred prospectively. The proportion of prospectively registered studies increased from 25% prior to inclusion of the ICMJE recommendation in the journals’ policies to 48% thereafter. 41% (11/27) of the prospectively registered trials were “free” of selective outcome reporting bias and 37% (10/27) trials showed some evidence of selective outcome reporting with a total of 19 major outcome discrepancies between registered and published trial reports. Among the trials with selective outcome reporting 80% (8/10) favoured reporting of at least one statistically significant result. In general, registered trial compared to non-registered trials were more often of ‘overall low risk of bias’ and reported the source of funding. Most of the multi-center trials were registered, but only a minority of the Asian studies.

Previous studies on trial registration in anaesthesia clinical trials focused mainly on RCTs published in high impact journals of anaesthesiology, pain or critical care during one year or short periods of time [9, 31,32,33]. Our study provides further insight into the phenomena of trial registration and selective outcome reporting in anaesthesia trials regarding antiemetic drugs. To the best of our knowledge, this is the first study to examine trial registration and selective outcome reporting in a specific field of clinical research in anaesthesia (PONV research) published over time in a broad range of different journals not restricted to the impact factor of the journals. The trial registration rate in our study with 22% (75/334) was lower compared to previous studies on trial registration in anaesthesia trials ranging from 35 to 78% [9, 31,32,33]. On the one hand, the discrepancy might be due to different observation periods. Our study dates back to 2004 a time period where the recommendation of the ICMJE had not yet gained much awareness. Viergever et al. showed in general that the global number of registered clinical studies increased fivefold between 2004 and 2013 [34]. On the other hand, we did not restrict our study pool to studies published in high impact journals compared to the other studies [9, 31,32,33]. High impact journals do more frequently require trial registration than low impact journals [35]. In our study, we showed that registered studies were published more frequently in journals that follow the ICMJE policy.

We found that only 8% (27/334) of trials published between 2004 and 2017 were prospectively registered. This finding is comparable to Jones et al. that 14% of the 860 RCTs published in the top 6 general anaesthesiology journals in 2007, 2010, 2013, and 2015 were prospectively registered [9]. Retrospective registration is a major problem, because there is no guarantee that trials have not been registered in favour of a certain result [34]. The frequency of trial registration at all (pro- and retrospective) in studies published in journals following the ICMJE policy did not differ between the time before and after the date of adopting the ICMJE policy. However, we found that the proportion of prospective registrations increased after the endorsement of the ICMJE policy by the journals.

Prospective registration per se does not prevent selective outcome reporting. Only 41% (11/27) trials were free of selective outcome reporting bias and 37% (10/27) were at high risk. Among the leading forms of selective outcome reporting in our study were a change from primary to secondary outcomes, introduction of new primary outcomes, and different outcome assessment times. The influence of these discrepancies could be assessed in two-third of them and in these statistically significant results were favoured in 80% (8/10) of trials. This finding is in line with results from Mathieu et al. who found that 83% of RCTs with outcome discrepancies published in 2008 in 10 general medical high impact journals favoured statistically significant results [12].

Trial registration can be seen as a quality criteria of clinical studies. We found that registered trials were more frequently assessed as ‘overall low risk of bias’ with the Cochrane Risk of Bias tool and reported their funding source. Therefore, trial registration is a reliable quality criteria for RCTs in the context of our study. Interestingly, Asian studies that make the largest proportion of trials in the Cochrane review tend to be less frequently registered with only 15% (32/219) of all Asian studies compared to studies conducted in other areas of the world, especially Europe and North America. When the studies were carried out as multi-centre studies in different centres over the world, they were registered mostly.

Our study has limitations. The current study was not prospectively registered. The primary aim of our group was to conduct a systematic Cochrane review for PONV prophylaxis. It was only during our work that we came across the issue of missing trial registration and selective outcome reporting in the field of PONV research. We were not aware of the extent of this problem before the start of the review and wanted to share our findings with the scientific community. Therefore, we could have registered only a protocol for this study retrospectively. However, retrospective registration would be in contradiction to the message of our paper. As part of the previously published Cochrane systematic review on antiemetic drugs, we performed a comprehensive literature search which was also the basis for this study. Several studies had duplicate publications in different journals and were listed in trial registries by different first authors; this complicated the process of data synthesis. By making references and dataset freely available [10], we welcome perusal by outside researchers to identify mistakes in our dataset, our analysis or our interpretation. We did not send requests to trial authors either not publishing a trial registration number in the publication asking for trial registration or not providing sufficient details in the protocol to assess selective outcome reporting. Thus, the proportion of registered trials could be underestimated and the proportion of selective outcome reporting in prospectively registered trials could be slightly different. We defined prospectively registered trials as those in which the date of trial registration was before or at the same date of first participant’s enrolment. Thus, we may have underestimated the number of prospectively registered trials by definition. However, the chosen approach deemed sensible to have clearly defined time-points. We assessed selective outcome reporting and trial registration for trials published from 2004 onwards which is the same year that ICMJE introduced trial registration as a necessity for good clinical practice and the first of our included published studies registered the trial. Due to the lag from trial initiation to publication of results, trialists publishing shortly after the ICMJE’s announcement certainly would not be able to offer a prospective protocol. Therefore, an increase in prospective trial registration is expectedly delayed. Additionally, it has to be kept in mind that this study only considers trials investigating antiemetic drugs for PONV prophylaxis and our findings cannot be extrapolated to other fields in anaesthesiology research.

Finally, only 3% (11/334) of the investigated trials were deemed as prospectively and completely registered and free of selective outcome reporting. This is still an alarming sign of inadequacy in clinical research of PONV despite more than ten years of international recommendations on prospective trial registration. However, PONV research is not an outsider in this field since other specialities, e.g. psychotherapy, reported similar numbers with only 5% of RCTs that were free of selective outcome reporting [36]. Therefore, study’s authors should became aware of that a complete, transparent, and prospective trial registration and publication according to the specifications set out in the protocol is seen as an important quality criteria that increases the confidence of the study findings.

Conclusions

In 2017, 13 years after the ICMJE declared prospective protocol registration a necessity for reliable clinical studies, the frequency and quality of trial registration in the field of PONV research is very poor. Only one fifth of the clinical trials published in 2004 or later and included in the recently published Cochrane review referenced a registered trial protocol of which almost two third were registered retrospectively. In the end, of the prospectively registered trials less than 50% were free of selective outcome reporting bias. This is an alarming deficit. We also showed that registered trials in general were more frequently judged as overall low risk of bias regarding the Cochrane Risk of Bias assessment, suggesting trial registration as a quality criterion for RCTs in PONV clinical research. Selective outcome reporting reduces trustworthiness in findings of clinical trials. Investigators and clinicians should be aware that only following a properly registered protocol and transparently reporting of predefined outcomes, regardless of the direction and significance of the result, will ultimately strengthen the body of evidence in the field of PONV research in the future.

Availability of data and materials

The datasets used and/or analysed during the current study are available from the corresponding author on reasonable request.

Abbreviations

PONV:

Postoperative Nausea and Vomiting

ICMJE:

International Committee of Medical Journal Editors

RCT:

Randomized Clinical Trials

WHO:

World Health Organization

CENTRAL:

Cochrane Central Register of Controlled Trials

ICTRP:

International Clinical Trials Registry Platform

CINAHL:

Cumulative Index to Nursing and Allied Health Literature

IQR:

Interquartile Ranges

EU:

European Union

References

  1. Song F, Eastwood AJ, Gilbody S, Duley L, Sutton AJ. Publication and related biases. Health Technol Assess. 2000;4(10):1–115.

    Article  Google Scholar 

  2. Hutton JL, Williamson PR. Bias in Meta-analysis due to outcome variable selection within studies. J R Stat Soc: Ser C: Appl Stat. 2000;49(3):359–70.

    Article  Google Scholar 

  3. Dickersin K, Rennie D. Registering clinical trials. JAMA. 2003;290(4):516–23.

    Article  Google Scholar 

  4. Chan AW, Hrobjartsson A, Haahr MT, Gotzsche PC, Altman DG. Empirical evidence for selective reporting of outcomes in randomized trials: comparison of protocols to published articles. JAMA. 2004;291(20):2457–65.

    Article  CAS  Google Scholar 

  5. Dwan K, Altman DG, Arnaiz JA, Bloom J, Chan AW, Cronin E, et al. Systematic review of the empirical evidence of study publication bias and outcome reporting bias. PLoS One. 2008;3(8):e3081.

    Article  Google Scholar 

  6. De Angelis C, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, et al. Clinical trial registration: a statement from the International Committee of Medical Journal Editors. N Engl J Med. 2004;351(12):1250–1.

    Article  Google Scholar 

  7. De Angelis CD, Drazen JM, Frizelle FA, Haug C, Hoey J, Horton R, et al. Is this clinical trial fully registered? — a statement from the International Committee of Medical Journal Editors. N Engl J Med. 2005;352(23):2436–8.

    Article  Google Scholar 

  8. Al-Durra M, Nolan RP, Seto E, Cafazzo JA. Prospective registration and reporting of trial number in randomised clinical trials: global cross sectional study of the adoption of ICMJE and declaration of Helsinki recommendations. BMJ. 2020;369:m982.

    Article  Google Scholar 

  9. Jones PM, Chow JTY, Arango MF, Fridfinnson JA, Gai N, Lam K, et al. Comparison of registered and reported outcomes in randomized clinical trials published in anesthesiology journals. Anesth Analg. 2017;125(4):1292–300.

    Article  Google Scholar 

  10. Weibel S, Rucker G, Eberhart LH, Pace NL, Hartl HM, Jordan OL, et al. Drugs for preventing postoperative nausea and vomiting in adults after general anaesthesia: a network meta-analysis. Cochrane Database Syst Rev. 2020;10:CD012859.

    PubMed  Google Scholar 

  11. Weibel S, Schaefer MS, Raj D, Rücker G, Pace NL, Schlesinger T, et al. Drugs for preventing postoperative nausea and vomiting in adults after general anaesthesia: an abridged Cochrane network meta-analysis. Anaesthesia. 2021;76(7):962–73.

  12. Mathieu S, Boutron I, Moher D, Altman DG, Ravaud P. Comparison of registered and published primary outcomes in randomized controlled trials. JAMA. 2009;302(9):977–84.

    Article  CAS  Google Scholar 

  13. Agarkar S, Chatterjee AS. Comparison of ramosetron with ondansetron for the prevention of post-operative nausea and vomiting in high-risk patients. Indian J Anaesth. 2015;59(4):222–7.

    Article  CAS  Google Scholar 

  14. Alghanem SM, Massad IM, Rashed EM, Abu-Ali HM, Daradkeh SS. Optimization of anesthesia antiemetic measures versus combination therapy using dexamethasone or ondansetron for the prevention of postoperative nausea and vomiting. Surg Endosc. 2010;24(2):353–8.

    Article  Google Scholar 

  15. Bang SR, Kim HJ, Ahn EJ, Choi HR, Kim KW, Ko MJ, et al. Effect of total intravenous anesthesia and prophylactic 5-HT3 receptor antagonist on postoperative nausea and vomiting after gynecologic laparoscopic surgery: a prospective, randomized controlled study. Rawal Med J. 2017;42(1):73–7.

    Google Scholar 

  16. Blitz JD, Haile M, Kline R, Franco L, Didehvar S, Pachter HL, et al. A randomized double blind study to evaluate efficacy of palonosetron with dexamethasone versus palonosetron alone for prevention of postoperative and postdischarge nausea and vomiting in subjects undergoing laparoscopic surgeries with high emetogenic risk. Am J Ther. 2012;19(5):324–9.

    Article  Google Scholar 

  17. Choi EK, Kim DG, Jeon Y. Comparison of the prophylactic antiemetic efficacy of aprepitant plus palonosetron versus aprepitant plus ramosetron in patients at high risk for postoperative nausea and vomiting after laparoscopic cholecystectomy: a prospective randomized-controlled trial. Surg Laparosc Endosc Percutan Tech. 2016;26(5):354–7.

    Article  Google Scholar 

  18. Jung WS, Kim YB, Park HY, Choi WJ, Yang HS. Oral administration of aprepitant to prevent postoperative nausea in highly susceptible patients after gynecological laparoscopy. J Anesth. 2013;27(3):396–401.

    Article  Google Scholar 

  19. Kakuta N, Tsutsumi YM, Horikawa YT, Kawano H, Kinoshita M, Tanaka K, et al. Neurokinin-1 receptor antagonism, aprepitant, effectively diminishes post-operative nausea and vomiting while increasing analgesic tolerance in laparoscopic gynecological procedures. J Med Investig. 2011;58(3–4):246–51.

    Article  Google Scholar 

  20. Kim SH, Hong JY, Kim WO, Kil HK, Karm MH, Hwang JH. Palonosetron has superior prophylactic antiemetic efficacy compared with ondansetron or ramosetron in high-risk patients undergoing laparoscopic surgery: a prospective, randomized, double-blinded study. Korean J Anesthesiol. 2013;64(6):517–23.

    Article  CAS  Google Scholar 

  21. Kizilcik N, Bilgen S, Menda F, Türe H, Aydın B, Kaspar EC, et al. Comparison of dexamethasone-dimenhydrinate and dexamethasone-ondansetron in prevention of nausea and vomiting in postoperative patients. Aesthet Plast Surg. 2017;41(1):204–10.

    Article  Google Scholar 

  22. Ryoo SH, Yoo JH, Kim MG, Lee KH, Kim SI. The effect of combination treatment using palonosetron and dexamethasone for the prevention of postoperative nausea and vomiting versus dexamethasone alone in women receiving intravenous patient-controlled analgesia. Korean J Anesthesiol. 2015;68(3):267–73.

    Article  CAS  Google Scholar 

  23. Sánchez-Rodríguez PE, Fuentes-Orozco C, González-Ojeda A. Effect of dexamethasone on postoperative symptoms in patients undergoing elective laparoscopic cholecystectomy: randomized clinical trial. World J Surg. 2010;34(5):895–900.

    Article  Google Scholar 

  24. NCT00888329. Aprepitant for Prevention of Postoperative Nausea and Vomiting in Elective Hysterectomy. 2009. https://clinicaltrials.gov/ct2/show/NCT00888329. Accessed 6 Dec 2018.

  25. NKO101287. The purpose of this study is to determine the effectiveness of this medication in preventing nausea and vomiting in female patients at risk for post-operative nausea and vomiting (PONV). 2004. www.gsk-studyregister.com/study?uniqueStudyId=NKO101287. Accessed 6 Dec 2018.

  26. NKT102245. The primary purpose of this study is to determine an effective dose of this NK-1 anti-emetic medication to prevent nausea and vomiting in females after surgery. 2005. www.gsk-studyregister.com/study?uniqueStudyId=NKT1022452018. Accessed 6 Dec 2018.

  27. NKT102260. This study is looking at a range of doses of this NK-1 receptor antagonist drug, for both safety and effectiveness in prevention PONV. 2005. www.gsk-studyregister.com/study?uniqueStudyId=NKT1022602018. Accessed 6 Dec 2018.

  28. NKT102552. This study is being conducted to see if adding GW679769 (casopitant) to ZOFRAN will significantly decrease the number of patients who experience nausea and vomiting after surgery. 2006. www.gsk-studyregister.com/study?uniqueStudyId=NKT1025522018. Accessed 6 Dec 2018.

  29. PALO-04-07. A Randomized, Double-blind, Multicenter, Parallel Group, Balanced, Stratified Phase 3 Study to Evaluate the Efficacy and the Safety of Single IV Doses of Palonosetron 0.025 mg, 0.050 mg, and 0.075 mg versus Placebo to Prevent Postoperative Nausea and Vomiting Following Elective Gynecologic or Breast Surgery. 2005. www.clinicaltrialsregister.eu/ctr-search/search?query=2005–000298-232005. Accessed 6 Dec 2018.

  30. Apfel CC, Korttila K, Abdalla M, Kerger H, Turan A, Vedder I, et al. A factorial trial of six interventions for the prevention of postoperative nausea and vomiting. N Engl J Med. 2004;350(24):2441–51.

    Article  CAS  Google Scholar 

  31. Bonnot B, Yavchitz A, Mantz J, Paugam-Burtz C, Boutron I. Selective primary outcome reporting in high-impact journals of anaesthesia and pain. Br J Anaesth. 2016;117(4):542–3.

    Article  CAS  Google Scholar 

  32. El-Boghdadly K, Wiles MD, Atton S, Bailey CR. Adherence to guidance on registration of randomised controlled trials published in Anaesthesia. Anaesthesia. 2018;73(5):556–63.

    Article  CAS  Google Scholar 

  33. Jones CW, Platts-Mills TF. Quality of registration for clinical trials published in emergency medicine journals. Ann Emerg Med. 2012;60(4):458–64 e1.

    Article  Google Scholar 

  34. Viergever RF, Li K. Trends in global clinical trial registration: an analysis of numbers of registered clinical trials in different parts of the world from 2004 to 2013. BMJ Open. 2015;5(9):e008932.

    Article  Google Scholar 

  35. Hooft L, Korevaar DA, Molenaar N, Bossuyt PM, Scholten RJ. Endorsement of ICMJE's clinical trial registration policy: a survey among journal editors. Neth J Med. 2014;72(7):349–55.

    CAS  PubMed  Google Scholar 

  36. Bradley HA, Rucklidge JJ, Mulder RT. A systematic review of trial registration and selective outcome reporting in psychotherapy randomized controlled trials. Acta Psychiatr Scand. 2017;135(1):65–77.

    Article  CAS  Google Scholar 

Download references

Acknowledgements

We would like to thank the author team of the Cochrane review for their support with literature screening, data extraction and critical appraisal. We would like to thank Elisabeth Friedrich-Würstlein for organization of full texts of published articles.

Funding

This work was supported by departmental resources only.

This publication was supported by the Open Access Publication Fund of the University of Wuerzburg. Open Access funding enabled and organized by Projekt DEAL.

Author information

Author notes

  1. Manuel Riemer and Peter Kranke contributed equally to this work.

Authors and Affiliations

  1. Department of Anaesthesiology, Intensive Care, Emergency and Pain Medicine, University Hospital Wuerzburg, Oberduerrbacher Str. 6, 97080, Wuerzburg, Germany

    Manuel Riemer, Peter Kranke, Antonia Helf, Maria Popp, Tobias Schlesinger, Patrick Meybohm & Stephanie Weibel

  2. Department of Surgery, Kantonsspital Glarus, Glarus, Switzerland

    Debora Mayer

Authors
  1. Manuel Riemer
    View author publications

    You can also search for this author in PubMed Google Scholar

  2. Peter Kranke
    View author publications

    You can also search for this author in PubMed Google Scholar

  3. Antonia Helf
    View author publications

    You can also search for this author in PubMed Google Scholar

  4. Debora Mayer
    View author publications

    You can also search for this author in PubMed Google Scholar

  5. Maria Popp
    View author publications

    You can also search for this author in PubMed Google Scholar

  6. Tobias Schlesinger
    View author publications

    You can also search for this author in PubMed Google Scholar

  7. Patrick Meybohm
    View author publications

    You can also search for this author in PubMed Google Scholar

  8. Stephanie Weibel
    View author publications

    You can also search for this author in PubMed Google Scholar

Contributions

MR: study design, acquisition of data, analysis, interpretation, drafting the article; PK: study design, interpretation, drafting the article; AH: acquisition of data; DM: acquisition of data; MP: interpretation, drafting the article; TS: interpretation, drafting the article; PM: interpretation, drafting the article; SW: study design, acquisition of data, analysis, interpretation, drafting the article. The manuscript has been read and approved by all co-authors.

Corresponding author

Correspondence to Stephanie Weibel.

Ethics declarations

Ethics approval and consent to participate

Not applicable.

Consent for publication

Not applicable.

Competing interests

PK has financial relationships with TEVA Ratiopharm GmbH, Fresenius Kabi GmbH Germany, Pajunk that might have an interest in the submitted work in the previous three years; he has no other relationships or activities that could appear to have influenced the submitted work. PK was involved in the conduct of studies related to the Cochrane review. He did not assess the relevant studies for in- or exclusion and were not allowed to extract data and critically appraise the quality of the relevant studies. No other financial or competing interests declared by any of the authors.

Additional information

Publisher’s Note

Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.

Supplementary Information

Additional file 1.

PRISMA study flow diagram.

Additional file 2.

References to included registered studies.

Additional file 3.

Studies with registered study protocols.

Additional file 4.

List of journals publishing the registered trials (n = 75), with date of adopting the ICMJE policy.

Additional file 5.

Major discrepancies of prospectively registered studies with high risk of selective outcome reporting (SOR).

Rights and permissions

Open Access This article is licensed under a Creative Commons Attribution 4.0 International License, which permits use, sharing, adaptation, distribution and reproduction in any medium or format, as long as you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons licence, and indicate if changes were made. The images or other third party material in this article are included in the article's Creative Commons licence, unless indicated otherwise in a credit line to the material. If material is not included in the article's Creative Commons licence and your intended use is not permitted by statutory regulation or exceeds the permitted use, you will need to obtain permission directly from the copyright holder. To view a copy of this licence, visit http://creativecommons.org/licenses/by/4.0/. The Creative Commons Public Domain Dedication waiver (http://creativecommons.org/publicdomain/zero/1.0/) applies to the data made available in this article, unless otherwise stated in a credit line to the data.

Reprints and permissions

About this article

Check for updates. Verify currency and authenticity via CrossMark

Cite this article

Riemer, M., Kranke, P., Helf, A. et al. Trial registration and selective outcome reporting in 585 clinical trials investigating drugs for prevention of postoperative nausea and vomiting. BMC Anesthesiol 21, 249 (2021). https://doi.org/10.1186/s12871-021-01464-w

Download citation

  • Received:

  • Accepted:

  • Published:

  • DOI: https://doi.org/10.1186/s12871-021-01464-w

Keywords

BMC Anesthesiology

ISSN: 1471-2253

Contact us