Concurrent validity and reliability of suicide risk assessment instruments: A meta-analysis of 20 instruments across 27 international cohorts.

Adrian Campos; Laura van Velzen; Dick Veltman; Elena Pozzi; Sonia Ambrogi; Elizabeth Ballard; Nerisa Banaj; Zeynep Başgöze; Sophie Bellow; Francesco Benedetti; Irene Bollettini; Katharina Brosch; Erick Canales-Rodríguez; Emily Clarke-Rubright; Lejla Colic; Colm Connolly; Philippe Courtet; Kathryn Cullen; Udo Dannlowski; Maria Dauvermann; Christopher Davey; Jérémy Deverdun; Katharina Dohm; Tracy Erwin-Grabner; Roberto Goya-Maldonado; Negar Fani; Lydia Fortea; Paola Fuentes-Claramonte; Ali Saffet Gonul; Ian Gotlib; Dominik Grotegerd; Mathew A Harris; Ben Harrison; Courtney Haswell; Emma Hawkins; Dawson Hill; Yoshiyuki Hirano; Tiffany Ho; Fabrice Jollant; Tanja Jovanovic; Tilo Kircher; Bonnie Klimes-Dougan; Emmanuelle Le Bars; Christine Lochner; Andrew McIntosh; Susanne Meinert; Yara Mekawi; Elisa Melloni; Philip Mitchell; Rajendra Morey; Akiko Nakagawa; Igor Nenadić; Emilie Olié; F. Pereira; Rachel Phillips; Fabrizio Piras; Sara Poletti; Edith Pomarol-Clotet; Joaquim Radua; Kerry Ressler; Gloria Roberts; Elena Rodríguez-Cano; Matthew D Sacchet; Raymond Salvador; Anca-Larisa Sandu; Eiji Shimizu; Aditya Singh; Gianfranco Spalletta; J. Douglas Steele; Dan Stein; Frederike Stein; Jennifer Stevens; Giana Teresi; Aslihan Uyar-Demir; Nic van der Wee; Steven van der Werff; Sanne J.H. van Rooij; Daniela Vecchio; Norma Verdolini; Eduard Vieta; Gordon Waiter; Heather Whalley; Sarah Whittle; Tony Yang; Carlos Zarate; Paul Thompson; Neda Jahanshad; Anne-Laura van Harmelen; Hilary Blumberg; Lianne Schmaal; Miguel Rentería

doi:10.1037/neu0000850

Back

Concurrent validity and reliability of suicide risk assessment instruments: A meta-analysis of 20 instruments across 27 international cohorts.

Journal article

Open access

Peer reviewed

Concurrent validity and reliability of suicide risk assessment instruments: A meta-analysis of 20 instruments across 27 international cohorts.

Adrian Campos, Laura van Velzen, Dick Veltman, Elena Pozzi, Sonia Ambrogi, Elizabeth Ballard, Nerisa Banaj, Zeynep Başgöze, Sophie Bellow, Francesco Benedetti, …

Neuropsychology, Vol.37(3), pp.315-329

2023

DOI: https://doi.org/10.1037/neu0000850

PMCID: PMC10132776

PMID: 37011159

Abstract

suicide

concurrent validity

harmonisation

psychometrics

instruments

Objective: A major limitation of current suicide research is the lack of power to identify robust correlates of suicidal thoughts or behaviour. Variation in suicide risk assessment instruments used across cohorts may represent a limitation to pooling data in international consortia.Method: Here, we examine this issue through two approaches: (i) an extensive literature search on the reliability and concurrent validity of the most commonly used instruments; and (ii) by pooling data (N~6,000 participants) from cohorts from the ENIGMA-Major Depressive Disorder (ENIGMA-MDD) and ENIGMA-Suicidal Thoughts and Behaviour (ENIGMA-STB) working groups, to assess the concurrent validity of instruments currently used for assessing suicidal thoughts or behaviour.Results: We observed moderate-to-high correlations between measures, consistent with the wide range (kappa range: 0.15-0.97; r range: 0.21-0.94) reported in the literature. Two common multi-item instruments, the Columbia Suicide Severity Rating Scale (C-SSRS) and the Beck Scale for Suicidal Ideation (SSI) were highly correlated with each other (r=0.83). Sensitivity analyses identified sources of heterogeneity such as the time frame of the instrument and whether it relies on self-report or a clinical interview. Finally, construct-specific analyses suggest that suicide ideation items from common psychiatric questionnaires are most concordant with the suicide ideation construct of multi-item instruments.Conclusions Our findings suggest that multi-item instruments provide valuable information on different aspects of suicidal thoughts or behaviour but share a modest core factor with single suicidal ideation items. Retrospective, multi-site collaborations including distinct instruments should be feasible provided they harmonise across instruments or focus on specific constructs of suicidality.

Files and links (1)

url

Find in HALView

Metrics

1 Record Views

See more details

Details

Title: Concurrent validity and reliability of suicide risk assessment instruments: A meta-analysis of 20 instruments across 27 international cohorts.
Creators - without role: Adrian Campos - QIMR Berghofer Medical Research Institute
Laura van Velzen - Orygen
Dick Veltman - Vrije Universiteit Amsterdam
Elena Pozzi - Orygen
Sonia Ambrogi - Fondazione Santa Lucia
Elizabeth Ballard - National Institutes of Health [Bethesda, MD, USA]
Nerisa Banaj - Fondazione Santa Lucia
Zeynep Başgöze - University of Minnesota System
Sophie Bellow - University of Cambridge
Francesco Benedetti - Vita-Salute San Raffaele University
Irene Bollettini - Vita-Salute San Raffaele University
Katharina Brosch - Philipps University of Marburg
Erick Canales-Rodríguez - Hospital Mare de Déu de la Mercè
Emily Clarke-Rubright - Duke University
Lejla Colic - Jena University Hospital
Colm Connolly - Florida State University
Philippe Courtet - Centre Hospitalier Universitaire de Montpellier
Kathryn Cullen - University of Minnesota System
Udo Dannlowski - University of Münster
Maria Dauvermann - University of Cambridge
Christopher Davey - Melbourne Health
Jérémy Deverdun - Université de Montpellier
Katharina Dohm - University of Münster
Tracy Erwin-Grabner - University of Göttingen
Roberto Goya-Maldonado - University of Göttingen
Negar Fani - Emory University
Lydia Fortea - Centro de Investigación Biomédica en Red de Salud Mental
Paola Fuentes-Claramonte - Hospital Mare de Déu de la Mercè
Ali Saffet Gonul - Ege University
Ian Gotlib - Stanford University
Dominik Grotegerd - University of Münster
Mathew A Harris - University of Edinburgh
Ben Harrison - University of Melbourne
Courtney Haswell - Duke University
Emma Hawkins - University of Edinburgh
Dawson Hill - University of Minnesota System
Yoshiyuki Hirano - Chiba University
Tiffany Ho - University of California, San Francisco
Fabrice Jollant - GHU Paris psychiatrie & neurosciences
Tanja Jovanovic - Wayne State University
Tilo Kircher - Philipps University of Marburg
Bonnie Klimes-Dougan - University of Minnesota System
Emmanuelle Le Bars - Université de Montpellier
Christine Lochner - Stellenbosch University
Andrew McIntosh - University of Edinburgh
Susanne Meinert - University of Münster
Yara Mekawi - Emory University
Elisa Melloni - Vita-Salute San Raffaele University
Philip Mitchell - UNSW Sydney
Rajendra Morey - Duke University
Akiko Nakagawa - Chiba University
Igor Nenadić - Philipps University of Marburg
Emilie Olié - Université de Montpellier, Institut de Génomique Fonctionnelle - IGF
F. Pereira - Centre Hospitalier Universitaire de Nîmes
Rachel Phillips - Duke University
Fabrizio Piras - Fondazione Santa Lucia
Sara Poletti - Vita-Salute San Raffaele University
Edith Pomarol-Clotet - Hospital Mare de Déu de la Mercè
Joaquim Radua - Centro de Investigación Biomédica en Red de Salud Mental
Kerry Ressler - Emory University
Gloria Roberts - UNSW Sydney
Elena Rodríguez-Cano - Hospital Mare de Déu de la Mercè
Matthew D Sacchet - Harvard University
Raymond Salvador - Hospital Mare de Déu de la Mercè
Anca-Larisa Sandu - University of Aberdeen
Eiji Shimizu - Chiba University
Aditya Singh - University of Göttingen
Gianfranco Spalletta - Fondazione Santa Lucia
J. Douglas Steele - University of Dundee
Dan Stein - University of Cape Town
Frederike Stein - Philipps University of Marburg
Jennifer Stevens - Emory University
Giana Teresi - Stanford University
Aslihan Uyar-Demir - Ege University
Nic van der Wee - Leiden University Medical Center
Steven van der Werff - Leiden University Medical Center
Sanne J.H. van Rooij - Emory University
Daniela Vecchio - Fondazione Santa Lucia
Norma Verdolini - Universitat de Barcelona
Eduard Vieta - Universitat de Barcelona
Gordon Waiter - University of Aberdeen
Heather Whalley - University of Edinburgh
Sarah Whittle - University of Melbourne
Tony Yang - University of California [San Francisco]
Carlos Zarate - National Institutes of Health [Bethesda, MD, USA]
Paul Thompson - University of Southern California
Neda Jahanshad - University of Southern California
Anne-Laura van Harmelen - University of Cambridge
Hilary Blumberg - Yale University
Lianne Schmaal - Orygen
Miguel Rentería - QIMR Berghofer Medical Research Institute
Publication Details: Neuropsychology, Vol.37(3), pp.315-329
Grant note: MER received support from the Australian National Health and Medical Research Council (NHMRC) Centre for Research Excellence on Suicide Prevention (CRESP) [GNT1042580]. LS, LvV, LC, HPB, ALvH, SB and MD were supported by the MQ Brighter Futures Award MQBFC/2. LvV, LS and NJ were supported by the National Institute of Mental Health of the National Institutes of Health under Award Number R01MH117601. LS is supported by a NHMRC Career Development Fellowship (1140764). HPB was additionally supported by: R61MH111929RC1MH088366, R01MH070902, R01MH069747, American Foundation for Suicide Prevention, International Bipolar Foundation, Brain and Behavior Research Foundation, For the Love of Travis Foundation and Women’s Health Research at Yale. LC was additionally supported by Interdisziplinäres Zentrum für Klinische Forschung, UKJ. PMT was supported in part by NIH grant R01 MH116147. FJ would like to thank dr. S. Richard-Devantoy for his assistance during data collection. This work was supported by the CIBERSAM and the Catalonian Government (2014-SGR-1573 and 2017-SGR-1271 to FIDMAG). PF-C is funded by the Instituto de Salud Carlos III, co-funded by European Union (ERDF/ESF, “Investing in your future”): Sara Borrell contract (CD19/00149). The researchers based in Milan were supported by an Italian Ministry of Health grant RF-2011-02349921. ALvH was funded through the Leiden University Social Safety and Resilience Programme. The NIMH-ETPB team was supported by the Intramural Research Program at the National Institute of Mental Health, National Institutes of Health (IRP-NIMH-NIH; ZIAMH002927). MS is supported by the Phyllis and Jerome Lyle Rappaport Foundation, Ad Astra Chandaria Foundation, BIAL Foundation, Brain and Behavior Research Foundation, Anonymous donors, and the Center for Depression, Anxiety, and Stress Research at McLean Hospital. The team based at the University of Minnesota was supported by the National Institute of Mental Health (K23MH090421), the National Alliance for Research on Schizophrenia and Depression, the University of Minnesota Graduate School, the Minnesota Medical Foundation, and the Biotechnology Research Center (P41 RR008079 to the Center for Magnetic Resonance Research), University of Minnesota, and the Deborah E. Powell Center for Women’s Health Seed Grant. IHG was supported by the National Institute of Mental Health grant R37MH101495. EV thanks the support of the Spanish Ministry of Science and Innovation (PI15/00283, PI18/00805) integrated into the Plan Nacional de I+D+I and co-financed by the ISCIII-Subdirección General de Evaluación and the Fondo Europeo de Desarrollo Regional (FEDER); the Instituto de Salud Carlos III; the CIBER of Mental Health (CIBERSAM); the Secretaria d’Universitats i Recerca del Departament d’Economia i Coneixement (2017 SGR 1365), the CERCA Programme, and the Departament de Salut de la Generalitat de Catalunya for the PERIS grant SLT006/17/00357. NV thanks the support of a BITRECS project that has received funding from the European Union’s Horizon 2020 research and innovation programme under the Marie Skłodowska-Curie grant agreement No 754550 and from “La Caixa” Foundation (ID 100010434), under the agreement LCF/PR/GN18/50310006. For the team in Nimes, CINES grants access to HPC facilities (A0100311413). The team based in Rome was supported by an Italian Ministry of Health grant RC17-18-19-20-21/A. Support for the TIGER study includes the Klingenstein Third Generation Foundation, the National Institute of Mental Health (K01MH117442), the Stanford Maternal Child Health Research Institute, and the Stanford Center for Cognitive and Neurobiological Imaging. TCH receives partial support from the Ray and Dagmar Dolby Family Fund. The UCSF site was supported by the National Center for Complementary and Integrative Health (NCCIH) R21AT009173 and R61AT009864 to TTY; by the National Center for Advancing Translational Sciences (CTSI), National Institutes of Health, through UCSF-CTSI UL1TR001872 to TTY; by the American Foundation for Suicide Prevention (AFSP) SRG-1-141-18 to TTY; by UCSF Research Evaluation and Allocation Committee (REAC) and J. Jacobson Fund to TTY; by the National Institute of Mental Health (NIMH) R01MH085734 and the Brain and Behavior Research Foundation (formerly NARSAD) to TTY. The team at Duke University/Durham VA medical center were supported by the VA Mid-Atlantic Mental Illness Research Education and Clinical Center (MIRECC). The Moral Dilemma study was supported by the Brain & Behavior Research Foundation, and by the National Health and Medical Research Council (ID 1125504 to SLW). The FOR2107 Marburg site was supported by the German Research Foundation (DFG, grant FOR2107 KI588/14-1 and FOR2107 KI588/14-2 to Tilo Kircher, Marburg). The FOR2107 Muenster site was supported by the German Research Foundation (DFG, grant FOR2107 DA1151/5-1 and DA1151/5-2 to UD; SFB-TRR58, Projects C09 and Z02 to UD) and the Interdisciplinary Center for Clinical Research (IZKF) of the medical faculty of Münster (grant Dan3/012/17 to UD). CGD and BJH were supported by the National Health and Medical Research Council of Australia (NHMRC) Project Grants (1064643 and 1024570). NF was supported by the National Institute of Mental Health (MH111671) and National Center for Complementary and Integrative Health (R01AT011267). TJ was supported by the National Institutes Health Project Grants (MH098212) to TJ. JR and LF thank the support of the Spanish Ministry of Science and Innovation (PI19/00394 and CPII19/00009) integrated into the Plan Nacional de I+D+I and co-financed by the ISCIII-Subdirección General de Evaluación and the Fondo Europeo de Desarrollo Regional (FEDER); the Instituto de Salud Carlos III; the CIBER of Mental Health (CIBERSAM). YH, AN, ES were supported by AMED Brain/MINDS Beyond program Grant No. 20dm0307002, YH was supported by JSPS KAKENHI Grants No. 19K03309. AFFDIS was funded by the University Medical Center Goettingen (UMG Startfoerderung), TEG and RGM were supported by German Federal Ministry of Education and Research (Bundesministerium fuer Bildung und 664 Forschung, BMBF: 01 ZX 1507, “PreNeSt - e:Med”).
Identifiers: 9940792309311
Academic Unit: Institut de Génomique Fonctionnelle - IGF
Language: English
Resource Type: Journal article
Local Fields: hal-04711953