Advertisement

Measurement Properties of Visual Analogue Scale, Numeric Rating Scale, and Pain Severity Subscale of the Brief Pain Inventory in Patients With Low Back Pain: A Systematic Review

  • Alessandro Chiarotto
    Correspondence
    Address reprint requests to Alessandro Chiarotto, Department of Epidemiology and Biostatistics, Amsterdam Public Health research institute, Amsterdam Movement Sciences research institute, VU University Medical Center, de Boelelaan 1089a, Medical Faculty F-vleugel, 1081HV, Amsterdam, the Netherlands.
    Affiliations
    Department of Epidemiology and Biostatistics, Amsterdam Public Health Research Institute, VU University Medical Center, Amsterdam, Netherlands.

    Department of Health Sciences, Amsterdam Movement Sciences Research Institute, Vrije Universiteit, Amsterdam, Netherlands
    Search for articles by this author
  • Lara J. Maxwell
    Affiliations
    Centre for Practice-Changing Research, Ottawa Hospital Research Institute, University of Ottawa, Ottawa, Canada.
    Search for articles by this author
  • Raymond W. Ostelo
    Affiliations
    Department of Epidemiology and Biostatistics, Amsterdam Public Health Research Institute, VU University Medical Center, Amsterdam, Netherlands.

    Department of Health Sciences, Amsterdam Movement Sciences Research Institute, Vrije Universiteit, Amsterdam, Netherlands
    Search for articles by this author
  • Maarten Boers
    Affiliations
    Department of Epidemiology and Biostatistics, Amsterdam Public Health Research Institute, VU University Medical Center, Amsterdam, Netherlands.

    Amsterdam Rheumatology and Immunology Center, VU University Medical Center, Amsterdam, Netherlands.
    Search for articles by this author
  • Peter Tugwell
    Affiliations
    Centre for Practice-Changing Research, Ottawa Hospital Research Institute, University of Ottawa, Ottawa, Canada.

    Department of Medicine, Faculty of Medicine, University of Ottawa, Ottawa, Canada.
    Search for articles by this author
  • Caroline B. Terwee
    Affiliations
    Department of Epidemiology and Biostatistics, Amsterdam Public Health Research Institute, VU University Medical Center, Amsterdam, Netherlands.
    Search for articles by this author
Published:August 09, 2018DOI:https://doi.org/10.1016/j.jpain.2018.07.009

      Abstract

      The Visual Analogue Scale (VAS), Numeric Rating Scale (NRS), and Pain Severity subscale of the Brief Pain Inventory (BPI-PS) are the most frequently used instruments to measure pain intensity in low back pain. However, their measurement properties in this population have not been reviewed systematically. The goal of this study was to provide such systematic evidence synthesis. Six electronic sources (MEDLINE, EMBASE, CINAHL, PsycINFO, SportDiscus, Google Scholar) were searched (July 2017). Studies assessing any measurement property in patients with nonspecific low back pain were included. Two reviewers independently screened articles and assessed risk of bias using the COSMIN checklist. For each measurement property, evidence quality was rated as high, moderate, low, or very low (GRADE approach) and results were classified as sufficient, insufficient, or inconsistent. Ten studies assessed the VAS, 13 the NRS, 4 the BPI-PS. The 3 instruments displayed low or very low quality evidence for content validity. High-quality evidence was only available for NRS insufficient measurement error. Moderate evidence was available for NRS inconsistent responsiveness, BPI-PS sufficient structural validity and internal consistency, and BPI-PS inconsistent construct validity. All VAS measurement properties were underpinned by no, low, or very low quality evidence; likewise, the other measurement properties of NRS and BPI-PS.

      Perspectives

      Despite their broad use, there is no evidence clearly suggesting that one among VAS, NRS, and BPI-PS has superior measurement properties in low back pain. Future adequate quality head-to-head comparisons are needed and priority should be given to assessing content validity, test-retest reliability, measurement error, and responsiveness.

      Key words

      To read this article in full you will need to make a payment
      Subscribe to The Journal of Pain
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect

      References

        • Angst F
        • Verra ML
        • Lehmann S
        • Aeschlimann A
        Responsiveness of five condition-specific and generic outcome assessment instruments for chronic pain.
        BMC Med Res Methodol. 2008; 8: 26
        • Ballantyne JC
        • Sullivan MD
        Intensity of chronic pain: The wrong metric?.
        N Engl J Med. 2015; 373: 2098-2099
        • Beurskens AJ
        • de Vet HC
        • Koke AJ
        Responsiveness of functional status in low back pain: A comparison of different instruments.
        Pain. 1996; 65: 71-76
        • Black N
        Patient reported outcome measures could help transform healthcare.
        BMJ. 2013; 346: f167
        • Boers M
        • Brooks P
        • Strand CV
        • Tugwell P
        The OMERACT filter for outcome measures in rheumatology.
        J Rheumatol. 1998; 25: 198-199
        • Castarlenas E
        • Jensen MP
        • von Baeyer CL
        • Miro J
        Psychometric properties of the numerical rating scale to assess self-reported pain intensity in children and adolescents: A systematic review.
        Clin J Pain. 2017; 33: 376-383
        • Chapman JR
        • Norvell DC
        • Hermsmeyer JT
        • Bransford RJ
        • DeVine J
        • McGirt MJ
        • Lee MJ
        Evaluating common outcomes for measuring treatment success for chronic low back pain.
        Spine. 2011; 36: S54-S68
        • Chiarotto A
        • Boers M
        • Deyo RA
        • Buchbinder R
        • Corbin TP
        • Costa LO
        • Foster NE
        • Grotle M
        • Koes BW
        • Kovacs FM
        • Lin CC
        • Maher CG
        • Pearson AM
        • Peul WC
        • Schoene ML
        • Turk DC
        • van Tulder MW
        • Terwee CB
        • Ostelo RW
        Core outcome measurement instruments for clinical trials in non-specific low back pain.
        Pain. 2018; 159: 481-495
        • Chiarotto A
        • Deyo RA
        • Terwee CB
        • Boers M
        • Buchbinder R
        • Corbin TP
        • Costa LO
        • Foster NE
        • Grotle M
        • Koes BW
        • Kovacs FM
        • Lin CC
        • Maher CG
        • Pearson AM
        • Peul WC
        • Schoene ML
        • Turk DC
        • van Tulder MW
        • Ostelo RW
        Core outcome domains for clinical trials in non-specific low back pain.
        Eur Spine J. 2015; 24: 1127-1142
        • Chiarotto A
        • Maxwell LJ
        • Terwee CB
        • Wells GA
        • Tugwell P
        • Ostelo RW
        Roland-Morris Disability Questionnaire and Oswestry Disability Index: Which has better measurement properties for measuring physical functioning in nonspecific low back pain? Systematic review and meta-analysis.
        Phys Ther. 2016; 96: 1620-1637
        • Chiarotto A
        • Ostelo RW
        • Boers M
        • Terwee CB
        A systematic review highlights the need to investigate the content validity of patient-reported outcome measures for physical functioning in low back pain.
        J Clin Epidemiol. 2018; 95: 73-93
        • Chiarotto A
        • Terwee CB
        • Deyo RA
        • Boers M
        • Lin C-WC
        • Buchbinder R
        • Corbin TP
        • Costa LO
        • Foster NE
        • Grotle M
        • Koes BW
        • Kovacs FM
        • Maher CG
        • Pearson AM
        • Peul WC
        • Schoene ML
        • Turk DC
        • van Tulder MW
        • Ostelo RW
        A core outcome set for clinical trials on non-specific low back pain: Study protocol for the development of a core domain set.
        Trials. 2014; 15: 511
        • Chiarotto A
        • Terwee CB
        • Ostelo RW
        Choosing the right outcome measurement instruments for patients with low back pain.
        Best Pract Res Clin Rheumatol. 2016; 30: 1003-1020
        • Childs JD
        • Piva SR
        • Fritz JM
        Responsiveness of the numeric pain rating scale in patients with low back pain.
        Spine. 2005; 30: 1331-1334
      1. Cleeland CS: The Brief Pain Inventory, Available at: https://www.mdanderson.org/documents/Departments-and-Divisions/Symptom-Research/BPI_UserGuide.pdf, 2009. Accessed July 27, 2017

        • Cleeland CS
        • Ryan K
        Pain assessment: Global used of the Brief Pain Inventory.
        Ann Acad Med Singapore. 1994; 23: 129-138
        • Clement RC
        • Welander A
        • Stowell C
        • Cha TD
        • Chen JL
        • Davies M
        • Fairbank JC
        • Foley KT
        • Gehrchen M
        • Hagg O
        • Jacobs WC
        • Kahler R
        • Khan SN
        • Lieberman IH
        • Morisson B
        • Ohnmeiss DD
        • Peul WC
        • Shonnard NH
        • Smuck MW
        • Solberg TK
        • Stromqvist BH
        • Hooff ML
        • Wasan AD
        • Willems PC
        • Yeo W
        • Fritzell P
        A proposed set of metrics for standardized outcome reporting in the management of low back pain.
        Acta Orthop. 2015; 86: 523-533
        • Co YY
        • Eaton S
        • Maxwell MW
        The relationship between the St. Thomas and Oswestry disability scores and the severity of low back pain.
        J Manipulative Physiol Ther. 1993; 16: 14-18
        • Daut RL
        • Cleeland CS
        • Flanery RC
        Development of the Wisconsin Brief Pain Questionnaire to assess pain in cancer and other diseases.
        Pain. 1983; 17: 197-210
        • de Vet HC
        • Terwee CB
        • Mokkink LB
        • Knol DL
        Measurement in medicine: A practical guide.
        Cambridge University Press, Cambridge2011
        • de Vet HC
        • Terwee CB
        • Ostelo RW
        • Beckerman H
        • Knol DL
        • Bouter LM
        Minimal changes in health status questionnaires: Distinction between minimally detectable change and minimally important change.
        Health Qual Life Outcomes. 2006; 4: 54
        • Deyo RA
        • Dworkin SF
        • Amtmann D
        • Andersson G
        • Borenstein D
        • Carragee E
        • Carrino J
        • Chou R
        • Cook K
        • DeLitto A
        • Goertz C
        • Khalsa P
        • Loeser J
        • Mackey S
        • Panagis J
        • Rainville J
        • Tosteson T
        • Turk D
        • Von Korff M
        • Weiner DK
        Report of the NIH Task Force on research standards for chronic low back pain.
        J Pain. 2014; 15: 569-585
        • Downie W
        • Leatham P
        • Rhind V
        • Wright V
        • Branco J
        • Anderson J
        Studies with pain rating scales.
        Ann Rheum Dis. 1978; 37: 378-381
        • Dworkin RH
        • Turk DC
        • Farrar JT
        • Haythornthwaite JA
        • Jensen MP
        • Katz NP
        • Kerns RD
        • Stucki G
        • Allen RR
        • Bellamy N
        • Carr DB
        • Chandler J
        • Cowan P
        • Dionne R
        • Galer BS
        • Hertz S
        • Jadad AR
        • Kramer LD
        • Manning DC
        • Martin S
        • McCormick CG
        • McDermott MP
        • McGrath P
        • Quessy S
        • Rappaport BA
        • Robbins W
        • Robinson JP
        • Rothman M
        • Royal MA
        • Simon L
        • Stauffer JW
        • Stein W
        • Tollett J
        • Wernicke J
        • Witter J
        Core outcome measures for chronic pain clinical trials: IMMPACT recommendations.
        Pain. 2005; 113: 9-19
        • Elfving B
        • Lund I
        • C LB
        • Bostrom C
        Ratings of pain and activity limitation on the visual analogue scale and global impression of change in multimodal rehabilitation of back pain - analyses at group and individual level.
        Disabil Rehabil. 2016; 38: 2206-2216
        • Farrar JT
        • Young Jr, JP
        • LaMoreaux L
        • Werth JL
        • Poole RM
        Clinical importance of changes in chronic pain intensity measured on an 11-point numerical pain rating scale.
        Pain. 2001; 94: 149-158
        • Filho IT
        • Simmonds MJ
        • Protas EJ
        • Jones S
        Back pain, physical function, and estimates of aerobic capacity: What are the relationships among methods and measures?.
        Am J Phys Med Rehabil. 2002; 81: 913-920
        • Fishbain DA
        • Gao J
        • Lewis JE
        • Zhang L
        At completion of a multidisciplinary treatment program, are psychophysical variables associated with a VAS improvement of 30% or more, a minimal clinically important difference, or an absolute VAS score improvement of 1.5 cm or more?.
        Pain Med. 2016; 17: 781-789
        • Fishbain DA
        • Lewis JE
        • Gao J
        Is there significant correlation between self-reported low back pain visual analogue scores and low back pain scores determined by pressure pain induction matching?.
        Pain Pract. 2013; 13: 358-363
        • Fritsch CG
        • Ferreira ML
        • Maher CG
        • Herbert RD
        • Pinto RZ
        • Koes B
        • Ferreira PH
        The clinical course of pain and disability following surgery for spinal stenosis: A systematic review and meta-analysis of cohort studies.
        Eur Spine J. 2017; 26: 324-335
        • Froud R
        • Patel S
        • Rajendran D
        • Bright P
        • Bjorkli T
        • Buchbinder R
        • Eldridge S
        • Underwood M
        A systematic review of outcome measures use, analytical approaches, reporting methods, and publication volume by year in low back pain trials published between 1980 and 2012: Respice, adspice, et prospice.
        PLoS One. 2016; 11e0164573
        • Furlan AD
        • Malmivaara A
        • Chou R
        • Maher CG
        • Deyo RA
        • Schoene M
        • Bronfort G
        • Van Tulder MW
        2015 updated method guideline for systematic reviews in the Cochrane Back and Neck Group.
        Spine. 2015; 40: 1660-1673
      2. GBD 2015 Disease and Injury Incidence and Prevalence Collaborators: Global, regional, and national incidence, prevalence, and years lived with disability for 310 diseases and injuries, 1990-2015: A systematic analysis for the Global Burden of Disease Study 2015. Lancet 388:1545-1602, 2016

        • Gronblad M
        • Hurri H
        • Kouri JP
        Relationships between spinal mobility, physical performance tests, pain intensity and disability assessments in chronic low back pain patients.
        Scand J Rehabil Med. 1997; 29: 17-24
        • Gronblad M
        • Lukinmaa A
        • Konttinen YT
        Chronic low-back pain: Intercorrelation of repeated measures for pain and disability.
        Scand J Rehabil Med. 1990; 22: 73-77
        • Grotle M
        • Brox JI
        • Vollestad NK
        Concurrent comparison of responsiveness in pain and functional status measurements used for patients with low back pain.
        Spine. 2004; 29: E492-E501
        • Guyatt GH
        • Oxman AD
        • Vist GE
        • Kunz R
        • Falck-Ytter Y
        • Alonso-Coello P
        • Schunemann HJ
        GRADE: An emerging consensus on rating quality of evidence and strength of recommendations.
        BMJ. 2008; 336: 924
        • Hagino C
        • Thompson M
        • Advent J
        • Rivet L
        Agreement between 2 pain visual analogue scales, by age and area of complaint in neck and low back pain subjects: The standard pen and paper VAS versus plastic mechanical sliderule VAS.
        J Can Chiropr Assoc. 1996; 40: 220
        • Hawker GA
        • Mian S
        • Kendzerska T
        • French M
        Measures of adult pain: Visual Analog Scale for Pain (VAS Pain), Numeric Rating Scale for Pain (NRS Pain), McGill Pain Questionnaire (MPQ), Short-Form McGill Pain Questionnaire (SF-MPQ), Chronic Pain Grade Scale (CPGS), Short Form-36 Bodily Pain Scale (SF-36 BPS), and Measure of Intermittent and Constant Osteoarthritis Pain (ICOAP).
        Arthritis Care Res. 2011; 63: S240-S252
        • Hazard RG
        • Haugh LD
        • Green PA
        • Jones PL
        Chronic low back pain: The relationship between patient satisfaction and pain, impairment, and disability outcomes.
        Spine. 1994; 19: 881-887
        • Henry SG
        • Bell RA
        • Fenton JJ
        • Kravitz RL
        Goals of chronic pain management: Do patients and primary care physicians agree and does it matter?.
        Clin J Pain. 2017; 33: 955-961
        • Hjermstad MJ
        • Fayers PM
        • Haugen DF
        • Caraceni A
        • Hanks GW
        • Loge JH
        • Fainsinger R
        • Aass N
        • Kaasa S
        Studies comparing numerical rating scales, verbal rating scales, and visual analogue scales for assessment of pain intensity in adults: A systematic literature review.
        J Pain Symptom Manage. 2011; 41: 1073-1093
        • Hush JM
        • Refshauge K
        • Sullivan G
        • De Souza L
        • Maher CG
        • McAuley JH
        Recovery: What does this mean to patients with low back pain?.
        Arthritis Rheum. 2009; 61: 124-131
        • Hush JM
        • Refshauge KM
        • Sullivan G
        • De Souza L
        • McAuley JH
        Do numerical rating scales and the Roland-Morris Disability Questionnaire capture changes that are meaningful to patients with persistent back pain?.
        Clin Rehabil. 2010; 24: 648-657
        • Huskisson E
        Measurement of pain.
        Lancet. 1974; 304: 1127-1131
        • Jamison RN
        • Raymond SA
        • Slawsby EA
        • McHugo GJ
        • Baird JC
        Pain assessment in patients with low back pain: Comparison of weekly recall and momentary electronic data.
        J Pain. 2006; 7: 192-199
      3. Jensen MP: The validity and reliability of pain measures for use in clinical trials in adults: Review paper written for the Initiative on Methods, Measurements, and Pain Assessment in Clinical Trials (IMMPACT) meeting. April 12–13 (2003), IMMPACT-II, http://www.immpact.org/static/meetings/Immpact2/background/Jensen_review.pdf, 2003. Accessed November 3, 2017

        • Jensen MP
        • Hu X
        • Potts SL
        • Gould EM
        Single vs composite measures of pain intensity: Relative sensitivity for detecting treatment effects.
        Pain. 2013; 154: 534-538
        • Jensen MP
        • Schnitzer TJ
        • Wang H
        • Smugar SS
        • Peloso PM
        • Gammaitoni A
        Sensitivity of single-domain versus multiple-domain outcome measures to identify responders in chronic low-back pain: Pooled analysis of 2 placebo-controlled trials of etoricoxib.
        Clin J Pain. 2012; 28: 1-7
        • Jensen MP
        • Tome-Pires C
        • Sole E
        • Racine M
        • Castarlenas E
        • de la Vega R
        • Miro J
        Assessment of pain intensity in clinical trials: Individual ratings vs composite scores.
        Pain Med. 2015; 16: 141-148
        • Jensen MP
        • Turner JA
        • Romano JM
        • Fisher LD
        Comparative reliability and validity of chronic pain intensity measures.
        Pain. 1999; 83: 157-162
        • Kahl C
        • Cleland JA
        Visual analogue scale, numeric pain rating scale and the McGill Pain Questionnaire: An overview of psychometric properties.
        Phys Ther Rev. 2005; 10: 123-128
        • Kaiser U
        • Kopkow C
        • Deckert S
        • Neustadt K
        • Jacobi L
        • Cameron P
        • De VA
        • Apfelbacher C
        • Arnold B
        • Birch J
        Developing a core outcome-domain set to assessing effectiveness of interdisciplinary multimodal pain therapy: The VAPAIN consensus statement on core outcome-domains.
        Pain. 2018; 159: 673-683
        • Kamper SJ
        • Apeldoorn AT
        • Chiarotto A
        • Smeets RJ
        • Ostelo RW
        • Guzman J
        • van Tulder MW
        Multidisciplinary biopsychosocial rehabilitation for chronic low back pain.
        Cochrane Database Syst Rev. 2014; Cd000963
        • Keller S
        • Bann CM
        • Dodd SL
        • Schein J
        • Mendoza TR
        • Cleeland CS
        Validity of the brief pain inventory for use in documenting the outcomes of patients with noncancer pain.
        Clin J Pain. 2004; 20: 309-318
        • Kovacs FM
        • Abraira V
        • Royuela A
        • Corcoll J
        • Alegre L
        • Cano A
        • Muriel A
        • Zamora J
        • del Real MT
        • Gestoso M
        • Mufraggi N
        Minimal clinically important change for pain intensity and disability in patients with nonspecific low back pain.
        Spine. 2007; 32: 2915-2920
        • Krebs EE
        • Bair MJ
        • Damush TM
        • Tu W
        • Wu J
        • Kroenke K
        Comparative responsiveness of pain outcome measures among primary care patients with musculoskeletal pain.
        Med Care. 2010; 48: 1007-1014
        • Lapane KL
        • Quilliam BJ
        • Benson C
        • Chow W
        • Kim M
        One, two, or three? Constructs of the brief pain inventory among patients with non-cancer pain in the outpatient setting.
        J Pain Symtpom Manage. 2014; 47: 325-333
        • Lauridsen HH
        • Hartvigsen J
        • Manniche C
        • Korsholm L
        • Grunnet-Nilsson N
        Responsiveness and minimal clinically important difference for pain and disability instruments in low back pain patients.
        BMC Musculoskelet Disord. 2006; 7: 82
        • Lauridsen HH
        • Manniche C
        • Korsholm L
        • Grunnet-Nilsson N
        • Hartvigsen J
        What is an acceptable outcome of treatment before it begins? Methodological considerations and implications for patients with chronic low back pain.
        Eur Spine J. 2009; 18: 1858-1866
        • Law M
        • McIntosh J
        • Morrison L
        • Baptiste S
        A comparison of two pain measurement scales: Their clinical value.
        Can J Rehabil. 1987; 1: 55-58
        • Lee H
        • Hübscher M
        • Moseley GL
        • Kamper SJ
        • Traeger AC
        • Mansell G
        • McAuley JH
        How does pain lead to disability? A systematic review and meta-analysis of mediation studies in people with back and neck pain.
        Pain. 2015; 156: 988-997
        • Lee TH
        Zero pain is not the goal.
        JAMA. 2016; 315: 1575-1577
        • Love A
        • Leboeuf C
        • Crisp TC
        Chiropractic chronic low back pain sufferers and self-report assessment methods. Part I. A reliability study of the visual analogue scale, the pain drawing and the McGill Pain Questionnaire.
        J Manipulative Physiol Ther. 1989; 12: 21-25
        • Machado GC
        • Maher CG
        • Ferreira PH
        • Day RO
        • Pinheiro MB
        • Ferreira ML
        Non-steroidal anti-inflammatory drugs for spinal pain: A systematic review and meta-analysis.
        Ann Rheum Dis. 2017; 76: 1269-1278
        • Machin D
        • Lewith GT
        • Wylson S
        Pain measurement in randomized clinical trials: A comparison of two pain scales.
        Clin J Pain. 1988; 4: 161-168
        • Maher C
        • Underwood M
        • Buchbinder R
        Non-specific low back pain.
        Lancet. 2017; 389: 736-747
        • Marin TJ
        • Van Eerd D
        • Irvin E
        • Couban R
        • Koes BW
        • Malmivaara A
        • van Tulder MW
        • Kamper SJ
        Multidisciplinary biopsychosocial rehabilitation for subacute low back pain.
        Cochrane Database Syst Rev. 2017; 6CD002193
        • Maughan EF
        • Lewis JS
        Outcome measures in chronic low back pain.
        Eur Spine J. 2010; 19: 1484-1494
        • McRae M
        • Hancock MJ
        Adults attending private physiotherapy practices seek diagnosis, pain relief, improved function, education and prevention: A survey.
        J Physiother. 2017; 63: 250-256
        • Moher D
        • Liberati A
        • Tetzlaff J
        • Altman DG
        • Group P
        Preferred reporting items for systematic reviews and meta-analyses: The PRISMA statement.
        PLoS Med. 2009; 6e1000097
        • Mokkink LB
        • De Vet HC
        • Prinsen CA
        • Patrick DL
        • Alonso J
        • Bouter LM
        • Terwee CB
        COSMIN risk of bias checklist for systematic reviews of patient-reported outcome measures.
        Qual Life Res. 2018; 27: 1171-1179
        • Mokkink LB
        • Terwee CB
        • Patrick DL
        • Alonso J
        • Stratford PW
        • Knol DL
        • Bouter LM
        • de Vet HC
        The COSMIN study reached international consensus on taxonomy, terminology, and definitions of measurement properties for health-related patient-reported outcomes.
        J Clin Epidemiol. 2010; 63: 737-745
        • Olaogun MO
        • Adedoyin RA
        • Ikem IC
        • Anifaloba OR
        Reliability of rating low back pain with a visual analogue scale and a semantic differential scale.
        Physiother Theory Pract. 2004; 20: 135-142
        • Ostelo RW
        • Deyo RA
        • Stratford P
        • Waddell G
        • Croft P
        • Von Korff M
        • Bouter LM
        • de Vet HC
        Interpreting change scores for pain and functional status in low back pain: Towards international consensus regarding minimal important change.
        Spine. 2008; 33: 90-94
        • Ostelo RW
        • Swinkels-Meewisse IJ
        • Knol DL
        • Vlaeyen JW
        • de Vet HC
        Assessing pain and pain-related fear in acute low back pain: What is the smallest detectable change?.
        Int J Behav Med. 2007; 14: 242-248
        • Page MJ
        • Huang H
        • Verhagen AP
        • Buchbinder R
        • Gagnier JJ
        Identifying a core set of outcome domains to measure in clinical trials for shoulder disorders: A modified Delphi study.
        RMD Open. 2016; 2e000380
        • Park KB
        • Shin JS
        • Lee J
        • Lee YJ
        • Kim MR
        • Lee JH
        • Shin KM
        • Shin BC
        • Cho JH
        • Ha IH
        Minimum clinically important difference and substantial clinical benefit in pain, functional, and quality of life scales in failed back surgery syndrome patients.
        Spine. 2017; 42: E474-e481
        • Parreira P
        • Heymans MW
        • van Tulder MW
        • Esmail R
        • Koes BW
        • Poquet N
        • Lin CWC
        • Maher CG
        Back schools for chronic non-specific low back pain.
        Cochrane Database Syst Rev. 2017; 8CD011674
        • Paungmali A
        • Sitilertpisan P
        • Taneyhill K
        • Pirunsan U
        • Uthaikhup S
        Intrarater reliability of pain intensity, tissue blood flow, thermal pain threshold, pressure pain threshold and lumbo-pelvic stability tests in subjects with low back pain.
        Asian J Sports Med. 2012; 3: 8-14
        • Pengel LH
        • Refshauge KM
        • Maher CG
        Responsiveness of pain, disability, and physical impairment outcomes in patients with low back pain.
        Spine. 2004; 29: 879-883
        • Price DD
        • Harkins SW
        Combined use of experimental pain and visual analogue scales in providing standardized measurement of clinical pain.
        Clin J Pain. 1987; 3: 1-8
        • Price DD
        • McGrath PA
        • Rafii A
        • Buckingham B
        The validation of visual analogue scales as ratio scale measures for chronic and experimental pain.
        Pain. 1983; 17: 45-56
        • Prinsen CA
        • Mokkink LB
        • Bouter LM
        • Alonso J
        • Patrick DL
        • De Vet HC
        • Terwee CB
        COSMIN guideline for systematic reviews of patient-reported outcome measures.
        Qual Life Res. 2018; 27: 1147-1157
        • Prinsen CA
        • Vohra S
        • Rose MR
        • Boers M
        • Tugwell P
        • Clarke M
        • Williamson PR
        • Terwee CB
        How to select outcome measurement instruments for outcomes included in a “Core Outcome Set”: A practical guideline.
        Trials. 2016; 17: 449
        • Ramasamy A
        • Martin ML
        • Blum SI
        • Liedgens H
        • Argoff C
        • Freynhagen R
        • Wallace M
        • McCarrier KP
        • Bushnell DM
        • Hatley NV
        • Patrick DL
        Assessment of patient-reported outcome instruments to assess chronic low back pain.
        Pain Med. 2017; 18: 1098-1110
        • Roach KE
        • Brown MD
        • Dunigan KM
        • Kusek CL
        • Walas M
        Test-retest reliability of patient reports of low back pain.
        J Orthop Sports Phys Ther. 1997; 26: 253-259
        • Robinson-Papp J
        • George MC
        • Dorfman D
        • Simpson DM
        Barriers to chronic pain measurement: A qualitative study of patient perspectives.
        Pain Med. 2015; 16: 1256-1264
        • Scrimshaw SV
        • Maher C
        Responsiveness of visual analogue and McGill pain scale measures.
        J Manipulative Physiol Ther. 2001; 24: 501-504
        • Shea BJ
        • Grimshaw JM
        • Wells GA
        • Boers M
        • Andersson N
        • Hamel C
        • Porter AC
        • Tugwell P
        • Moher D
        • Bouter LM
        Development of AMSTAR: A measurement tool to assess the methodological quality of systematic reviews.
        BMC Med Res Methodol. 2007; 7: 10
        • Sheldon EA
        • Bird SR
        • Smugar SS
        • Tershakovec AM
        Correlation of measures of pain, function, and overall response: Results pooled from two identical studies of etoricoxib in chronic low back pain.
        Spine. 2008; 33: 533-538
        • Solomon D
        • Roopchand-Martin S
        • Swaminathan N
        • Heymans MW
        How well do pain scales correlate with each other and with the Oswestry Disability Questionnaire?.
        Int J Ther Rehabil. 2011; 18
        • Song CY
        • Lin SF
        • Huang CY
        • Wu HC
        • Chen CH
        • Hsieh CL
        Validation of the Brief Pain Inventory in patients with low back pain.
        Spine. 2016; 41: E937-E942
        • Stinson JN
        • Kavanagh T
        • Yamada J
        • Gill N
        • Stevens B
        Systematic review of the psychometric properties, interpretability and feasibility of self-report pain intensity measures for use in clinical trials in children and adolescents.
        Pain. 2006; 125: 143-157
        • Strong J
        • Ashton R
        • Chant D
        Pain intensity measurement in chronic low back pain.
        Clin J Pain. 1991; 7: 209-218
        • Sullivan MD
        • Ballantyne JC
        Must we reduce pain intensity to treat chronic pain?.
        Pain. 2016; 157: 65-69
        • Tan G
        • Jensen MP
        • Thornby JI
        • Shanti BF
        Validation of the Brief Pain Inventory for chronic nonmalignant pain.
        J Pain. 2004; 5: 133-137
        • Terwee CB
        • Jansma EP
        • Riphagen II
        • de Vet HC
        Development of a methodological PubMed search filter for finding studies on measurement properties of measurement instruments.
        Qual Life Res. 2009; 18: 1115-1123
        • Terwee CB
        • Mokkink LB
        • Knol DL
        • Ostelo RW
        • Bouter LM
        • de Vet HC
        Rating the methodological quality in systematic reviews of studies on measurement properties: A scoring system for the COSMIN checklist.
        Qual Life Res. 2012; 21: 651-657
        • Terwee CB
        • Prinsen CA
        • Chiarotto A
        • De Vet HC
        • Westerman MJ
        • Patrick DL
        • Alonso J
        • Bouter LM
        • Mokkink LB
        COSMIN methodology for evaluating the content validity of patient-reported outcome measures: A Delphi study.
        Qual Life Res. 2018; 27: 1159-1170
        • Triano JJ
        • McGregor M
        • Cramer GD
        • Emde DL
        A comparison of outcome measures for use with back pain patients: Results of a feasibility study.
        J Manipulative Physiol Ther. 1993; 16: 67-73
        • Turk DC
        • Dworkin RH
        • Allen RR
        • Bellamy N
        • Brandenburg N
        • Carr DB
        • Cleeland C
        • Dionne R
        • Farrar JT
        • Galer BS
        • Hewitt DJ
        • Jadad AR
        • Katz NP
        • Kramer LD
        • Manning DC
        • McCormick CG
        • McDermott MP
        • McGrath P
        • Quessy S
        • Rappaport BA
        • Robinson JP
        • Royal MA
        • Simon L
        • Stauffer JW
        • Stein W
        • Tollett J
        • Witter J
        Core outcome domains for chronic pain clinical trials: IMMPACT recommendations.
        Pain. 2003; 106: 337-345
        • Turk DC
        • Dworkin RH
        • Revicki D
        • Harding G
        • Burke LB
        • Cella D
        • Cleeland CS
        • Cowan P
        • Farrar JT
        • Hertz S
        • Max MB
        • Rappaport BA
        Identifying important outcome domains for chronic pain clinical trials: An IMMPACT survey of people with pain.
        Pain. 2008; 137: 276-285
        • van der Roer N
        • Ostelo RW
        • Bekkering GE
        • van Tulder MW
        • de Vet HC
        Minimal clinically important change for pain intensity, functional status, and general health status in patients with nonspecific low back pain.
        Spine. 2006; 31: 578-582
        • Whiting P
        • Savovic J
        • Higgins JP
        • Caldwell DM
        • Reeves BC
        • Shea B
        • Davies P
        • Kleijnen J
        • Churchill R
        ROBIS: A new tool to assess risk of bias in systematic reviews was developed.
        J Clin Epidemiol. 2016; 69: 225-234
        • Whynes DK
        • McCahon RA
        • Ravenscroft A
        • Hodgkinson V
        • Evley R
        • Hardman JG
        Responsiveness of the EQ-5D health-related quality-of-life instrument in assessing low back pain.
        Value Health. 2013; 16: 124-132
        • Williams ACdC
        • Davies HTO
        • Chadury Y
        Simple pain rating scales hide complex idiosyncratic meanings.
        Pain. 2000; 85: 457-463
        • Williamson A
        • Hoggart B
        Pain: A review of three commonly used pain rating scales.
        J Clin Nurs. 2005; 14: 798-804
        • Wright AA
        • Cook CE
        Criterion validation of the rate of recovery, single alphanumeric measure, in patients with low back pain.
        Physiother Res Int. 2013; 18: 124-129