Do You Recall?: Results From a Within-Person Recall Study of the Patient-Reported Outcomes Measurement Information System (PROMIS) Short Form v2.0 – Physical Function 8c

Published:October 03, 2021DOI:


      • The Patient-Reported Outcomes Measurement Information System Physical Function Short Form v2.0 – Physical Function 8c (PROMIS PF8c) instrument is a useful clinical outcome assessment to capture patient-reported physical functioning among patients with advanced cancer currently being considered for qualification as a drug development tool with the US Food and Drug Administration. There are currently 2 versions of the PROMIS PF8c: one with a 7-day recall and one with no recall. This article determined whether these versions yielded similar responses using a within-person design.
      • Responses to the no recall and 7-day recall versions of the PROMIS PF8c were very similar. Both in terms of T scores and raw scores, average differences between these versions approached 0.
      • Given that it is more similar to other PROMIS Physical Function measures, the no recall version is a preferable choice for administering the PF8c.



      This study aimed to determine whether responses to Patient-Reported Outcomes Measurement Information System Short Form v2.0 – Physical Function 8c (PROMIS PF8c) items differed when the use of a 7-day recall period was compared with no specified recall period.


      Using a within-subject design, we surveyed 1810 individuals from the US general population, administering PROMIS PF8c at survey beginning and end. The order of measure presentation was randomly assigned. We calculated recall difference scores (RDSs) as no recall score minus 7-day recall score using both item response theory-based T scores and raw summed scores. We examined the distribution and created Bland-Altman plots for both RDSTscore and RDSRaw. We also calculated correlations between no recall versus 7-day recall T score and raw scores. Finally, we determined whether differences in no recall versus 7-day recall scores were associated with patient-reported PF.


      RDSTscore and RDSRaw had means (root mean square differences) of 0.00 (5.43) and −0.04 (3.79), respectively. The vast majority (%) of RDSTscore and RDSRaw values fell between the Bland-Altman limits of agreement (−10.65 to 10.66 and −7.46 to 7.38, respectively). Pearson’s correlations between no recall and 7-day recall for T scores and raw scores were 0.88 and 0.87, respectively. Effect sizes for mean RDSTscore and RDSRaw compared across level of Eastern Oncology Cooperative Group performance status, patient global impression of PF severity, and single PF items were near 0.


      We did not find any significant recall period effect on PF8c responses. Therefore, we recommend the use of the PROMIS physical function standard, with no specified recall time period.


      To read this article in full you will need to make a payment


      Subscribe to Value in Health
      Already a print subscriber? Claim online access
      Already an online subscriber? Sign in
      Institutional Access: Sign in to ScienceDirect


      1. Clinical outcome assessment (COA) qualification program. US Food and Drug Administration.
      2. Drug development tool (DDT) qualification programs. US Food and Drug Administration.
      3. Qualification Process for drug development tools guidance for industry and FDA staff. US Food and Drug Administration.
        • Kluetz P.G.
        • Slagle A.
        • Papadopoulos E.J.
        • et al.
        Focusing on Core patient-reported outcomes in cancer clinical trials: symptomatic adverse events, physical function, and disease-related symptoms.
        Clin Cancer Res. 2016; 22: 1553-1558
        • Blumenthal G.M.
        • Kluetz P.G.
        • Schneider J.
        • Goldberg K.B.
        • McKee A.E.
        • Pazdur R.
        Oncology drug approvals: evaluating endpoints and evidence in an era of breakthrough therapies.
        Oncologist. 2017; 22: 762-767
      4. DDT COA #000079: PROMIS® physical function in oncology. US Food and Drug Administration.
        • Condon D.M.
        • Chapman R.
        • Shaunfield S.
        • et al.
        Does recall period matter? Comparing PROMIS® physical function with no recall, 24-hr recall, and 7-day recall.
        Qual Life Res. 2020; 29: 745-753
        • Cella D.
        • Riley W.
        • Stone A.
        • et al.
        The Patient-Reported Outcomes Measurement Information System (PROMIS) developed and tested its first wave of adult self-reported health outcome item banks: 2005-2008.
        J Clin Epidemiol. 2010; 63: 1179-1194
        • Bowker A.H.
        A test for symmetry in contingency tables.
        J Am Stat Assoc. 1948; 43: 572-574
        • Bland J.M.
        • Altman D.G.
        Statistical methods for assessing agreement between two methods of clinical measurement.
        Lancet. 1986; 1: 307-310
        • Hinkle D.E.
        • Wiersma W.
        • Jurs S.G.
        Applied Statistics for the Behavioral Science.
        5th ed. Houghton Mifflin, Boston, MA2003
        • Fleiss J.
        Statistical Methods for Rates and Proportions.
        Wiley & Sons, Toronto, Canada2004
        • Samejima F.
        Graded response model.
        in: van der Linden W.J. Hambleton R.K. Handbook of Modern Item Response Theory. Springer New York, New York, NY1997: 85-100
        • Felt J.M.
        • Castaneda R.
        • Tiemensma J.
        • Depaoli S.
        Using person fit statistics to detect outliers in survey research.
        Front Psychol. 2017; 8 (863-863)
        • Cohen J.
        Statistical Power Analysis for the Behavioral Science.
        Academic Press, New York, NY1988
        • Bruce B.
        • Fries J.F.
        • Ambrosini D.
        • et al.
        Better assessment of physical function: item improvement is neglected but essential.
        Arthritis Res Ther. 2009; 11: R191
        • Ulrich C.M.
        • Wallen G.R.
        • Feister A.
        • Grady C.
        Respondent burden in clinical research: when are we asking too much of subjects?.
        IRB. 2005; 27: 17-20
        • Ulrich C.M.
        • Knafl K.A.
        • Ratcliffe S.J.
        • et al.
        Developing a model of the benefits and burdens of research participation in cancer clinical trials.
        AJOB Prim Res. 2012; 3: 10-23
        • Vose J.M.
        • Levit L.A.
        • Hurley P.
        • et al.
        Addressing administrative and regulatory burden in cancer clinical trials: summary of a stakeholder survey and workshop hosted by the American Society of Clinical Oncology and the Association of American cancer institutes.
        J Clin Oncol. 2016; 34: 3796-3802
        • Riis C.L.
        • Bechmann T.
        • Jensen P.T.
        • Coulter A.
        • Steffensen K.D.
        Are patient-reported outcomes useful in post-treatment follow-up care for women with early breast cancer? A scoping review.
        Patient Relat Outcome Meas. 2019; 10: 117-127
        • Lundy J.J.
        • Coon C.D.
        • Fu A.C.
        • Pawar V.
        Collection of post-treatment PRO data in oncology clinical trials.
        Ther Innov Regul Sci. 2021; 55: 111-117