Oncology Outpatient and Provider Responses to a Computerized Symptom Assessment System

Janet S. Carpenter

Susan M. Rawl

Jennifer Porter

Karen Schmidt

Jennifer Tornatta

Foluso Ojewole

Paul R. Helft

David A. Potter

Christopher Sweeney

R. Brian Giesler

symptom assessment, outpatient setting, healthcare providers
ONF 2008, 35(4), 661-669. DOI: 10.1188/08/ONF.661-669

Purpose/Objectives: To assess patient and provider responses to a computerized symptom assessment system.

Design: Descriptive, longitudinal study with retrospective, longitudinal medical records review.

Setting: University-based National Cancer Institute-designated outpatient cancer center.

Sample: 80 oncology outpatients receiving chemotherapy, 8 providers, and 30 medical records.

Methods: Patients completed the computerized assessment during three chemotherapy follow-up clinic appointments (times 1, 2, and 3). Patient usability was recorded via an observer checklist (ease of use) and the computer (completion time). Patient satisfaction and impact were assessed during telephone interviews two to three days after times 1 and 3 only. Provider usability and impact were assessed at the end of the study using a questionnaire and focus groups, whereas effect on provider documentation was assessed through chart audits.

Main Research Variables: Patient usability (ease of use, completion time), satisfaction, and impact; provider usability and impact.

Findings: Patients reported good usability, high satisfaction, and modest impact on discussions with their providers. Providers reported modest usability, modest impact on discussions with patients, and had varied reactions as to how the system affected practice. Documentation of symptoms was largely absent before and after implementation.

Conclusions: This system demonstrated good usability and satisfaction but had only a modest impact on symptom-related discussions and no impact on documentation.

Implications for Nursing: A computerized system can help address barriers to symptom assessment but may not improve documentation unless it can be integrated into existing medical records systems.

Jump to a section


    Velikova, G., Wright, E. P., Smith, A. B., Cull, A., Gould, A., Forman, D., et al. (1999). Automated collection of quality-of-life data: A comparison of paper and computer touch-screen questionnaires. Journal of Clinical Oncology, 17(3), 998-1007.
    Ward, S. E., Goldberg, N., Miller-McCauley, V., Mueller, C., Nolan, A., Pawlik-Plank, D., et al. (1993). Patient-related barriers to management of cancer pain. Pain, 52(3), 319-324.
    Wilkie, D. J., Huang, H. Y., Berry, D. L., Schwartz, A., Lin, Y. C., Ko, N. Y., et al. (2001). Cancer symptom control: Feasibility of a tailored, interactive computerized program for patients. Family and Community Health, 24(3), 48-62.
    Barsevick, A. M. (2007). The concept of symptom cluster. Seminars in Oncology Nursing, 23(2), 89-98.
    Beck, S. L., Schwartz, A. L., Towsley, G., Dudley, W., & Barsevick, A. (2004). Psychometric evaluation of the Pittsburgh Sleep Quality Index in cancer patients. Journal of Pain and Symptom Management, 27(2), 140-148.
    Berry, D. L., Trigg, L. J., Lober, W. B., Karras, B. T., Galligan, M. L., Austin-Seymour, M., et al. (2004). Computerized symptom and quality-of-life assessment for patients with cancer part I: Development and pilot testing [Online exclusive]. Oncology Nursing Forum, 31(5), E75-E83. Retrieved May 29, 2008, from…
    Daut, R. L., Cleeland, C. S., & Flanery, R. C. (1983). Development of the Wisconsin brief pain questionnaire to assess pain in cancer and other diseases. Pain, 17(2), 197-210.
    Detmar, S. B., & Aaronson, N. K. (1998). Quality of life assessment in daily clinical oncology practice: A feasibility study. European Journal of Cancer, 34(8), 1181-1186.
    DeVon, H. A., Ryan, C. J., & Zerwic, J. J. (2004). Is the medical record an accurate reflection of patients' symptoms during acute myocardial infarction? Western Journal of Nursing Research, 26(5), 547-560.
    Dodd, M., Janson, S., Facione, N., Faucett, J., Froelicher, E. S., Humphreys, J., et al. (2001). Advancing the science of symptom management. Journal of Advanced Nursing, 33(5), 668-676.
    Escalante, C. P., Grover, T., Johnson, B. A., Harle, M., Guo, H., Mendoza, T. R., et al. (2001). A fatigue clinic in a comprehensive cancer center: Design and experiences. Cancer, 92(6, Suppl.), 1708-1713.
    Finkelstein, J., Cabrera, M. R., & Hripcsak, G. (2000). Internet-based home asthma telemonitoring: Can patients handle the technology? Chest, 117(1), 148-155.
    Institute of Medicine. (2003). Improving palliative care: We can take better care of people with cancer. Washington, DC: National Academy of Sciences.
    Kim, H. J., McGuire, D. B., Tulman, L., & Barsevick, A. M. (2005). Symptom clusters: Concept analysis and clinical implications for cancer nursing. Cancer Nursing, 28(4), 270-282.
    Larson, P. J., Carrieri-Kohlman, V., Dodd, M. J., Douglas, M., Faucett, J., & Froelicher, E. S. (1994). A model for symptom management. Image: Journal of Nursing Scholarship, 26(5), 547-560.
    McDonald, M. V., Passik, S. D., Dugan, W., Rosenfeld, B., Theobald, D. E., & Edgerton, S. (1999). Nurses' recognition of depression in their patients with cancer. Oncology Nursing Forum, 26(3), 593-599.
    Mendoza, T. R., Wang, X. S., Cleeland, C. S., Morrissey, M., Johnson, B. A., Wendt, J. K., et al. (1999). The rapid assessment of fatigue severity in cancer patients: Use of the Brief Fatigue Inventory. Cancer, 85(5), 1186-1196.
    Mullen, K. H., Berry, D. L., & Zierler, B. K. (2004). Computerized symptom and quality-of-life assessment for patients with cancer part II: Acceptability and usability. Oncology Nursing Forum, 31(5), E84-E89. Retrieved June 20, 2008, from
    National Comprehensive Cancer Network. (2006). National Comprehensive Cancer Network Clinical Practice Guidelines in Oncology: Distress management. Retrieved May 29, 2008, from
    National Institutes of Health. (2007). Patient-Reported Outcomes Measurement Information System (PROMIS). Retrieved August 21, 2007, from
    Oncology Nursing Society. (2007). Oncology Nursing Society's role in multisite research. Retrieved August 21, 2007, from
    Passik, S. D., Dugan, W., McDonald, M. V., Rosenfeld, B., Theobald, D. E., & Edgerton, S. (1998). Oncologists' recognition of depression in their patients with cancer. Journal of Clinical Oncology, 16(4), 1594-1600.
    Patrick, D. L., Ferketich, S. L., Frame, P. S., Harris, J. J., Hendricks, C. B., Levin, B., et al. (2004). National Institutes of Health State-of-the-Science Conference statement: Symptom management in cancer: pain, depression, and fatigue, July 15-17, 2002. Journal of the National Cancer Institute. Monographs, 2004(32), 9-16.
    Rogers, M. S., & Todd, C. J. (2000). The ‘right kind’ of pain: Talking about symptoms in outpatient oncology consultations. Palliative Medicine, 14(4), 299-307.
    Savard, J., & Morin, C. M. (2001). Insomnia in the context of cancer: A review of a neglected problem. Journal of Clinical Oncology, 19(3), 895-908.
    Serlin, R. C., Mendoza, T. R., Nakamura, Y., Edwards, K. R., & Cleeland, C. S. (1995). When is cancer pain mild, moderate or severe? Grading pain severity by its interference with function. Pain, 61(2), 277-284.
    Smith, A. B., Selby, P. J., Velikova, G., Stark, D., Wright, E. P., Gould, A., et al. (2002). Factor analysis of the Hospital Anxiety and Depression Scale from a large cancer population. Psychology and Psychotherapy, 75(Pt. 2), 165-176.
    Stone, P., Richardson, A., Ream, E., Smith, A. G., Kerr, D. J., Kearney, N., et al. (2000). Cancer-related fatigue: Inevitable, unimportant and untreatable? Results of a multi-centre patient survey. Annals of Oncology, 11(8), 971-975.
    Stromgren, A. S., Groenvold, M., Pedersen, L., Olsen, A. K., Spile, M., & Sjogren, P. (2001). Does the medical record cover the symptoms experienced by cancer patients receiving palliative care? A comparison of the record and patient self-rating. Journal of Pain and Symptom Management, 21(3), 189-196.
    Stromgren, A. S., Groenvold, M., Sorensen, A., & Andersen, L. (2001). Symptom recognition in advanced cancer. A comparison of nursing records against patient self-rating. Acta Anaesthesiologica Scandinavica, 45(9), 1080-1085.
    Taenzer, P., Bultz, B. D., Carlson, L. E., Speca, M., DeGagne, T., Olson, K., et al. (2000). Impact of computerized quality of life screening on physician behaviour and patient satisfaction in lung cancer outpatients. Psycho-Oncology, 9(3), 203-213.
    Wilkie, D. J., Judge, M. K., Berry, D. L., Dell, J., Zong, S., & Gilespie, R. (2003). Usability of a computerized PAINReportIt in the general public with pain and people with cancer pain. Journal of Pain and Symptom Management, 25(3), 213-224.
    Wright, E. P., Selby, P. J., Crawford, M., Gillibrand, A., Johnston, C., Perren, T. J., et al. (2003). Feasibility and compliance of automated measurement of quality of life in oncology practice. Journal of Clinical Oncology, 21(2), 374-382.