Reliability and Validity of Health-Related Quality of Life Instruments for Breast Cancer Patients in Asia: A Systematic Review and Meta-Analysis

 

Kinanti Citra Weny1, Pujiyanto2*

Universitas Indonesia, Indonesia

Email: drkinanticitra@gmail.com

 

KEYWORDS

ABSTRACT

HRQoL, breast cancer, reliability, validity, EORTC QLQ-C30, QLQ-BR23, FACIT-Sp12, meta-analysis, Asia.

Health-related quality of life (HRQoL) instruments are crucial for assessing breast cancer patients' well-being. This research reviewed and meta-analyzed the reliability and validity of widely used HRQoL instruments, including EORTC QLQ-C30, QLQ-BR23, and FACIT-Sp12, in Asian breast cancer populations. Searches in PubMed, Embase, and Web of Science up to November 2024 identified five studies with 818 patients. Reliability was assessed using Cronbach’s alpha, with pooled values calculated via a random-effects model. EORTC QLQ-C30 and QLQ-BR23 showed strong reliability, with pooled Cronbach’s alpha values of 0.881 (I² = 93%) and 0.860 (I² = 90%), respectively, while FACIT-Sp12 demonstrated excellent reliability (α = 0.87). High heterogeneity in EORTC QLQ-C30 and QLQ-BR23 results likely stemmed from population and research design variations. Validity data were inconsistently reported but highlighted QLQ-BR23's superior item discriminant validity and QLQ-C30's strong construct validity (CVI = 0.98). These instruments are reliable tools for HRQoL assessment in Asian breast cancer populations. However, variability in validity reporting and significant heterogeneity limit their universal applicability. To enhance their use in Asia, future studies should standardize validity methodologies, address heterogeneity sources, and consider cultural diversity. Additionally, digital adaptations and resource-sensitive approaches are needed to make these tools more accessible in diverse and resource-limited settings. This will ensure more accurate and equitable assessments of HRQoL across Asia.

DOI: 10.58860/ijsh.v4i1.277

 

Corresponding Author: Pujiyanto*

Email: drkinanticitra@gmail.com

INTRODUCTION

Breast cancer remains the most common cancer among women worldwide, with a substantial burden observed in Asia due to its diverse populations, healthcare systems, and cultural contexts (Yap et al., 2019). Evaluating health-related quality of life (HRQoL) in breast cancer patients is essential for understanding their overall well-being during and after treatment. Reliable and valid HRQoL assessment tools are critical, especially as the HRQoL of breast cancer patients in Asia is often reported to be lower than that of the general population (Salas et al., 2022).

In Asia, the region's cultural and linguistic diversity underscores the need for HRQoL questionnaires that are not only reliable and valid but also appropriately adapted to its unique sociocultural contexts (Zaki et al., 2025). Widely used tools, such as the European Organisation for Research and Treatment of Cancer Quality of Life Questionnaire (EORTC QLQ-C30), Functional Assessment of Cancer Therapy-Breast (FACT-B), and Breast Cancer-Specific Quality of Life Questionnaire (QLQ-BR23), exhibit variability in their psychometric properties and applicability across different settings. Despite the availability of these tools, the lack of standardized validation methodologies tailored for Asia has resulted in inconsistent adaptation and use, further complicating cross-research comparisons and hindering the development of region-specific clinical and research practices (Jerbi, 2025).

This systematic review and meta-analysis aimed to evaluate the reliability and validity of HRQoL questionnaires used for breast cancer patients in Asia (Sun et al., 2023). By comparing the psychometric properties of these tools, the research addresses a significant gap in the literature by providing evidence on their suitability for the region. Additionally, it highlights the urgent need for standardized validation methodologies to ensure consistency and reliability in the adaptation and application of HRQoL instruments across diverse Asian contexts. This will ultimately facilitate more robust research and clinical practice, enabling a better understanding of the quality of life of breast cancer patients in the region (Cardoso et al., 2018).

Based on the background above, the objective of this research is to evaluate the reliability and validity of health-related quality of life (HRQoL) measurement tools used for breast cancer patients in Asia. This research aims to identify the most appropriate measurement tools based on their psychometric properties and to develop recommendations for standardized validation methodologies that can be applied within the diverse cultural and linguistic contexts of Asia. The benefits of this research include making a significant contribution to the advancement of research and clinical practices in Asia. With reliable and valid HRQoL measurement tools, this research can assist healthcare professionals and researchers in understanding the holistic needs of breast cancer patients, enabling more targeted interventions. Furthermore, the findings of this research are expected to serve as a foundation for developing health policies and improving the quality of life of breast cancer patients in the region through a more standardized and culturally relevant approach.

 

METHOD

A thorough literature search was conducted by two independent reviewers using multiple electronic databases, including PubMed, ScienceDirect, and ProQuest, from inception until October 1st, 2024. The search terms included “Breast cancer,” “Breast neoplasm,” “Health-related Quality of Life,” “Validity,” “Reliability,” and “Asia,” which were adjusted as per the specific search criteria of each database. To address potential publication bias, strategies such as the use of funnel plots for visual assessment and sensitivity analyses to test the robustness of the findings were incorporated.

This review includes studies conducted in Asia that report the questionnaire for assessing the HRQoL of breast cancer patients. Studies were included if they: (1) focused on adult patients (≥18 years old) with newly diagnosed or followed-up breast cancer in Asian countries, (2) used HRQoL questionnaires as part of their assessment, (3) included psychometric evaluations such as Cronbach’s alpha, test-retest reliability, construct validity, or criterion validity, and (4) were observational studies (cross-sectional, cohort, or case-control) or validation studies. Only peer-reviewed publications that provide specific instruments for assessing HRQoL of breast cancer patients were included.

Data extraction from the included studies was carried out independently by two investigators. To enhance consistency among reviewers, a pilot phase was conducted using the first five studies. Any discrepancies during data extraction were resolved through consensus. Predefined forms were used to extract data into a spreadsheet program, capturing the following metrics: author and year, country, research design, number of patients, mean age, patient characteristics, instrument details, and psychometric outcomes, including reliability metrics (e.g., Cronbach’s alpha) and validity measures (e.g., construct or criterion validity). Funnel plots were generated to assess the symmetry of effect sizes, and sensitivity analyses were performed to determine the impact of excluding studies with high risk of bias or outliers on the overall conclusions (Afonso et al., 2024).

 

RESULT AND DISCUSSION

Literature Search and Characteristics of Included Studies

After conducting the author search on electronic databases using the specified search strategy, a total of 1342 studies were identified. Among these, 853 studies were duplicates, and an additional 237 studies were excluded after reviewing the titles and abstracts. Further exclusions were made based on availability and failure to meet the inclusion criteria (Maghfour et al., 2023). The search yielded in a final fifteen studies for qualitative analysis and five studies for quantitative synthesis (Figure 1). The five included studies were conducted in Kuwait, China, Iran, India, and Nepal, with sample sizes ranging from 50 to 348 patients. The average age of participants across studies ranged from 46.2 to 54.48 years. Most studies assessed breast cancer patients undergoing or following treatment using various HRQoL instruments, including EORTC QLQ-C30 and QLQ-BR-23 FACIT-Sp1217, and mMOS-SS20. The extracted data and characteristics of the included studies can be found in Table 2.

Risk of Bias in Included Studies

The summary from bias assessment were shown in Table 3 for all studies. In summary, we found that all studies included in this review resulted in a score of ≥7 which translated to good and very good quality in terms of AHRQ standards (Adam et al., 2019). Therefore, we conclude that all studies included in this review were of low risk of bias.

Reliability of HRQoL Instruments

The pooled Cronbach’s alpha values of 0.871 (95% CI: [0.812 – 0.914]) demonstrated strong internal consistency for the instruments assessed (Figure 2). The EORTC QLQ-C30 showed a pooled Cronbach’s alpha of 0.881 (95% CI: [0.773 – 0.942]), indicating excellent reliability. The QLQ-BR-23 also exhibited robust reliability, with a pooled Cronbach’s alpha of 0.860 (95% CI: [0.770 – 0.919]). Similarly, the FACIT-Sp12 demonstrated robust reliability, with a pooled Cronbach’s alpha of 0.87 (95% CI: [0.767 – 0.931]).  The test for subgroup differences resulted in a p-value of 0.94, suggesting no significant differences in reliability across the subgroups analyzed. Heterogeneity across the studies for the EORTC QLQ-C30 and QLQ-BR-23 was deemed substantial, with an I² value of 93% and 90%, respectively.

Validity of HRQoL Instruments

Validity findings were inconsistently reported across the studies, limiting the ability to conduct a pooled analysis. Alawadi et al. (2019) noted that the QLQ-BR23 had superior item discriminant validity compared to the QLQ-C30, distinguishing effectively between patients with different disease stages and health statuses. Huang et al. (2025) provided strong evidence of construct validity for the EORTC QLQ-C30, reporting a content validity index (CVI) of 0.98, which supports the adequacy of the instrument in capturing HRQoL domains relevant to breast cancer patients. Despite these findings, three studies failed to report any validity metrics, posing challenges to synthesizing comprehensive conclusions on validity.

While the reported results affirm the validity of these instruments for assessing HRQoL in breast cancer populations, the substantial heterogeneity in research designs and reporting emphasizes the need for more standardized validation protocols. Subgroup differences in validity outcomes could not be assessed due to inconsistent reporting, underscoring the importance of future studies adopting uniform methods to evaluate and report psychometric properties (Oszlánszky et al., 2024).

In our meta-analysis, the pooled Cronbach’s alpha values revealed high internal consistency across the evaluated instruments. These values exceed the commonly accepted threshold of 0.7, indicating robust reliability for clinical and research applications. The highest Cronbach alpha achieved by EORTC QLQ-C30, in which has previously demonstrated high reliability in non-Asian populations, confirming its consistency across diverse settings. However, the heterogeneity in reliability estimates was substantial. Factors contributing to this heterogeneity likely include differences in cultural contexts, patient demographics, and the clinical settings in which the instruments were deployed. These findings align with earlier literature that highlighted variability in subscale performance, such as lower cognitive function reliability (Howlett et al., 2021).

Validity metrics were less consistently reported, but available data demonstrated the robustness of these instruments in specific domains. QLQ-BR23 exhibited superior item discriminant validity compared to QLQ-C30 in one research, reflecting its strength in breast cancer-specific assessments. Another research reported a content validity index of 0.98 for QLQ-C30, supporting its construct validity. These results align with global evidence showing significant correlations among subscales, reinforcing the tool's applicability across different cultural and clinical setting (Roberts et al., 2021). The variability in validity outcomes across studies limited the ability to conduct pooled analysis. This inconsistency underscores a broader challenge in HRQoL research—methodological differences in evaluating validity and the lack of standard reporting protocols. Future studies should incorporate standardized frameworks, such as the COSMIN guidelines, to ensure comprehensive validity assessments.

The comparison of reliability across the three instruments revealed no significant differences, with a subgroup analysis p-value of 0.94. This suggests comparable performance, supporting the interchangeable use of these instruments in assessing HRQoL in breast cancer patients. However, the high heterogeneity within individual instrument analyses warrants further investigation into context-specific factors influencing reliability and validity (Hebda-Boon et al., 2023).

Our review faced several limitations. The small number of included studies for certain instruments, such as FACIT-Sp12, precluded the assessment of heterogeneity and publication bias. The inconsistent reporting of validity metrics further restricted comprehensive meta-analyses. Additionally, the cultural diversity within Asia may contribute to variability, highlighting the importance of regional validation studies (Bergström et al., 2020).

Future studies should prioritize the use of standardized frameworks like COSMIN for reporting psychometric properties. Context-specific validation is crucial to address cultural and linguistic diversity in Asia. Longitudinal research is also needed to assess test-retest reliability and responsiveness over time. Collaborative efforts across institutions can enhance methodological consistency and generalizability, while exploring digital adaptations of HRQoL instruments may improve accessibility and data collection efficiency in resource-limited settings (Carter et al., 2021). By addressing these recommendations, future studies can refine HRQoL instruments and ensure their effective application in clinical and research settings across Asia, ultimately enhancing the assessment of breast cancer patients' well-being.

 

CONCLUSION

The results affirm the strong reliability of EORTC QLQ-C30, QLQ-BR23, and FACIT-Sp12 for HRQoL assessment in breast cancer patients in Asia, with validity outcomes providing additional support for their use. While subgroup differences were non-significant, the high heterogeneity underscores the need for standardized methodologies and reporting in future research. To strengthen the evidence base, further studies should consider longitudinal validation and the digitization of these instruments. Additionally, specific recommendations for their use should be developed to address diverse clinical and research needs, ensuring their effective application in oncology across various settings.

 


 

REFERENCES

Adam, G. P., Balk, E. M., Jap, J., Senturk, B., Sanders-Schmidler, G., Lallinger, K., Butler, M., Brasure, M., & Trikalinos, T. A. (2019). AHRQ EPC Series on Improving Translation of Evidence: Web-Based Interactive Presentation of Systematic Review Reports. The Joint Commission Journal on Quality and Patient Safety, 45(9), 629–638. https://doi.org/10.1016/j.jcjq.2019.05.001

Afonso, J., Ramirez-Campillo, R., Clemente, F. M., Büttner, F. C., & Andrade, R. (2024). The perils of misinterpreting and misusing “publication Bias” in meta-analyses: an education review on funnel plot-based methods. Sports Medicine, 54(2), 257–269.

Bergström, A., McCarthy, S. A., Hui, R., Almarri, M. A., Ayub, Q., Danecek, P., Chen, Y., Felkel, S., Hallast, P., & Kamm, J. (2020). Insights into human genetic variation and population history from 929 diverse genomes. Science, 367(6484), eaay5012.

Cardoso, F., Spence, D., Mertz, S., Corneliussen-James, D., Sabelko, K., Gralow, J., Cardoso, M.-J., Peccatori, F., Paonessa, D., Benares, A., Sakurai, N., Beishon, M., Barker, S.-J., & Mayer, M. (2018). Global analysis of advanced/metastatic breast cancer: Decade report (2005–2015). The Breast, 39, 131–138. https://doi.org/10.1016/j.breast.2018.03.002

Carter, H., Araya, R., Anjur, K., Deng, D., & Naslund, J. A. (2021). The emergence of digital mental health in low-income and middle-income countries: A review of recent advances and implications for the treatment and prevention of mental disorders. Journal of Psychiatric Research, 133, 223–246. https://doi.org/10.1016/j.jpsychires.2020.12.016

Hebda-Boon, A., Tan, X.-L., Tillmann, R., Shortland, A. P., Firth, G. B., & Morrissey, D. (2023). The impact of instrumented gait analysis on decision-making in the interprofessional management of cerebral palsy: A scoping review. European Journal of Paediatric Neurology, 42, 60–70. https://doi.org/10.1016/j.ejpn.2022.11.007

Howlett, C. A., Wewege, M. A., Berryman, C., Oldach, A., Jennings, E., Moore, E., Karran, E. L., Szeto, K., Pronk, L., Miles, S., & Moseley, G. L. (2021). Same room - different windows? A systematic review and meta-analysis of the relationship between self-report and neuropsychological tests of cognitive flexibility in healthy adults. Clinical Psychology Review, 88, 102061. https://doi.org/10.1016/j.cpr.2021.102061

Jerbi, A. (2025). Using discrete-event simulation for planning and managing mass vaccination centers: a comprehensive examination. SIMULATION, 00375497241308563.

Lee, H., Park, E. Y., & Park, K.-H. (2025). Assessing Cancer-Related Fatigue: Validation of the Korean version of the Cancer Fatigue Scale Among Cancer Survivors. Asia-Pacific Journal of Oncology Nursing, 100657. https://doi.org/10.1016/j.apjon.2025.100657

Maghfour, J., Liu, V., Parks-Miller, A., & Hamzavi, I. H. (2023). Evaluating the Impact of Exclusion Criteria on the Generalizability of Hidradenitis Suppurativa Treatment Research. JID Innovations, 3(3), 100192. https://doi.org/10.1016/j.xjidi.2023.100192

Naung, M. T. (2019). Effect of peer support intervention on anxiety, depression and quality of life among female breast cancer patients on chemotherapy in Yangon, Myanmar: randomized controlled trial.

Oszlánszky, J., Gulácsi, L., Péntek, M., Hermann, P., & Zrubka, Z. (2024). Psychometric Properties of General Oral Health Assessment Index Across Ages: COSMIN Systematic Review. Value in Health. https://doi.org/10.1016/j.jval.2024.02.022

Roberts, A. E., Davenport, T. A., Wong, T., Moon, H.-W., Hickie, I. B., & LaMonica, H. M. (2021). Evaluating the quality and safety of health-related apps and e-tools: Adapting the Mobile App Rating Scale and developing a quality assurance protocol. Internet Interventions, 24, 100379. https://doi.org/10.1016/j.invent.2021.100379

Salas, M., Mordin, M., Castro, C., Islam, Z., Tu, N., & Hackshaw, M. D. (2022). Health-related quality of life in women with breast cancer: a review of measures. BMC Cancer, 22(1), 66.

Sun, M., Liu, C., Lu, Y., Zhu, F., Li, H., & Lu, Q. (2023). Effects of Physical Activity on Quality of Life, Anxiety and Depression in Breast Cancer Survivors: A Systematic Review and Meta-analysis. Asian Nursing Research, 17(5), 276–285. https://doi.org/10.1016/j.anr.2023.11.001

Yap, Y.-S., Lu, Y.-S., Tamura, K., Lee, J. E., Ko, E. Y., Park, Y. H., Cao, A.-Y., Lin, C.-H., Toi, M., & Wu, J. (2019). Insights into breast cancer in the east vs the west: a review. JAMA Oncology, 5(10), 1489–1496.

Zaki, S., Alam, M. F., & Sharma, S. (2025). Evaluating the internal reliability and convergent validity of the 19-item Audit of Diabetes-Dependent Quality of Life (ADDQoL-19) questionnaire in Indian patients with type 2 diabetes. International Journal of Diabetes in Developing Countries, 1–9.

 

 

https://jurnal.syntax-idea.co.id/public/site/images/idea/88x31.png© 2025 by the authors. It was submitted for possible open-access publication under the terms and conditions of the Creative Commons Attribution (CC BY SA) license (https://creativecommons.org/licenses/by-sa/4.0/).