Sharing Experiences in Selecting Clinical Outcome and Approving Validated Questionnaires : Insights from an Elderly Registry Study

Nahyun Cho; Hyungsun Jun; Won-Bae Ha; Junghan Lee; Mi Mi Ko; Young-Eun Kim; Jeeyoun Jung; Jungtae Leem; Cho, Nahyun; Jun, Hyungsun; Ha, Won-Bae; Lee, Junghan; Ko, Mi Mi; Kim, Young-Eun; Jung, Jeeyoun; Leem, Jungtae

doi:10.13048/jkm.24002

JKM > Volume 45(1); 2024 > Article

Cho, Jun, Ha, Lee, Ko, Kim, Jung, and Leem: Sharing Experiences in Selecting Clinical Outcome and Approving Validated Questionnaires : Insights from an Elderly Registry Study

Original Article

The Journal of Korean Medicine 2024; 45(1): 17-43.

Published online: March 1, 2024

DOI: https://doi.org/10.13048/jkm.24002

Sharing Experiences in Selecting Clinical Outcome and Approving Validated Questionnaires : Insights from an Elderly Registry Study

Nahyun Cho¹

, Hyungsun Jun¹

, Won-Bae Ha²

, Junghan Lee²

, Mi Mi Ko³

, Young-Eun Kim⁴

, Jeeyoun Jung³^{, *}

, Jungtae Leem¹^{, 5}^{, *}

¹Department of Diagnostics, College of Korean Medicine, Wonkwang University

²Department of Korean Medicine Rehabilitation, College of Korean Medicine, Won-Kwang University

³Korea Medicine Science Research Division, Korea Institute of Oriental Medicine

⁴Korea Medicine Data Research Division, Korea Institute of Oriental Medicine

⁵Research Center of Traditional Korean Medicine, College of Korean Medicine, Wonkwang University

Correspondence to: Jungtae Leem, College of Korean Medicine, Wonkwang University, 460 Iksandae-ro, Iksan, 54538, Republic of Korea, Tel: +82-63-850-6914, Fax: +82-63-850-7324, E-mail: julcho@naver.com

Correspondence to: Jeeyoun Jung, Korea Medicine Science Research Division, Korea Institute of Oriental Medicine,, 1672 Yuseong-daero, Yuseong-gu, Daejeon, 34054, Republic of Korea, Tel: +82-42-868-9272, Fax: +82-42-868-9299, E-mail: jjy0918@kiom.re.kr

Received September 27, 2023 Revised October 26, 2023 Accepted February 16, 2024

Abstract

Objectives

Underpinned by the context of a Korean traditional medicine cohort study on healthy aging, this research primarily aims to guide the selection of Clinical Outcome Assessments (COAs) for elderly healthy aging patient registry research, offering insights into the selection process; and secondly, to streamline the resource-intensive process of obtaining permissions for validated COAs, benefiting future traditional Korean medicine clinical researchers.

Methods

In this study, we identified outcomes through a review of previous studies, followed by a process involving expert consultations to select the final outcomes. Subsequently, for the selected outcomes that were Clinical Outcome Assessments (COAs) developed tools, we searched in commercial databases to confirm the availability of Korean versions and the necessity of obtaining permissions. Finally, we obtained permissions for their utilization and, when needed, acquired the original instrument questionnaire through payment.

Results

Through a literature review of existing observational studies, a total of 57 outcomes were selected, with 19 of them identified as COA instruments. Upon verifying usage permissions for these 19 instruments, it was found that 17 required author-specific permissions, and among these, 2 needed a purchase as they were commercially available.

Conclusion

This study provides a detailed overview of outcome selection and permission acquisition for elderly patient registry research. It underscores the importance of Clinical Outcome Assessment (COA) tools and the rigorous approval process, aiming to enhance research reliability. Continuous verification of COA information is essential, and future research should explore Core Outcome Set (COS) development through consensus-building approaches like Delphi studies.

Keywords: Outcome Assessment, Health Care, Healthy Aging, Data Collection/methods*, Medicine, Korean Traditional, Copyright, Surveys and Questionnaires*

Supplementary Information

jkm-45-1-17-Supplementary-table-1.pdf

jkm-45-1-17-Supplementary-table-2.pdf

Fig. 1

Flow diagram of the process of Selecting Clinical Outcome and Approving Validated Questionnaires

Table 1

Overview of Prior Research

Author, Year	Country	Starting Year	Study Period (year)	Plans for Follow-up Period (month)	Study Name	Study Population	No. of Subjects	Study Design
Baek Y, 2020	Korea, Daejeon-si	2017	9	2 year	KDCC(Korean Medicine Daejeon Citizen Cohort Study)	men and women aged 30–55 years ; residents of Daejeon ; individuals who provided informed consent	2000	prospective cohort study, multi-center, protocol
Won CW, 2020	Korea	2016	10	2 year	KFACS (Korean Frailty and Aging Cohort Study)	men and women aged 70–84 years ; currently living in the community ; having no plans to move out in the next 2 years ; having no problems with communication and no prior dementia diagnosis.	3014	multicenter longitudinal cohort study
Ding D,2014	China, Shanghai	2010	ongoing	baseline and 4 year	Shanghai Aging Study	(1) registered residents in Jingansi community; (2) ≥ 60 years; (3) without schizophrenia or mental retardation based on their medical records; or (4) able to communicate and accept physical and cognitive examinations	3141	a prospective cohort, protocol
Hong N,2019	Korea	2012	10	2 year†	The Korean Urban Rural Elderly (KURE) Cohort	age ≥65 years; residence in the study area; ability to communicate with the research team; and provision of written informed consent	3517	prospective cohort study, multi-center
Jeffery A D,2022	US (14 member sites)	2013	10	baseline, 2, 4, 6, 12, 18 and 24months*	Patients Receiving Integrative MedicineEffectiveness Registry (PRIMIER)	outpatient aged 18 or over who was seen by an IM provider at any of the clinical sites in the 8weeks preceding their enrollment ; must be willing and able to provide informed consent, to participate, and to be contacted in the future by study personnel.	2374	A prospective, longitudinal,observational evaluation

* Tobacco and alcohol use are asked at baseline, 12, and 24 months, and medical record data are pulled at baseline and every 6 months

† the first and second follow-up performed every 4 years

Table 2

Process of Outcome Revision

Domain	Classification	Reasons for Exclusions and Changes	Excluded Instruments
Health Status	Pregnancy	1st : Excluded from selection because age range on inclusion criteria
Health Status	Breast-feeding	1st : Excluded from selection because age range on inclusion criteria
Health Assessment / Vital Signs	Body Mass Index; Body temperature	1st : Additional selections
Health Status	Family history	1st : Exclude because it’s in the medical history 2nd : Reselected to evaluate family history separately.
	Health Related Quality of Life (HRQOL)	1st : Selected (1) SF-12v2, but changed to (2) SF-36v2 with more detailed questions 2nd : Re-selected (1) SF-12v2 as the shortened version to save patient interview time.	(2) SF-36v2 Korean
	Comorbidity	1st : Select three objective comorbidity measures (1) CCI, (2) ECM, (3) SCQ 2nd : Selected CCI as the most commonly used of the three metrics, and excluded SCQ because it was not possible to calculate a final score.	(3) SCQ (2) ECM
	Polypharmacy	1st : Selection of two “inappropriate medication prescribing criteria” to assess polypharmacy ((1)AGS Beers criteria, (2) STOPP Citeria) 2nd : Decided not to use criteria, but to collect through history taking of medication history. Excluded from selection	(1) AGS Beers criteria (2) STOPP criteria
	Dietary supplement	1st : Further refine dietary supplement categorization by nutrient and function
	Constipation	1st : Select 3 most commonly used constipation endpoints in Korea (1) CAS, (2) PAC-SYM, (3) PAC-QOL 2nd : (1) CAS was selected as the most commonly used of the three metrics, (2) PAC-SYM, and (3) PAC-QOL were excluded because they require a paid purchase or have a complicated registration process.	(2) PAC-SYM (3) PAC-QOL
	Geriatric depression	1st : (1) GDS (2) GDS-SF 2nd : Decide to utilize the shortened form (2) GDS-SF, to save time on patient interviews	(1) GDS
	Instrumental activities of daily living	1st : Select two Korean adaptations of instrumental activities of daily living (IADLs). (1) Jang Won Won Development - 10 questions (2) Kang Soo Jin Development - 11 questions 2nd : Decided to use (1) Jang Won Won Development - 10 questions, because it’s easier to get the author’s contact information for the translation	(2) Korean IADL (Kang Soo Jin Development - 11 questions)
	Activities of daily living	1st : (1) Excluded K-ADLs due to lack of sensitivity when surveying the elderly.	(1) ADL
	Physical resilience	1st : Additional selections
	Fall scale	1st : Four assessment tools were selected for fall risk prediction (1)MFS (2)Huhn’s Fall Risk Assessment Tool (3)JHFRAT (4)FAS-K 2nd : Decided to assess fractures and falls comprehensively through (1) MFS. 3rd : Korean translations were selected to the extent possible. As kFES-I is more researched among fall-related assessment scales in Korean subjects, we decided to evaluate kFES-I except for (1) MFS.	(1) MFS (2) Huhn’s Fall Risk Assessment Tool (3) JHFRAT (4) FAS-k
	Recent injury	1st : Select questions using the Fracture Assessment Questions as a guide 2nd : Decided to assess fractures and falls comprehensively through (1) MFS.
	Fear of falling	1st : Select 2 fear of falling scales (1)kFES-I (Korean Version of Falls Efficacy Scale-International ) (2)ABC-scale 2nd : Decided to assess fractures and falls comprehensively through (1) MFS. 3rd : Korean translations were selected to the extent possible. As kFES-I is more researched among fall-related assessment scales in Korean subjects, we decided to evaluate kFES-I except for (1) MFS.	(2) ABC-scale
	Oral health	1st : Five oral health assessment items were selected: (1) whether to brush daily yesterday; (2) when to brush yesterday; (3) whether to have an oral examination in the past year; (4) mastication discomfort; and (5) pronunciation discomfort.
	Urine-hCG	1st : Add blood test items for pregnancy and lactation. 2nd : Decide not to collect because patients screened for cohort are not likely to be of childbearing potential. Delete this entry
Health Behavior	Eating behavior	1st : Select 3 assessment tools for dietary habits (1) National Health and Nutrition Examination Survey_Dietary Habits Survey (2) DEBQ, (3) TFEQ 2nd : (2) DEBQ and (3) TFEQ were not selected because they do not have Korean translations and the license purchase process is complicated.	(2) DEBQ, (3) TFEQ
	Food security	1st : Selection of two assessment tools for food safety items (1) National Health and Nutrition Examination Survey_Food Security Survey (2) U.S. Household food security survey module 2nd : Eliminated all due to lack of clinical significance of food security when evaluating geriatric populations	(1) National Health and Nutrition Examination Survey_Food Security Survey (2) U.S. Household food security survey module
	Paving Wheel Questionnaire	2nd : No validation studies have been done on the translations, so we requested and obtained appropriate translations from the journal.
	Social network	1st : Select 2 additional social network questionnaire assessment tools (1) MOS-SSS (2) Lubben-6 2nd : (2) Lubben-18 tool was not selected because no information could be found about purchasing licenses and permissions.	(2) Lubben-18
Healthcare	Unmet needs	1st : Use survey items provided by the Korean Medical Panel
Healthcare	Long-term care services	2nd : The service is offered to people 65 and older, so it does not meet the cohort selection criteria and was not selected.
Cognitive-Psychiatric Function	Cognitive function - MMSE2, MMSE	1st : Select 2 tools (1) MMSE, (2) MMSE-2 3rd : Excluded (1) MMSE and (2) MMSE-2 due to the high number of overlapping questions with the MoCA instrument and the difficulty of purchasing a research license for both.	(1) MMSE (2) MMSE-2
Cognitive-Psychiatric Function	Cognitive function - CDT scoring	1st : For the Clock Drawing item of MoCA-K, we decided to use a separately developed scoring system, (1) the CDT Scoring Table. 3rd : Decided to utilize only MoCA-k, and excluded (1) the CDT Scoring Table..	(1) the CDT Scoring Table.
Physical Function	TUG test, FRT	1st : Select (1) TUG and (2) FRT, which are common physical performance tests with SPPB. 2nd : Eliminated (1) TUG and (2) FRT because we believe SPPB is sufficient to assess physical performance.	(1) TUG (2) FRT
	Knee MMT	2nd : Knee MMT excluded from selection, as it is replaced by knee ROM test
	Knee, lumbar spine X ray	2nd : Decide not to order knee and hip X-rays and replace them with a bone density test to save time with the patient.
	Core muscle assessment	1st : Decided to use ultrasound to assess abdominal, rectus femoris, and core muscle thickness. 2nd : Decided to eliminate it due to inefficiency of patient interview time and instead use McGil’s core endurance test to assess abdominal core muscle function.
	Availability of squat tests	2nd : Decide to run a simple squat test to assess physical function and strength 3rd : Decided to use McGil’s endurance test to comprehensively assess strength measures. The squat test was excluded
	Hearing, vision test	1st : Hearing loss and vision loss are common symptoms of the elderly, so select vision loss as an additional category.
	EEG; HRV test; Biological age measurement; PFT	3rd : Access to equipment at healthcare organizations conducting clinical research. Added to leverage rich evaluation metrics
Body Composition	Inbody - assessment of Sarcopenia	3rd : Decided to evaluate muscle mass through inbody testing. We decide to further evaluate for sarcopenia.
Korean Medicine Questionnaire	BSQ-MS	3rd : The existing questionnaire is full of Korean medicine terminology, which makes it difficult to conduct interviews in the field, so we changed it to a simplified questionnaire that is easy, clear, and shortened.	(1) BSQ-MS

Sf-12v2; 12-item Short Form Survey, Sf-36v2; 36-item Short Form Survey, CCI; Charlson comorbidity index, ECM; Elixhauser et al. comorbidity measure, SCQ; Self-Administered Comorbidity Questionnaire, AGS; American Geriatrics Society, STOPP; Screening Tool of Older Persons’ Prescriptions, CAS; Constipation Assessment Scale, PAC-SYM; Psychometric validation of a constipation symptom assessment questionnaire, PAC-QOL; Patient Assessment of Constipation Quality of Life questionnaire, GDS; Geriatric Depression Scale, GDS-SF: Geriatric Depression Scale-Short Form, IADL; Instrumental Activities of Daily Living, ADL; Activities of Daily Living, MFS; Morse Fall Scale, JHFRAT; The Johns Hopkins Fall Risk Assessment Tool, FAS-K; Adult Fall Assessment Scale Korean version, kFES-I; Korean Version of Falls Efficacy Scale-International, ABC-scale; Activities-specific Balance Confidence scale, DEBQ; Dutch Behavior Questionnaire, TFEQ; Three-Factor Eating Questionnaire, MOS-SSS; Medical Outcomes Study Social Support Survey, MMSE; Mini-mental State Examination, MMSE-2; Mini-mental State Examination 2^nd edition, CDT; Clock Drawing Test, TUG; Timed Up and Go, FRT; Functional Reach Test, MMT; Manual Muscle Test, ROM; Range of Motion, EEG; electroencephalography, HRV; heart rate variability, PFT; Pulmonary function test, BSQ-MS; Blood Stasis Questionnaires on metabolic

Table 3

Final Outcomes and Classification According to FDA⁸⁾

Outcome Domain	Individual Clinical Outcome Variable	Clinical Outcome Assessments/Biomarkers/Other Outcomes (Classification According to FDA)
Demographics	Sex	Other outcomes
	Date of birth; age	Other outcomes
	Education attainment	Other outcomes
	Family relationship	Other outcomes

Anthropometry	Body weight; Height; Body Mass Index	Biomarker

Health Assessment Vital Signs	Blood Pressure : Systolic blood pressure; Diastolic blood pressure	Biomarker
	Pulse rate	Biomarker
	Body temperature	Biomarker

Health Status	Medical history; Surgical history; Drug history(polypharmacy); Family history	PRO

Health Behavior	Korean 12-item Short Form Survey	PROs instrument
	Comorbidity as Charlson comorbidity index	PRO
	Dietary supplement	PRO
	Constipation - Constipation Assessment Scale	PROs instrument
	Quality of life - EQ-5D-5L, EQ-5D-5L visual Analogue	PROs instrument
	Geriatric Depression Scale Short Form Korea Version	PROs instrument
	Korean instrumental activities of daily living scale.	PROs instrument
	Physical resilience scale	PROs instrument
	Fear of falling - Korean Version of Falls Efficacy Scale-International	PROs instrument
	Oral health	PRO
	Women’s health	PRO
	Smoking; drinking	PRO
	Sleep - Korean version of the Pittsburgh Sleep Quality Index	PROs instrument
	Physical activity - Korean Version of International Physical Activity Questionnaire Short Form	PROs instrument
	Nutritional risk - short form	PROs instrument
	Eating behavior	PRO
	Korean Version of Simplified Nutritional Appetite Questionnaire	PROs instrument
	Paving Wheel Questionnaire	PROs instrument
	Social network - Korean translation of the Medical Outcomes Study Social Support Survey scale	PROs instrument

Healthcare	Unmet needs	Other outcomes
Healthcare	Healthcare costs	Other outcomes

Cognitive Function	Korean Version of the Montreal Cognitive Assessment	PerfO instrument

Physical Function	Hand-grip	PerfO
	SPPB score	PerfO
	Range Of Motion (knee; lumbar)	ClinRO
	Hearing, vision test	ClinRO
	Electroencephalography(EEG)	ClinRO
	Heart Rate Variability test (pulse wave test)	ClinRO
	McGil’s core endurance test	PerfO
	Biological age measurement	ClinRO
	Pulmonary function test	PerfO

Body Composition	DEXA	ClinRO
Body Composition	Inbody ; assessment of Sarcopenia	ClinRO

Korean Medicine Questionnaire	Instrument of Korean Medical Pattern Identification and Functional Evaluation for Five Organ	PROs instrument
	Blood Stasis Questionnaires on metabolic syndrome	PROs instrument
	Kidney deficiency pattern screening assessment questionnaire	PROs instrument
	Core Seven-Emotions Inventory - short form	PROs instrument

Clinical Laboratory Tests		Biomarker

Biochemistry	Albumin, aspartate aminotransferase, Total Protein, Total bilirubin, Calcium, Chlorine, Phosphorus, Sodium, Alkaline phosphatase isoenzymes, Amylase, creatine kinase, Aspartate Aminotransferase, Lactate dehydrogenase, γ-Gamma-glutamyl transpeptidase, Blood Urea Nitrogen, Creatinine, Uric Acid, Total cholesterol, High-density lipoprotein cholesterol, Triglyceride, Ferritin, total iron binding capacity, C-Reactive Protein, Low-density lipoprotein cholesterol

Immunology	25-OH Vitamin D-Osteocalcin, Cortisol, Free Thyroxine 4, Thyroid Stimulating Hormone, Dehydroepiandrosterone-sulfate - Vitamin B12, Insulin

Male Hormone	Testosterone, prostate-specific antigen

Female Hormone	Follicle stimulating hormone, Luteinizing Hormone, Estradiol

Hematology, HbA1c	White Blood Cell, Red Blood Cell, Hemoglobin, hematocrit, Platelet, Mean corpuscular volume, Mean Corpuscular Hemoglobin, Mean Corpuscular Hemoglobin Concentration, White Blood Cell differential (Neutrophil, Lymphocyte, Monocyte, Eosinophil, Basophil), Hemoglobin A1c

Glucose	Glucose

Urinalysis	Urine White Blood Cell, Specific gravity, pH, Protein, Glucose, Occult blood, Ketones, Urobilinogen, Bilirubin, Nitrite, Urine Sediment (White Blood Cell, Red Blood Cell, Epithelial cell, Bacteria, Casts, Crystal, Others)

Omics analysis	Metabolomic metrics, Plasma proteomics

EQ-5D-5L; EuroQOL 5-Dimension 5-level, PRO; Patient-reported outcomes, PerfO; performance outcome, SPPB; Short Physical Performance Battery, ClinRO; clinician-reported outcome, DEXA; Dual-energy X-ray absorptiometry

Table 4

Permission to Use of Clinical Outcome Assessment Instruments

	Clinical Outcome Assessment Instruments	Concept of Interest	Population Intended to Use	Response Option	Number of Items	Range of Score	PROQOLID Database Availability	Authorization Required for Use of Original Work	Requires Purchase of Original Work	Questionnaire Acquisition Methods: Availability of Original Author Contacts/Platform Link	[Korean] PROQOLID Database Korean Version Availability	[Korean] Authorization Required for Use of Translation Author	[Korean] Questionnaire Acquisition Methods: Availability of Translation Author Contacts/Platform Link
Health Status	Korean version of 12-item Short Form Survey 20,29)	Health-Related Quality of Life - HRQL (incl. health status)	Adult	Yes/No 5 to 6-point Likert Scale	12	0–100	O	O	O	https://www.qualitymetric.com/contact-info/?	O	O	O https://www.qualitymetric.com/contact-info/?
Health Status	Constipation Assessment Scale30,31)	Signs and symptoms	Adult	3-point Likert scale	8	0–16	O	X	X	NA	O	O	X
Health Status	EuroQOL 5-Dimension 5-level21)	Utility, Health-Related Quality of Life - HRQL (incl. health status)	Adolescent Adult Pediatrics	5-point Likert/Likert-type Scale	5	−0.59 ~ 1.00	O	O	X	https://customer.euroqol.org/users/sign_in	O	X	https://customer.euroqol.org/users/sign_in
Health Status	EuroQOL 5-Dimension 5-level Visual Analogue21)	Utility, Health-Related Quality of Life - HRQL (incl. health status)	Adolescent Adult Pediatrics	Visual Analog Scale(VAS)	1 VAS (20 cm)	0~100	O	O	X	https://customer.euroqol.org/users/sign_in	O	X	https://customer.euroqol.org/users/sign_in
Health Status	Geriatric Depression Scale Short Form Korea Version32,33)	NA	NA	Yes/no	15	N/A	O	X	X	NA	X	O	X
Health Status	Korean instrumental activities of daily living scale34,35)	Physical functioning	Geriatrics	3-, 4-point Likert scale	10	10–37	O	O	O	O	O	O	O
Health Status	Physical resilience scale 36)	Psychological functioning (incl. coping)	NA	2-point Likert scale	17 + 1 subjective question	0–17	X	O	X	O	X	X	X
Health Status	Korean Version of Falls Efficacy Scale-Internation al37,38)	Physical functioning	NA	4-point Likert Scale	16	16–64	O	O	X	O	O	O	O
Health Behavior	Paving Wheel Questionnaire46)	Psychological functioning (incl. coping), Social functioning (incl. work)	NA	5-point Likert scale	60	60–300	X	O	O	O	X	O	X
Health Behavior	Korean version of the Pittsburgh Sleep Quality Index42,43)	Signs and symptoms	Adult Caregivers	4-point Likert Scale	19 (+ 5 items rated by the bedpartner or roommate for clinical information only/not scored)	0–21	O	X	X	NA	O	O	O
Health Behavior	Korean Version of International Physical Activity Questionnaire Short Form41,42)	Physical functioning	Youth 15 years of age and older	Other: Number of minutes per week within each activity category Open-ended questions surrounding individuals’ last 7-day recall of physical activity	7	N/A	O	X	X	NA https://sites.google.com/view/ipaq	O	O	X
Health Behavior	Nutritional risk - short form43)	Other_ Nutritional status	Geriatrics	2-,3-,4-point Likert-type Scale	6+1	0–14	O	X	X	https://www.mna-elderly.com/	O	X	https://www.mna-elderly.com/sites/default/files/2021-10/mna-mini-korean.pdf
Health Behavior	Simplified nutritional appetite questionnaire 44,45)	Signs and symptoms	Adult Geriatrics	5-point Likert/Likert-type Scale	4	4–20	O	X	X	NA https://www.medlineuniversity.com/viewdocument/skintegrity-snaq-simplified-nutrit?CommunityKey=d15198e2-e041-4be7-be2b-1cc2c8291f86&tab=librarydocuments	O	O	O
Health Behavior	Medical outcomes study-social support survey 47,48)	Psychological functioning (incl. coping), Social functioning (incl. work)	Adult	5-point Likert scale	19	19–95	O	X	X	NA https://www.rand.org/health-care/surveys_tools/mos/social-support.html	O	O	X
Cognitive Function	Korean Version of the Montreal Cognitive Assessment22,52)	Psychological functioning (incl. coping)	Validated for 55 to 85 years	Other: drawing, multiple choices, pictorial, analogy, open-ended question, counting	28	0–30	O	X	X	NA https://mocacognition.com/paper/	O	X	https://mocacognition.com/paper/
Korean Medicine Questionnaire	Instrument of Korean Medical Pattern Identification and Functional Evaluation for Five Organ49)	Signs and symptoms	NA	5-point Likert scale	48	48–240	X	O	X	O		.	.
Korean Medicine Questionnaire	Blood Stasis Questionnaires on metabolic syndrome50)	Signs and symptoms	NA	5-point Likert scale Yes/No	15	0–32	X	O	X	O		.	.
Korean Medicine Questionnaire	Core Seven-Emotions Inventory - short form51)	Psychological functioning	NA	5-point Likert scale	28	28–140	X	O	X	O		.	.
Korean Medicine Questionnaire	Kidney deficiency pattern screening assessment questionnaire	Signs and symptoms	Adult Geriatrics	5-point Likert scale	20		X	O	O	O		.	.

참고문헌

1. Briggs, A. M., & de Carvalho, I. A. (2018). Actions required to implement integrated care for older people in the community using the World Health Organization’s ICOPE approach: A global Delphi consensus study. PLOS ONE, 13(10), e0205533. https://doi.org/10.1371/journal.pone.0205533

2. Kessler, R. C., Davis, R. B., Foster, D. F., Van Rompay, M. I., Walters, E. E., Wilkey, S. A., Kaptchuk, T. J., & Eisenberg, D. M. (2001). Long-term trends in the use of complementary and alternative medical therapies in the United States. Annals of Internal Medicine, 135(4), 262-268. https://doi.org/10.7326/0003-4819-135-4-200108210-00011

3. Ayele, A. A., Tegegn, H. G., Haile, K. T., Belachew, S. A., Mersha, A. G., & Erku, D. A. (2017). Complementary and alternative medicine use among elderly patients living with chronic diseases in a teaching hospital in Ethiopia. Complementary Therapies in Medicine, 35, 115-119. https://doi.org/10.1016/j.ctim.2017.10.006

4. Takayama, S., & Iwasaki, K. (2017). Systematic review of traditional Chinese medicine for geriatrics. Geriatrics & Gerontology International, 17(5), 679-688. https://doi.org/10.1111/ggi.12803

5. Kingston, A., & Jagger, C. (2018). Review of methodologies of cohort studies of older people. Age and Ageing, 47(2), 215-219. https://doi.org/10.1093/ageing/afx183

6. Walton, M. K., Powers, J. H., Hobart, J., Patrick, D. L., Marquis, P., Vamvakas, S., Isaac, M., Molsen, E., Cano, S. J., & Burke, L. (2015). Clinical Outcome Assessments: Conceptual Foundation–Report of the ISPOR Clinical Outcomes Assessment – Emerging Good Practices for Outcomes Research Task Force DOES THIS HAVE TO BE LABLED AS PART 1. Value in Health : The Journal of the International Society for Pharmacoeconomics and Outcomes Research, 18(6), 741-752. https://doi.org/10.1016/j.jval.2015.08.006

7. Bang, G., Kang, D., & Cho, J. (2022). Current status of routine use of Patient-Reported Outcome in the tertiary hospital clinical setting in Republic of Korea. Korean Journal of Clinical Pharmacy, 32(2), 74-83. https://doi.org/10.24304/kjcp.2022.32.2.74

8. FDA-NIH Biomarker Working Group. 2016. BEST (Biomarkers, EndpointS, and other Tools) Resource. Food and Drug Administration (US); http://www.ncbi.nlm.nih.gov/books/NBK326791/

9. Eton, D. T., Bauer, B. A., Sood, A., Yost, K. J., & Sloan, J. A. (2011). Patient-Reported Outcomes in Studies of Complementary and Alternative Medicine: Problems, Solutions, and Future Directions. EXPLORE, 7(5), 314-319. https://doi.org/10.1016/j.explore.2011.06.002

10. Barnes, P. M., Bloom, B., & Nahin, R. L. (2008). Complementary and alternative medicine use among adults and children: United States, 2007. National Health Statistics Reports, 12, 1-23.

11. Astin, J. A. (1998). Why Patients Use Alternative MedicineResults of a National Study. JAMA, 279(19), 1548-1553. https://doi.org/10.1001/jama.279.19.1548

12. Paterson, C., Baarts, C., Launsø, L., & Verhoef, M. J. (2009). Evaluating complex health interventions: A critical analysis of the “outcomes” concept. BMC Complementary and Alternative Medicine, 9, 18. https://doi.org/10.1186/1472-6882-9-18

13. Anfray C., Trimoreau M.n.d. Licensing and eCOAs: Lessons learned and pending issues. Mapi Research Trust;Retrieved June 28, 2023, from http://www.mapi-trust.org/news-events/news/licensing-and-ecoas-lesso/

14. Marcus, A. (2017). Pay up or retract? Drug survey spurs conflict. Science (New York, N.Y.), 357(6356), 1085-1086. https://doi.org/10.1126/science.357.6356.1085

15. Hays, R. D., Weech-Maldonado, R., Teresi, J. A., Wallace, S. P., & Stewart, A. L. (2018). Commentary: Copyright Restrictions versus Open Access to Survey Instruments. Medical Care, 56(2), 107-110. https://doi.org/10.1097/MLR.0000000000000857

16. Ongenae, K., Dierckxsens, L., Brochez, L., van Geel, N., & Naeyaert, J. M. (2005). Quality of life and stigmatization profile in a cohort of vitiligo patients and effect of the use of camouflage. Dermatology (Basel, Switzerland), 210(4), 279-285. https://doi.org/10.1159/000084751

17. Moon, S.-W. (2019). Research Ethics and Laws Related to Survey Research in Clinical Psychology. Korean Journal of Clinical Psychology, 38(1), 112-126. https://doi.org/10.15842/kjcp.2019.38.1.009

18. Anfray, C., Arnold, B., Martin, M., Eremenco, S., Patrick, D. L., Conway, K., & Acquadro, C.; ISOQOL Translation and Cultural Special Interest Group (TCA-SIG). (2018). Reflection paper on copyright, patient-reported outcome instruments and their translations. Health and Quality of Life Outcomes, 16(1), 224. https://doi.org/10.1186/s12955-018-1050-4

19. About PROQOLID - ePROVIDE™. n.d. ePROVIDE - Mapi Research Trust. Retrieved June 28, 2023, from https://eprovide.mapi-trust.org/about/about-proqolid

20. Ware, J., Kosinski, M., & Keller, S. D. (1996). A 12-Item Short-Form Health Survey: Construction of scales and preliminary tests of reliability and validity. Medical Care, 34(3), 220-233. https://doi.org/10.1097/00005650-199603000-00003

21. Herdman, M., Gudex, C., Lloyd, A., Janssen, M., Kind, P., Parkin, D., Bonsel, G., & Badia, X. (2011). Development and preliminary testing of the new five-level version of EQ-5D (EQ-5D-5L). Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 20(10), 1727-1736. https://doi.org/10.1007/s11136-011-9903-x

22. Nasreddine, Z. S., Phillips, N. A., Bédirian, V., Charbonneau, S., Whitehead, V., Collin, I., Cummings, J. L., & Chertkow, H. (2005). The Montreal Cognitive Assessment, MoCA: A brief screening tool for mild cognitive impairment. Journal of the American Geriatrics Society, 53(4), 695-699. https://doi.org/10.1111/j.1532-5415.2005.53221.x

23. McKown, S., Acquadro, C., Anfray, C., Arnold, B., Eremenco, S., Giroudet, C., Martin, M., & Weiss, D. (2020). Good practices for the translation, cultural adaptation, and linguistic validation of clinician-reported outcome, observer-reported outcome, and performance outcome measures. Journal of Patient-Reported Outcomes, 4(1), 89. https://doi.org/10.1186/s41687-020-00248-z

24. Won, C. W., Lee, S., Kim, J., Chon, D., Kim, S., Kim, C.-O., Kim, M. K., Cho, B., Choi, K. M., Roh, E., Jang, H. C., Son, S. J., Lee, J.-H., Park, Y. S., Lee, S.-G., Kim, B. J., Kim, H. J., Choi, J., Ga, H., & Kim, M. (2020). Korean frailty and aging cohort study (KFACS): Cohort profile. BMJ Open, 10(4), e035573. https://doi.org/10.1136/bmjopen-2019-035573

25. Ding, D., Zhao, Q., Guo, Q., Meng, H., Wang, B., Yu, P., Luo, J., Zhou, Y., Yu, L., Zheng, L., Chu, S., Mortimer, J. A., Borenstein, A. R., & Hong, Z. (2014). The Shanghai Aging Study: Study design, baseline characteristics, and prevalence of dementia. Neuroepidemiology, 43(2), 114-122. https://doi.org/10.1159/000366163

26. Hong, N., Kim, K.-J., Lee, S. J., Kim, C. O., Kim, H. C., Rhee, Y., Youm, Y., Choi, J.-Y., & Park, H.-Y. (2019). Cohort profile: Korean Urban Rural Elderly (KURE) study, a prospective cohort on ageing and health in Korea. BMJ Open, 9(10), e031018. https://doi.org/10.1136/bmjopen-2019-031018

27. Baek, Y., Seo, B.-N., Jeong, K., Yoo, H., & Lee, S. (2020). Lifestyle, genomic types and non-communicable diseases in Korea: A protocol for the Korean Medicine Daejeon Citizen Cohort study (KDCC). BMJ Open, 10(4), e034499. https://doi.org/10.1136/bmjopen-2019-034499

28. Dusek, J. A., Abrams, D. I., Roberts, R., Griffin, K. H., Trebesch, D., Dolor, R. J., Wolever, R. Q., McKee, M. D., & Kligler, B. (2016). Patients Receiving Integrative Medicine Effectiveness Registry (PRIMIER) of the BraveNet practice-based research network: Study protocol. BMC Complementary and Alternative Medicine, 16, 53. https://doi.org/10.1186/s12906-016-1025-0

29. Kim, S.-H., Jo, M.-W., Ahn, J., Ock, M., Shin, S., & Park, J. (2014). Assessment of psychometric properties of the Korean SF-12 v2 in the general population. BMC Public Health, 14, 1086. https://doi.org/10.1186/1471-2458-14-1086

30. Yang, S. (1992). Effects of Fluid Intake, Dietary Fiber Supplement and Abdominal Muscle Exercises on Antipsychotic Drug-Induced Constipation in Schizophrenics. Journal of Catholic Medical College, 45(4), 1501-1514.

31. McMillan, S. C., & Williams, F. A. (1989). Validity and reliability of the Constipation Assessment Scale. Cancer Nursing, 12(3), 183-188. https://doi.org/10.1097/00002820-198906000-00012

32. KEE, B. S. (1996). A Preliminary Study for the Standardization of Geriatric Depression Scale Short Form-Korea Version. J Korean Neuropsychiatr Assoc, 35(2), 298-306.

33. Yesavage, J. A., & Sheikh, J. I. (1986). 9/Geriatric Depression Scale (GDS). Clinical Gerontologist, 5(1–2), 165-173. https://doi.org/10.1300/J018v05n01_09

34. Won, C. W., Yang, K. Y., Rho, Y. G., Kim, S. Y., Lee, E. J., Yoon, J. L., Cho, K. H., Shin, H. C., Cho, B. R., Oh, J. R., Yoon, D. K., Lee, H. S., & Lee, Y. S. (2002). The Development of Korean Activities of Daily Living(K-ADL) and Korean Instrumental Activities of Daily Living(K-IADL) Scale. Journal of the Korean Geriatrics Society, 6(2), 107-120.

35. Lawton, M. P., & Brody, E. M. (1969). Assessment of older people: Self-maintaining and instrumental activities of daily living. The Gerontologist, 9(3), 179-186.

36. Resnick, B., Galik, E., Dorsey, S., Scheve, A., & Gutkin, S. (2011). Reliability and validity testing of the physical resilience measure. The Gerontologist, 51(5), 643-652. https://doi.org/10.1093/geront/gnr016

37. Park, G., Cho, B., Kwon, I. S., Park, B. J., Kim, T., Cho, K. Y., Park, U. J., & Kim, M. J. (2016). Reliability and Validity of Korean Version of Falls Efficacy Scale-International (KFES-I). Journal of Korean Academy of Rehabilitation Medicine, 34(5), 554-559.

38. Yardley, L., Beyer, N., Hauer, K., Kempen, G., Piot-Ziegler, C., & Todd, C. (2005). Development and initial validation of the Falls Efficacy Scale-International (FES-I). Age and Ageing, 34(6), 614-619. https://doi.org/10.1093/ageing/afi196

39. Sohn, S. I., Kim, D. H., Lee, M. Y., & Cho, Y. W. (2012). The reliability and validity of the Korean version of the Pittsburgh Sleep Quality Index. Sleep & Breathing = Schlaf & Atmung, 16(3), 803-812. https://doi.org/10.1007/s11325-011-0579-9

40. Buysse, D. J., Reynolds, C. F., Monk, T. H., Berman, S. R., & Kupfer, D. J. (1989). The Pittsburgh Sleep Quality Index: A new instrument for psychiatric practice and research. Psychiatry Research, 28(2), 193-213. https://doi.org/10.1016/0165-1781(89)90047-4

41. Craig, C. L., Marshall, A. L., Sjöström, M., Bauman, A. E., Booth, M. L., Ainsworth, B. E., Pratt, M., Ekelund, U., Yngve, A., Sallis, J. F., & Oja, P. (2003). International physical activity questionnaire: 12-country reliability and validity. Medicine and Science in Sports and Exercise, 35(8), 1381-1395. https://doi.org/10.1249/01.MSS.0000078924.61453.FB

42. Oh, J. Y., Yang, Y. J., Kim, B. S., & Kang, J. H. (2007). Validity and Reliability of Korean Version of International Physical Activity Questionnaire (IPAQ) Short Form. Journal of the Korean Academy of Family Medicine, 28(7), 532-541.

43. Rubenstein, L. Z., Harker, J. O., Salvà, A., Guigoz, Y., & Vellas, B. (2001). Screening for undernutrition in geriatric practice: Developing the short-form mini-nutritional assessment (MNA-SF). The Journals of Gerontology. Series A, Biological Sciences and Medical Sciences, 56(6), M366-372. https://doi.org/10.1093/gerona/56.6.m366

44. Wilson, M.-M. G., Thomas, D. R., Rubenstein, L. Z., Chibnall, J. T., Anderson, S., Baxi, A., Diebold, M. R., & Morley, J. E. (2005). Appetite assessment: Simple appetite questionnaire predicts weight loss in community-dwelling adults and nursing home residents. The American Journal of Clinical Nutrition, 82(5), 1074-1081. https://doi.org/10.1093/ajcn/82.5.1074

45. Oh, S. Y., Koh, S.-J., Yeon, B. J., Kwon, K. A., Jeung, H.-C., Lee, K. H., Young-Woong, W., & Lee, H. J. (2019). Validity and Reliability of Korean Version of Simplified Nutritional Appetite Questionnaire in Patients with Advanced Cancer: A Multicenter, Longitudinal Study. Cancer Research and Treatment, 51(4), 1612-1619.

46. Frates B., Tollefson M., Comander A.n.d. PAVING the Path to Wellness Workbook. Healthy Learning. Retrieved August 23, 2023, from https://healthylearning.com/paving-thepath-to-wellness-workbook/

47. Lim, M. K., Kim, M. H., Shin, Y. J., Yoo, W. S., & Yang, B. M. (n.d). Social Support and Self-rated Health Status in a Low Income Neighborhood of Seoul, Korea. Journal of Preventive Medicine and Public Health, 36(1), 54-62.

48. Sherbourne, C. D., & Stewart, A. L. (1991). The MOS social support survey. Social Science & Medicine (1982), 32(6), 705-714. https://doi.org/10.1016/0277-9536(91)90150-b

49. Su, J. E., Yun, Y. G., Ryong, Y. H., Kim, I. C., Park, J.-Y., & Jung, I. (2017). Preliminary Study to Develop the Instrument of Korean Medical Pattern Identification and Functional Evaluation for Five Organ. Journal of Physiology & Pathology in Korean Medicine, 31(2), 126-137. https://doi.org/10.15188/kjopp.2017.04.31.2.126

50. Kang, B.-K., Jang, S., Ko, M. M., & Jung, J. (2019). A Study on the Development of a Korean Metabolic Syndrome Questionnaire Using Blood Stasis Clinical Data. Evidence-Based Complementary and Alternative Medicine: eCAM, (2019). 8761417. https://doi.org/10.1155/2019/8761417

51. Cheong, M. J., Lee, G.-E., Lee, Y., Bae, K.-H., Kang, Y., Kim, J.-H., Lyu, Y.-S., & Kang, H. W. (2019). Validation of the Core Seven-Emotions Inventory—Short form. Integrative Medicine Research, 8(2), 116-119. https://doi.org/10.1016/j.imr.2019.04.003

52. Lee, J.-Y., Dong Woo Lee, null, Cho, S.-J., Na, D. L., Hong Jin Jeon, null, Kim, S.-K., You Ra Lee, null, Youn, J.-H., Kwon, M., Lee, J.-H., & Maeng Je Cho, null (2008). Brief screening for mild cognitive impairment in elderly outpatient clinic: Validation of the Korean version of the Montreal Cognitive Assessment. Journal of Geriatric Psychiatry and Neurology, 21(2), 104-110. https://doi.org/10.1177/0891988708316855

53. Survey contents | KDCA korean National HEalth & Nutrition Examination Survey. n.d. Retrieved August 23, 2023, from https://knhanes.kdca.go.kr/knhanes/sub04/sub04_01_02.do?classType=2

54. Kim C. O.n.d. Geriatric Diseases Prevention and Management Cohort. (2012. December) (1465012630). Retrieved August 23, 2023, from https://scienceon.kisti.re.kr/srch/selectPORSrchReport.do?cn=TRKO201300030794

55. Guralnik, J. M., Simonsick, E. M., Ferrucci, L., Glynn, R. J., Berkman, L. F., Blazer, D. G., Scherr, P. A., & Wallace, R. B. (1994). A short physical performance battery assessing lower extremity function: Association with self-reported disability and prediction of mortality and nursing home admission. Journal of Gerontology, 49(2), M85-94. https://doi.org/10.1093/geronj/49.2.m85

56. McGill, S. M., Childs, A., & Liebenson, C. (1999). Endurance times for low back stabilization exercises: Clinical targets for testing and training from a normal database. Archives of Physical Medicine and Rehabilitation, 80(8), 941-944. https://doi.org/10.1016/s0003-9993(99)90087-4

57. Korea Health Panel Survey. n.d. Retrieved August 23, 2023, from https://www.khp.re.kr:444/web/data/board/view.do?bbsid=54&seq=1731

58. Demers, L., Ska, B., Desrosiers, J., Alix, C., & Wolfson, C. (2004). Development of a conceptual framework for the assessment of geriatric rehabilitation outcomes. Archives of Gerontology and Geriatrics, 38(3), 221-237. https://doi.org/10.1016/j.archger.2003.10.003

59. Prorok, J. C., Williamson, P. R., Shea, B., Rolfson, D., Mañas, L. R., Cesari, M., Kim, P., & Muscedere, J. (2022). An international Delphi consensus process to determine a common data element and core outcome set for frailty: FOCUS (The Frailty Outcomes Consensus Project). BMC Geriatrics, 22(1), 284. https://doi.org/10.1186/s12877-022-02993-w

60. U.S. Department of Health and Human Services FDA Center for Drug Evaluation and Research, U.S. Department of Health and Human Services FDA Center for Biologics Evaluation and Research, & U.S. Department of Health and Human Services FDA Center for Devices and Radiological Health. (2006). Guidance for industry: Patient-reported outcome measures: use in medical product development to support labeling claims: draft guidance. Health and Quality of Life Outcomes, 4(1), 79. https://doi.org/10.1186/1477-7525-4-79

61. Al Sayah, F., Jin, X., & Johnson, J. A. (2021). Selection of patient-reported outcome measures (PROMs) for use in health systems. Journal of Patient-Reported Outcomes, 5(Suppl 2), 99. https://doi.org/10.1186/s41687-021-00374-2

62. Revicki, D. A., & Schwartz, C. E. (2009). Intellectual property rights and good research practice. Quality of Life Research: An International Journal of Quality of Life Aspects of Treatment, Care and Rehabilitation, 18(10), 1279-1280. https://doi.org/10.1007/s11136-009-9551-6

63. center for reserach ethics information. 2021. CRE Research Ethics Questions and Answers. 1: https://www.cre.or.kr/bbs/BoardDetail.do?nttId=568&bbsId=BBSMSTR_000000000041&pageIndex=1

64. Williamson, P. R., Altman, D. G., Blazeby, J. M., Clarke, M., Devane, D., Gargon, E., & Tugwell, P. (2012). Developing core outcome sets for clinical trials: Issues to consider. Trials, 13(1), 132. https://doi.org/10.1186/1745-6215-13-132

65. Webbe, J., Sinha, I., & Gale, C. (2018). Core Outcome Sets. Archives of Disease in Childhood. Education and Practice Edition, 103(3), 163-166. https://doi.org/10.1136/archdischild-2016-312117

66. Williamson, P. R., Altman, D. G., Blazeby, J. M., Clarke, M., Devane, D., Gargon, E., & Tugwell, P. (2012). Developing core outcome sets for clinical trials: Issues to consider. Trials, 13, 132. https://doi.org/10.1186/1745-6215-13-132