Background: Early identification of dysphagia reduces morbidity and mortality in acute stroke patients. During the acute phase of stroke, the Barnes-Jewish  Hospital Stroke Dysphagia Screen (BJH-SDS) is commonly recommended for such cases. In this study, our aim was to perform validity and reliability of the  Turkish version of BJH-SDS with a different method.
Methods: The scale was administered to 140 acute stroke patients within the first 24 hours of the event. The procedures were scored by two blind  independent expert observers. Cronbach’s alpha and item-to-total correlations were used to assess internal consistency. Inter-rater reliability studies were also  conducted. Endoscopic evaluations were performed within the first 24 hours following the application of the screening tests. The flexible fiberoptic endoscopic  evaluation of swallow (FEES) method was used to describe the validity of measures. 
Results: The mean age of 140 patients [58 (41.4 %) female, 82 (58.6 %) male] included in the study was 67.20 (SD 12.82) years. The internal consistency  of the test was good with Chronbach’s α values between 0.831 and 0.894, and there was a very good inter-rater agreement based on an intra-class  correlation coefficient between 0.850 and 1.000. The item-to-total correlation for test items was between 0.493 and 0.712, exceeding the commonly accepted  level of > 0.3. A significant positive association between total test scores of the raters and FEES levels (r: 0.733 p=0.001 and r=0.744, p=0.001). Based on the total scores, the sensitivity and specificity for detecting the presence of dysphagia were 78.6% and 80 to 82.8%, respectively. 
Conclusion: Our results suggest that the Turkish version of BJH-SDS that performed by using FEES method is a valid and reliable instrument when  determining dysphagia in acute stroke patients. 

• Stroke

• Dysphagia

• Barnes-Jewish hospital stroke

• Dysphagia screen test

• FEES

Eren Y, Umay EK, K?l?ç G, Yaylac? A, Alicura S, et al. (2017) Reliability and Validity of Barnes-Jewish Hospital Stroke Dysphagia Screen Test in Turkish Stroke Patients with the Fiberoptic Endoscopic Method. Ann Otolaryngol Rhinol 4(9): 1199.

Dysphagia is a serious condition commonly observed in patients with acute stroke. The prevalence rate for dysphagia varies between 37% and 78%, depending on the time and method of assessment [1,2].

Generally, dysphagia resolves within the first two weeks in almost 90% of patients with stroke [3,4]. Thus early period represents the most significant period of time for these patients.

It does not only increase the risk of complications such as swallowing abnormality, dehydration, and malnutrition, but it is also associated with an increased short term mortality [4-6]. Aspiration-related pneumonia is the most important complication of dysphagia. Studies examining patients with dysphagia after acute stroke showed the presence of silent aspiration in 60% of these cases, which may lead to a mortality rate of up to 50% [3].

Early recognition of dysphagia results in reduced complication rate, shortened hospital stay, and decreased in healthcare costs [3,7,8].

American Stroke Association and the Joint Commission on Accreditation of Healthcare Organizations (JCAHO) have described the importance of early diagnosis of dysphagia in acute stroke patients [9].

These organizations were commended that, this diagnosis should be include a bedside screening test protocol. Furtmore, this protocol should be consists of the check list and the water swallow test gave the best patient outcomes [10,11]. BJH-Stroke Dysphagia Screening (BJH-SDS) is recommended in accordance with these criteria [4].

Stroke represents an important heath problem both globally and nationally. Although nutritional management in stroke patients admitted to hospitals is based on an assessment of swallowing functions, no standardized dysphagia screening is utilized. Thus, we performed a reliability and validity testing of the Turkish version of Barnes Jewish Hospital Dysphagia Screen (BJH-SDS), which was originally developed in the stroke unit of Barnes Jewish Hospital and which was shown to be a reliable assessment tool in numerous previous studies [12].

A total of 140 patients admitted to our neurology department with clinical and radiological diagnosis of acute stroke between February 2016 and February 2017 were included in this study.

All patients were informed regarding the study details; the study was approved by the Local Ethics Committee of the Diskapi Yildirim Beyazit Education and Research Hospital. All investigators confirmed the ethical standards as described in the Declaration of Helsinki.

The inclusion criteria were as follows: To have the diagnosis of acute stroke based on clinical and magnetic resonance imaging(MRI) results, to be at the age of > 18 years, and to have normal cognitive functions (Mini Mental Test Score >24 points).

The exclusion criteria included the presence of previous stroke, neurodegenerative or muscular disease histories which are potentially associated with swallowing disorder, having malignancy, history of surgery in the head and neck region, bilateral cranial infarction, and psychiatric disorders. Also, presence of infectious diseases such as HIV, hepatitis B, or hepatitis C, decompensated heart failure, and nasal obstruction were the exclusion criteria for FEES.

The 140 patients included in the study were assessed within the first 24 hours. Demographic data, lesion side and stroke subtype according to Bamford classification were recorded [13]. The severity of the stroke was assessed using the National Institute Health Stroke Scale (NIHSS), while the functional disability was evaluated with the Modified Rankin scale [14,15] FEES was administered within the first 72 hours.

Barnes-Jewish Hospital Stroke Dysphagia Screen(BJHSDS) Test

BJH-SDS is a bed-side assessment tool developed in 2006 in order to identify the presence of dysphagia in acute stroke patients. The tool is administered by the nurses (appendix) [12]

Translation of BJH

As the initial step, permission was requested from the developer Edmiaston for conducting the validity and reliability studies of the Turkish version of BJH-SDS.

BJH-SDS was independently translated to Turkish by bilingual two physicians. Both translations were compared by five physicians (a neurologist, a specialist in physical medicine and rehabilitation (PMR), and three otolaryngologists ) and formed scale. The pilot study for the initially prepared form was carried out in 15 patients, and using the feed-back obtained from these 15 patients, a re-assessment was performed to obtain the final document. It was translated into English by native English speaking, language expert .The final Turkish version’s compliance with BJH-SDS accepted following a comparison of the meaning and format original English form. Speech and language therapists are available in only a very limited number of centers in Turkey. The swallowing disorder is generally assessed by the treating physician. Thus, the term “SPL” was replaced by the term “clinician” in the first sentence of the tool.

Reliability

Cronbach’s alpha coefficient and item-to-total correlations were used to assess internal consistency. Inter-rater reliability studies were also conducted. Agreement between two independent raters was analyzed using Intraclass Correlation Coefficient (ICC). One hour between the examinations was considered to be sufficient to prevent bias, because swallowing function may change over time.

Validity

The validity was assessed by the dysphagia level with FEES. Endoscopic evaluation was performed by an otolaryngologist blinded to the BJH-SDS test within the first 24 hours after performing the second BJH-SDS test.

The FEES was performed by the same otolaryngologist using a non-ducted fiberoptic nasopharyngoscope of 3.4 mm diameter, a light source, camera, monitor, and DVD recorder (Karl Storz GmbH & Co KG, Tuttlingen, Germany). The assessments were performed at the highest possible upright sitting position. Water was used for liquid, yoghurt for semisolid and a biscuit for solid food evaluations. Findings were recorded as video images. At the end of the examination, the dysphagia level was scored from 1 to 6 according to the protocol of assessment of dysphagia developed by Dziewas et al. [16] While 1 point was considered as “normal swallowing”, 2-6 points were defined as “dysphagia

Statistical analysis

All statistical analyses were carried out using SPSS 22.0 statistical package (SPSS, Chicago, IL, USA). Descriptive statistics were demonstrated as mean ± standard deviations for continuous variables and as a percentage (%) for nominal All statistical analyses were carried out using SPSS 22.0 statistical package (SPSS, Chicago, IL, USA). Descriptive statistics were demonstrated as mean ± standard deviations for continuous variables and as a percentage (%) for nominal

Patient Characteristics

The mean age of 140 patients [58 (41.4 %) female, 82 (58.6 %) male] included in the study was 67.20 (SD 12.82) years. The disease characteristics of patients are presented in (Table 1).

Table 1: The disease characteristics of patients.

An assessment of the swallowing functions showed the presence of oral phase disorder in 69 patients (49.3%). The mean PAS based on FEES assessment was 1.50 (1.0-6.0).

Reliability

Tests performed by 1st neurologist and the 2nd PMR specialist indicated that the internal consistency was “good” with a Cronbach’s α values of 0.894 and 0.831, respectively.

Item-to-total correlation results according to both raters are shown in Table (2).

Table 2: Corrected Item-total correlation results according to the two raters.

According to the corrected item-total correlation, Spearman’s rho correlation coefficients were ranged between 0.493 for “item 2 “ to 0.712 for “item 5” for both raters and all of the subtests were above the acceptable standards.

Inter-rater reliability between inter-raters are presented in Table (3).

Table 3: Inter-rater reliability between inter-raters

In the measurements performed with ICC, the values varied from 0.850 to 1.000, suggesting satisfactory stability and very good reliability of the subtests. None of the items showed good, poor or fair agreement.

Validity

A strong positive significant correlation was found between FEES stage and the total scores of the raters (r: 0.733 p=0.001; r=0.744, p=0.001, respectively).

According to total score; sensitivity, specificity, PPV and NPV were established as follows respectively 78.6%, 80-82.8%, %75.6-72.3 and 79.4-78.8% (Figure 1). 

Figure 1: Roc curve analysis for prediction of dysphagia risk.

These results indicate that T-BJH is a very useful and accurate diagnostic tool in the prediction of the risk of dysphagia.

The pathophysiology of swallowing disorder not only involves peripheral, but also central mechanisms, which play a major part. It is a synchronous and persistent process with a certain pattern that is initiated by the brainstem. Although swallowing consists of a series of successive actions, the duration of laryngeal elevation, opening of the upper esophageal sphincter, and breath holding phases vary depending on the bolus volume and viscocity. Stroke has an impact on swallowing at multiple levels based on the interruption in the feedback loop. The recovery is dependent on the cortical healing [19,20].

Although dysphagia may rapidly improve following stroke, the swallowing function may exhibit variability in some patients [19]. Neurogenic oropharyngeal dysphagia is considered to represent a prognostic marker in stroke patients. In a study by Ickenstein et al., presence of aspiration within the first 72 hour period was found to predict severe swallowing disorder in the first 90 days following stroke [3] Identification and management of dysphagia should be promptly undertaken after stroke.

In recent years, numerous bedside swallowing screening tests have been developed in order to assess dysphagia in stroke patients, each with varying degrees of validity and reliability [12,21-24], Currently no consensus exists on a standard screening testing [25].

However, use of BJH-SDS is commonly endorsed based on its ability to meet a number of criteria such as its high sensitivity, high reliability, and quick and easy administration [4]

In the first study which Edmiaston et al. published in 2010, BJH-SDS was administered by nurses to a total of 300 acute stroke patients within the first 8 to 32 hour period after the incident, and the tool was validated against the Mann Assessment of Swallowing Ability Scale. The inter-test reliability was 94%, and the inter-rater reliability was 92.5% [12,26]

In the other study Edmiaston et al. conducted in 2013, BJHSDS was administered to 225 patients with acute stroke, and the test results were compared with the video-fluoroscopy findings. The sensitivity and specificity for dysphagia were 94% and 66%, respectively, while the corresponding figures for aspiration were 95%, and 50 [27].

In this study, the tool was administered by a neurologist and a physical therapy and rehabilitation specialist. Routine assessment of the first 4 items within the context of the neurological examination provided convenience, and water swallowing test allowed a rapid assessment of the presence of dysphagia. The administration time of BJH took < 2 minutes. This is similar to the time required to complete the English version of the instrument.

In our study, a high inter-rater reliability was observed, although the correlation was only moderate for the 4th item. This may be due to the irritation experienced by the patient during examination, since the assessment of the palatal arch may pose certain challenges in patients who have a very strong gagging reflex. In other items of the test, the inter-rater correlation was high. This is consistent with the report of the Edmiaston evaluating the BJH in original language. Thus, it may be concluded that BJH also possesses reliability in repeated assessments, implying a high reproducibility.

The test was validated by using FEES. The severity of dysphagia was assessed with the Penetration Aspiration Scale developed by Dziewias, and a high correlation was identified [16]. Based on the total score the sensitivity was 78.6%, and the specificity was 80 to 82.8%. These results indicate that T-BJH is a very useful and accurate diagnostic tool in the prediction of the risk of dysphagia.

In the study by Edmiaston et al. the test was validated by using VF [21]. The current study confirmed the reliability of the test using both methods. Although VF is considered as the gold standard method for the detection of dysphagia, FEES currently represents the most frequently utilized assessment tool for the objective evaluation for dysphagia, as emphasized by the German Neurology and Stroke Associations and by Dziewas et al. [28] FEES allows effective and reliable assessment of swallowing as well as the determination of appropriate nutrition strategy and efficacy of different swallowing maneuvers. Furthermore, bedside utility and good tolerability provide additional advantages [29]. We also consider such benefits of FEES, which can be associated with time-savings with respect to nutrition management in vital stabilization and treatment planning stages during the acute period in the stroke unit (Appendix).

(throat cleaning, cough or change vocal quality within 1 minute)

As a conclusion a reliability and validity study other than the original language of BJH-SDS was performed for the first time which confirmed the reliability and validity of the Turkish version in stroke patients. Moreover, effectiveness of this test has been shown by using FEES method which has easy application, radiation free and increased popularity in recent years more than VF. The test’s reliability and validity have been updated. We believe that more extensive use of different language versions of this practical and rapid tool easily administrable by all healthcare professionals may assist in reaching a consensus for the dysphagia management during the acute phase of stroke.

1. Mann G, Hankey GJ, Cameron D. Swallowing function after stroke: prognosis and prognostic factors at 6 months. Stroke. 1999; 30: 744- 748.

2. Martino R, Foley N, Bhogal S, Diamant N, Speechley M, Teasell R. Dysphagia after stroke: incidence, diagnosis, and pulmonary complications. Stroke. 2005; 36: 2756-2763.

3. Ickenstein GW, Höhlig C, Prosiegel M, Koch H, Dziewas R, et al. Prediction of outcome in neurogenic oropharyngeal dysphagia within 72 hours of acute stroke. J Stroke Cerebrovasc Dis. 2012; 21: 569-576.

4. Frieling T. The Role of the Endoscopist in the Stroke Unit. Visc Med.2016 32:53-57.

5. Arnold M, Liesirova K, Broeg-Morvay A, Meisterernst J, Schlager M,et al. Dysphagia in Acute Stroke: Incidence, Burden and Impact on Clinical Outcome. PLoS One. 2016; 11: 0148424.

6. Mourão AM, Lemos SM, Almeida EO, Vicente LC, Teixeira AL. Frequency and factors associated with dysphagia in stroke. Codas. 2016; 28: 66-70.

7. Fedder WN. Review of Evidenced-Based Nursing Protocols for Dysphagia Assessment. Stroke. 2017; 48: 99-101.

8. Bax L, McFarlane M, Green E, Miles A. Speech-language pathologist-led fiberoptic endoscopic evaluation of swallowing:functional outcomes for patients after stroke. J Stroke Cerebrovasc Dis. 2014; 23: 195-200.

9. Summers D, Leonard A, Wentworth D, Saver JL, Simpson J, Spilker JA, et al. Comprehensive overview of nursing and interdisciplinary care of the acute ischemic stroke patient: a scientific statement from the American Heart Association. Stroke. 2009; 40: 2911-2944.

10. Hinchey JA, Shephard T, Furie K, Smith D, Wang D, Tonn S; Stroke Practice Improvement Network Investigators. Formal dysphagia screening protocols prevent pneumonia. Stroke. 2005; 36: 1972-1976.

11. Suiter DM, Leder SB. Clinical utility of the 3-ounce water swallow test. Dysphagia. 2008; 23: 244-250.

12. Edmiaston J, Connor LT, Loehr L, Nassief A. Validation of a dysphagia screening tool in acute stroke patients. Am J Crit Care. 2010; 19: 357- 364. 13.

13. Lindley RI, Warlow CP, Wardlaw JM, Dennis MS, Slattery J, Sandercock PA. Interobserver reliability of a clinical classification of acute cerebral infarction. Stroke. 1993; 24: 1801-1804.

14. Brott T, Adams HP Jr, Olinger CP, Marler JR, Barsan WG, Biller J, et al. Measurements of acute cerebral infarction: a clinical examination scale. Stroke. 1989; 20: 864-870.

15. Bonita R, Beaglehole R. Recovery of motor function after stroke. Stroke. 1988; 19: 1497-1500.

16. Dziewas R, Warnecke T, Olenberg S, Teismann I, Zimmermann J, et al. Towards a basic endoscopic assessment of swallowing in acute stroke – development and evaluation of a simple dysphagia score. Cerebrovasc Dis. 2008; 26: 41-47.

17. Bland JM, Altman DG. Statistical methods for assessing agreement between two methods of clinical measurement. Lancet. 1986; 8476: 307-331.

18. Dawson B, Trapp RG. Basic and Clinical Biostatistics. 4th Ed. New York: Lange Medical Books/McGraw-Hill; 2004.

19. Smithard DG. Dysphagia Management and Stroke Units. Curr Phys Med Rehabil Rep. 2016; 4: 287-294.

20. Okubo PC, Fábio SR, Domenis DR, Takayanagui OM. Using the National Institute of Health Stroke Scale to predict dysphagia in acute ischemic stroke. Cerebrovasc Dis. 2012; 33: 501-507. 21.

21. Trapl M, Enderle P, Nowotny M, Teuschl Y, Matz K. Dysphagia bedside screening for acute-stroke patients: the Gugging Swallowing Screen. Stroke. 2007; 38: 2948-2952.

22. Martino R, Silver F, Teasell R, Bayley M, Nicholson G,et al.The Toronto Bedside Swallowing Screening Test (TOR-BSST): development and validation of a dysphagia screening tool for patients with stroke. Stroke. 2009; 40: 555-561.

23. Turner-Lawrence DE, Peebles M, Price MF, Singh SJ, Asimos AW. A feasibility study of the sensitivity of emergency physician Dysphagia screening in acute stroke patients. Ann Emerg Med. 2009; 54: 344- 348.

24. Antonios N, Carnaby-Mann G, Crary M, Miller L, Hubbard H, Hood K, Sambandam R, Xavier A, Silliman S. Analysis of a physician tool for evaluating dysphagia on an inpatient stroke unit: the modified Mann Assessment of Swallowing Ability. J Stroke Cerebrovasc Dis. 2010; 19: 49-57.

25. Daniels SK, Anderson JA, Willson PC. Valid items for screening dysphagia risk in patients with stroke: a systematic review. Stroke. 2012; 43: 892-897.

26. Mann G. MASA:The Mann Assessment of Swallowing Ability. Singular;Clifton Park,NY: 2002.

27. Edmiaston J, Connor LT, Steger-May K, Ford AL. A simple bedside stroke dysphagia screen, validated against videofluoroscopy,detects dysphagia and aspiration with high sensitivity J Stroke Cerebrovasc Dis. 2014; 23: 712-716.

28. Dziewas R, Glahn J, Helfer C, Ickenstein G, Keller J. Flexible endoscopic evaluation of swallowing (FEES) for neurogenic dysphagia:training curriculum of the German Society of Neurology and the German stroke society. BMC Med Educ. 2016;16:70.

29. Radhakrishnan S, Menon UK, Anandakuttan A. A combined approach of bedside clinical examination and flexible endoscopic evaluation of swallowing in poststroke dysphagia: A pilot study. Ann Indian Acad Neurol. 2013;16: 388-393.