BackgroundUpper esophageal sphincter opening (UESO), and laryngeal vestibule closure (LVC) are tw... more BackgroundUpper esophageal sphincter opening (UESO), and laryngeal vestibule closure (LVC) are two essential kinematic events whose timings are crucial for adequate bolus clearance and airway protection during swallowing. Their temporal characteristics can be quantified through time‐consuming analysis of videofluoroscopic swallow studies (VFSS).ObjectivesWe sought to establish a model to predict the odds of penetration or aspiration during swallowing based on 15 temporal factors of UES and laryngeal vestibule kinematics.MethodsManual temporal measurements and ratings of penetration and aspiration were conducted on a videofluoroscopic dataset of 408 swallows from 99 patients. A generalized estimating equation model was deployed to analyze association between individual factors and the risk of penetration or aspiration.ResultsThe results indicated that the latencies of laryngeal vestibular events and the time lapse between UESO onset and LVC were highly related to penetration or aspir...
Three hyoid bone movements (coordinate values) for one swallow are listed in this file. The first... more Three hyoid bone movements (coordinate values) for one swallow are listed in this file. The first two columns are the predicted hyoid bone movement based on the computer calculation, in which the input were the sensor signals. The third and forth columns are hyoid bone movements labeled by a human rater based on the X-ray videos, and the fifth and sixth columns are also hyoid bone movements labeled by another human rater.<br>The data in the excel file were also used for drawing the Figure 4(c)
Objective: The aim of this work was to design an anatomically based scale for judging post-swallo... more Objective: The aim of this work was to design an anatomically based scale for judging post-swallow residue in the pharyngeal cavities, for use during the fiberoptic endoscopic evaluation of swallowing (FEES) in patients with dysphagia, and to assess its feasibility. Methods: Two 7-point ordinal scales (one for vallecular residue and one for pyriform sinus residue), were developed using detailed anatomic landmarks to denote residue levels. Hard copy color images of a specified frame, from 210 videos of 30 adult FEES evaluations demonstrating the range of all possible residue patterns, were selected (n = 56 valleculae, 62 pyriform sinuses). Half of these images were used to train 4 raters. The remaining half of the images were randomly ordered and rated by the trained raters. Two weeks later the same images were randomized again, and each rater re-analyzed them. The inter- and intra-rater reliability and criterion validity were determined using the kappa statistics and their standard ...
Big Data III: Learning, Analytics, and Applications, 2021
Swallowing dysfunction, or dysphagia, occurs secondary to many underlying etiologies such as stro... more Swallowing dysfunction, or dysphagia, occurs secondary to many underlying etiologies such as stroke and can lead to pneumonia. The upper esophageal sphincter (UES) is a major anatomical landmark that allows the passage of swallowed materials into the esophagus during swallowing. Delayed UES opening or reduced duration of opening can lead to the accumulation of pharyngeal residue, which can increase risk of aspiration. UES opening is observed through the inspection of radiographic exams, known as videofluoroscopy swallow studies (VFSSs), which expose patients to ionizing radiation and depend on subjective clinician interpretations. High resolution cervical auscultation (HRCA) is a non-invasive sensor-based technology that has been recently investigated to depict swallowing physiology. HRCA has been proposed for detecting UES opening duration through a deep learning framework. However, the proposed framework was only validated over swallows from patients. For such an algorithm to be robust, it has to be proven equally reliable for the detection of UES opening duration in swallows from both patients and healthy subjects. In this study, we intend to investigate the robustness of the HRCA-based framework to detect the UES opening in signals collected from a diverse population. The framework showed comparable performance regarding the UES opening detection with an average area under the ROC curve of 95%. The results indicate that the HRCA-based UES opening detection can provide superior performance on swallows from diverse populations which demonstrates the clinical potential of HRCA as a non-invasive swallowing assessment tool.
American Journal of Speech-Language Pathology, 2020
High-resolution cervical auscultation (HRCA) is an evolving clinical method for noninvasive scree... more High-resolution cervical auscultation (HRCA) is an evolving clinical method for noninvasive screening of dysphagia that relies on data science, machine learning, and wearable sensors to investigate the characteristics of disordered swallowing function in people with dysphagia. HRCA has shown promising results in categorizing normal and disordered swallowing (i.e., screening) independent of human input, identifying a variety of swallowing physiological events as accurately as trained human judges. The system has been developed through a collaboration of data scientists, computer–electrical engineers, and speech-language pathologists. Its potential to automate dysphagia screening and contribute to evaluation lies in its noninvasive nature (wearable electronic sensors) and its growing ability to accurately replicate human judgments of swallowing data typically formed on the basis of videofluoroscopic imaging data. Potential contributions of HRCA when videofluoroscopic swallowing study ...
Aspiration is a serious complication of swallowing disorders. Adequate detection of aspiration is... more Aspiration is a serious complication of swallowing disorders. Adequate detection of aspiration is essential in dysphagia management and treatment. High-resolution cervical auscultation has been increasingly considered as a promising noninvasive swallowing screening tool and has inspired automatic diagnosis with advanced algorithms. The performance of such algorithms relies heavily on the amount of training data. However, the practical collection of cervical auscultation signal is an expensive and time-consuming process because of the clinical settings and trained experts needed for acquisition and interpretations. Furthermore, the relatively infrequent incidence of severe airway invasion during swallowing studies constrains the performance of machine learning models. Here, we produced supplementary training exemplars for desired class by capturing the underlying distribution of original cervical auscultation signal features using auxiliary classifier Wasserstein generative adversarial networks. A 10-fold subject cross-validation was conducted on 2079 sets of 36-dimensional signal features collected from 189 patients undergoing swallowing examinations. The proposed data augmentation outperforms basic data sampling, cost-sensitive learning and other generative models with significant enhancement. This demonstrates the remarkable potential of proposed network in improving classification performance using cervical auscultation signals and paves the way of developing accurate noninvasive swallowing evaluation in dysphagia care.
Hyoid bone movement is an important physiological event during swallowing that contributes to nor... more Hyoid bone movement is an important physiological event during swallowing that contributes to normal swallowing function. In order to determine the adequate hyoid bone movement, clinicians conduct an X-ray videofluoroscopic swallowing study, which even though it is the gold-standard technique, has limitations such as radiation exposure and cost. Here, we demonstrated the ability to track the hyoid bone movement using a non-invasive accelerometry sensor attached to the surface of the human neck. Specifically, deep neural networks were used to mathematically describe the relationship between hyoid bone movement and sensor signals. Training and validation of the system were conducted on a dataset of 400 swallows from 114 patients. Our experiments indicated the computer-aided hyoid bone movement prediction has a promising performance when compared with human experts' judgements, revealing that the universal pattern of the hyoid bone movement is acquirable by the highly nonlinear alg...
Abstract—Objective: The effects of the chin-tuck maneuver, a technique commonly employed to compe... more Abstract—Objective: The effects of the chin-tuck maneuver, a technique commonly employed to compensate for dysphagia, on cervical auscultation are not fully understood. Characterizing a technique that is known to affect swallowing function is an important step on the way to developing a new instrumentation-based swallowing screening tool. Methods: In this study, we recorded data from 55 adult participants who each completed five saliva swallows in a chin-tuck position. The resulting data was processed using previously designed filtering and segmentation algorithms. We then calculated 9 time, frequency, and time-frequency domain features for each independent signal. Results: We found that multiple frequency and time domain features varied significantly between male and female subjects as well as between swallowing sounds and vibrations. However, our analysis showed that participant age did not play a significant role on the values of the extracted features. Finally, we found that var...
Few research studies have investigated temporal kinematic swallow events in healthy adults to est... more Few research studies have investigated temporal kinematic swallow events in healthy adults to establish normative reference values. Determining cutoffs for normal and disordered swallowing is vital for differentially diagnosing presbyphagia, variants of normal swallowing, and dysphagia; and for ensuring that different swallowing research laboratories produce consistent results in common measurements from different samples within the same population. High-resolution cervical auscultation (HRCA), a sensor-based dysphagia screening method, has accurately annotated temporal kinematic swallow events in patients with dysphagia, but hasn’t been used to annotate temporal kinematic swallow events in healthy adults to establish dysphagia screening cutoffs. This study aimed to determine: (1) Reference values for temporal kinematic swallow events, (2) Whether HRCA can annotate temporal kinematic swallow events in healthy adults. We hypothesized (1) Our reference values would align with a prior study; (2) HRCA would detect temporal kinematic swallow events as accurately as human judges. Trained judges completed temporal kinematic measurements on 659 swallows (N = 70 adults). Swallow reaction time and LVC duration weren’t different (p > 0.05) from a previously published historical cohort (114 swallows, N = 38 adults), while other temporal kinematic measurements were different (p < 0.05), suggesting a need for further standardization to feasibly pool data analyses across laboratories. HRCA signal features were used as input to machine learning algorithms and annotated UES opening (69.96% accuracy), UES closure (64.52% accuracy), LVC (52.56% accuracy), and LV re-opening (69.97% accuracy); providing preliminary evidence that HRCA can noninvasively and accurately annotate temporal kinematic measurements in healthy adults to determine dysphagia screening cutoffs.
Purpose The prevalence of dysphagia in patients with neurodegenerative diseases (ND) is alarmingl... more Purpose The prevalence of dysphagia in patients with neurodegenerative diseases (ND) is alarmingly high and frequently results in morbidity and accelerated mortality due to subsequent adverse events (e.g., aspiration pneumonia). Swallowing in patients with ND should be continuously monitored due to the progressive disease nature. Access to instrumental swallow evaluations can be challenging, and limited studies have quantified changes in temporal/spatial swallow kinematic measures in patients with ND. High-resolution cervical auscultation (HRCA), a dysphagia screening method, has accurately differentiated between safe and unsafe swallows, identified swallow kinematic events (e.g., laryngeal vestibule closure [LVC]), and classified swallows between healthy adults and patients with ND. This study aimed to (a) compare temporal/spatial swallow kinematic measures between patients with ND and healthy adults and (b) investigate HRCA's ability to annotate swallow kinematic events in pat...
BackgroundUpper esophageal sphincter opening (UESO), and laryngeal vestibule closure (LVC) are tw... more BackgroundUpper esophageal sphincter opening (UESO), and laryngeal vestibule closure (LVC) are two essential kinematic events whose timings are crucial for adequate bolus clearance and airway protection during swallowing. Their temporal characteristics can be quantified through time‐consuming analysis of videofluoroscopic swallow studies (VFSS).ObjectivesWe sought to establish a model to predict the odds of penetration or aspiration during swallowing based on 15 temporal factors of UES and laryngeal vestibule kinematics.MethodsManual temporal measurements and ratings of penetration and aspiration were conducted on a videofluoroscopic dataset of 408 swallows from 99 patients. A generalized estimating equation model was deployed to analyze association between individual factors and the risk of penetration or aspiration.ResultsThe results indicated that the latencies of laryngeal vestibular events and the time lapse between UESO onset and LVC were highly related to penetration or aspir...
Three hyoid bone movements (coordinate values) for one swallow are listed in this file. The first... more Three hyoid bone movements (coordinate values) for one swallow are listed in this file. The first two columns are the predicted hyoid bone movement based on the computer calculation, in which the input were the sensor signals. The third and forth columns are hyoid bone movements labeled by a human rater based on the X-ray videos, and the fifth and sixth columns are also hyoid bone movements labeled by another human rater.<br>The data in the excel file were also used for drawing the Figure 4(c)
Objective: The aim of this work was to design an anatomically based scale for judging post-swallo... more Objective: The aim of this work was to design an anatomically based scale for judging post-swallow residue in the pharyngeal cavities, for use during the fiberoptic endoscopic evaluation of swallowing (FEES) in patients with dysphagia, and to assess its feasibility. Methods: Two 7-point ordinal scales (one for vallecular residue and one for pyriform sinus residue), were developed using detailed anatomic landmarks to denote residue levels. Hard copy color images of a specified frame, from 210 videos of 30 adult FEES evaluations demonstrating the range of all possible residue patterns, were selected (n = 56 valleculae, 62 pyriform sinuses). Half of these images were used to train 4 raters. The remaining half of the images were randomly ordered and rated by the trained raters. Two weeks later the same images were randomized again, and each rater re-analyzed them. The inter- and intra-rater reliability and criterion validity were determined using the kappa statistics and their standard ...
Big Data III: Learning, Analytics, and Applications, 2021
Swallowing dysfunction, or dysphagia, occurs secondary to many underlying etiologies such as stro... more Swallowing dysfunction, or dysphagia, occurs secondary to many underlying etiologies such as stroke and can lead to pneumonia. The upper esophageal sphincter (UES) is a major anatomical landmark that allows the passage of swallowed materials into the esophagus during swallowing. Delayed UES opening or reduced duration of opening can lead to the accumulation of pharyngeal residue, which can increase risk of aspiration. UES opening is observed through the inspection of radiographic exams, known as videofluoroscopy swallow studies (VFSSs), which expose patients to ionizing radiation and depend on subjective clinician interpretations. High resolution cervical auscultation (HRCA) is a non-invasive sensor-based technology that has been recently investigated to depict swallowing physiology. HRCA has been proposed for detecting UES opening duration through a deep learning framework. However, the proposed framework was only validated over swallows from patients. For such an algorithm to be robust, it has to be proven equally reliable for the detection of UES opening duration in swallows from both patients and healthy subjects. In this study, we intend to investigate the robustness of the HRCA-based framework to detect the UES opening in signals collected from a diverse population. The framework showed comparable performance regarding the UES opening detection with an average area under the ROC curve of 95%. The results indicate that the HRCA-based UES opening detection can provide superior performance on swallows from diverse populations which demonstrates the clinical potential of HRCA as a non-invasive swallowing assessment tool.
American Journal of Speech-Language Pathology, 2020
High-resolution cervical auscultation (HRCA) is an evolving clinical method for noninvasive scree... more High-resolution cervical auscultation (HRCA) is an evolving clinical method for noninvasive screening of dysphagia that relies on data science, machine learning, and wearable sensors to investigate the characteristics of disordered swallowing function in people with dysphagia. HRCA has shown promising results in categorizing normal and disordered swallowing (i.e., screening) independent of human input, identifying a variety of swallowing physiological events as accurately as trained human judges. The system has been developed through a collaboration of data scientists, computer–electrical engineers, and speech-language pathologists. Its potential to automate dysphagia screening and contribute to evaluation lies in its noninvasive nature (wearable electronic sensors) and its growing ability to accurately replicate human judgments of swallowing data typically formed on the basis of videofluoroscopic imaging data. Potential contributions of HRCA when videofluoroscopic swallowing study ...
Aspiration is a serious complication of swallowing disorders. Adequate detection of aspiration is... more Aspiration is a serious complication of swallowing disorders. Adequate detection of aspiration is essential in dysphagia management and treatment. High-resolution cervical auscultation has been increasingly considered as a promising noninvasive swallowing screening tool and has inspired automatic diagnosis with advanced algorithms. The performance of such algorithms relies heavily on the amount of training data. However, the practical collection of cervical auscultation signal is an expensive and time-consuming process because of the clinical settings and trained experts needed for acquisition and interpretations. Furthermore, the relatively infrequent incidence of severe airway invasion during swallowing studies constrains the performance of machine learning models. Here, we produced supplementary training exemplars for desired class by capturing the underlying distribution of original cervical auscultation signal features using auxiliary classifier Wasserstein generative adversarial networks. A 10-fold subject cross-validation was conducted on 2079 sets of 36-dimensional signal features collected from 189 patients undergoing swallowing examinations. The proposed data augmentation outperforms basic data sampling, cost-sensitive learning and other generative models with significant enhancement. This demonstrates the remarkable potential of proposed network in improving classification performance using cervical auscultation signals and paves the way of developing accurate noninvasive swallowing evaluation in dysphagia care.
Hyoid bone movement is an important physiological event during swallowing that contributes to nor... more Hyoid bone movement is an important physiological event during swallowing that contributes to normal swallowing function. In order to determine the adequate hyoid bone movement, clinicians conduct an X-ray videofluoroscopic swallowing study, which even though it is the gold-standard technique, has limitations such as radiation exposure and cost. Here, we demonstrated the ability to track the hyoid bone movement using a non-invasive accelerometry sensor attached to the surface of the human neck. Specifically, deep neural networks were used to mathematically describe the relationship between hyoid bone movement and sensor signals. Training and validation of the system were conducted on a dataset of 400 swallows from 114 patients. Our experiments indicated the computer-aided hyoid bone movement prediction has a promising performance when compared with human experts' judgements, revealing that the universal pattern of the hyoid bone movement is acquirable by the highly nonlinear alg...
Abstract—Objective: The effects of the chin-tuck maneuver, a technique commonly employed to compe... more Abstract—Objective: The effects of the chin-tuck maneuver, a technique commonly employed to compensate for dysphagia, on cervical auscultation are not fully understood. Characterizing a technique that is known to affect swallowing function is an important step on the way to developing a new instrumentation-based swallowing screening tool. Methods: In this study, we recorded data from 55 adult participants who each completed five saliva swallows in a chin-tuck position. The resulting data was processed using previously designed filtering and segmentation algorithms. We then calculated 9 time, frequency, and time-frequency domain features for each independent signal. Results: We found that multiple frequency and time domain features varied significantly between male and female subjects as well as between swallowing sounds and vibrations. However, our analysis showed that participant age did not play a significant role on the values of the extracted features. Finally, we found that var...
Few research studies have investigated temporal kinematic swallow events in healthy adults to est... more Few research studies have investigated temporal kinematic swallow events in healthy adults to establish normative reference values. Determining cutoffs for normal and disordered swallowing is vital for differentially diagnosing presbyphagia, variants of normal swallowing, and dysphagia; and for ensuring that different swallowing research laboratories produce consistent results in common measurements from different samples within the same population. High-resolution cervical auscultation (HRCA), a sensor-based dysphagia screening method, has accurately annotated temporal kinematic swallow events in patients with dysphagia, but hasn’t been used to annotate temporal kinematic swallow events in healthy adults to establish dysphagia screening cutoffs. This study aimed to determine: (1) Reference values for temporal kinematic swallow events, (2) Whether HRCA can annotate temporal kinematic swallow events in healthy adults. We hypothesized (1) Our reference values would align with a prior study; (2) HRCA would detect temporal kinematic swallow events as accurately as human judges. Trained judges completed temporal kinematic measurements on 659 swallows (N = 70 adults). Swallow reaction time and LVC duration weren’t different (p > 0.05) from a previously published historical cohort (114 swallows, N = 38 adults), while other temporal kinematic measurements were different (p < 0.05), suggesting a need for further standardization to feasibly pool data analyses across laboratories. HRCA signal features were used as input to machine learning algorithms and annotated UES opening (69.96% accuracy), UES closure (64.52% accuracy), LVC (52.56% accuracy), and LV re-opening (69.97% accuracy); providing preliminary evidence that HRCA can noninvasively and accurately annotate temporal kinematic measurements in healthy adults to determine dysphagia screening cutoffs.
Purpose The prevalence of dysphagia in patients with neurodegenerative diseases (ND) is alarmingl... more Purpose The prevalence of dysphagia in patients with neurodegenerative diseases (ND) is alarmingly high and frequently results in morbidity and accelerated mortality due to subsequent adverse events (e.g., aspiration pneumonia). Swallowing in patients with ND should be continuously monitored due to the progressive disease nature. Access to instrumental swallow evaluations can be challenging, and limited studies have quantified changes in temporal/spatial swallow kinematic measures in patients with ND. High-resolution cervical auscultation (HRCA), a dysphagia screening method, has accurately differentiated between safe and unsafe swallows, identified swallow kinematic events (e.g., laryngeal vestibule closure [LVC]), and classified swallows between healthy adults and patients with ND. This study aimed to (a) compare temporal/spatial swallow kinematic measures between patients with ND and healthy adults and (b) investigate HRCA's ability to annotate swallow kinematic events in pat...
Uploads
Papers by James L Coyle