[go: up one dir, main page]

Next Issue
Volume 22, April-1
Previous Issue
Volume 22, March-1
 
 
sensors-logo

Journal Browser

Journal Browser

Sensors, Volume 22, Issue 6 (March-2 2022) – 349 articles

Cover Story (view full-size image): Real-time temperature monitoring is vital for most industrial and energy-conversion processes. Conventional high temperature solid-state sensors are composed of metals or semiconductor materials that are unstable in many of these harsh-environment reactors. In this work, a novel all-ceramic passive wireless LC resonator (planar inductor and parallel plate capacitor) was proposed, fabricated, and tested using all-ceramic refractory materials. Tin-doped indium oxide (ITO) and Al2O3 were chosen as electroconductive and dielectric ceramic materials. The wireless response from the sensor was interrogated through thermal insulation (1-inch) based on the principle of mutual inductive coupling between inductor and antenna. Moreover, the sensor placed in the hot zone does not require a battery or external power source for operation. View this paper
  • Issues are regarded as officially published after their release is announced to the table of contents alert mailing list.
  • You may sign up for e-mail alerts to receive table of contents of newly released issues.
  • PDF is the official format for papers published in both, html and pdf forms. To view the papers in pdf format, click on the "PDF Full-text" link, and use the free Adobe Reader to open them.
Order results
Result details
Section
Select all
Export citation of selected articles as:
21 pages, 7618 KiB  
Article
Statistical Analysis of the Consistency of HRV Analysis Using BCG or Pulse Wave Signals
by Huiying Cui, Zhongyi Wang, Bin Yu, Fangfang Jiang, Ning Geng, Yongchun Li, Lisheng Xu, Dingchang Zheng, Biyong Zhang, Peilin Lu and Stephen E. Greenwald
Sensors 2022, 22(6), 2423; https://doi.org/10.3390/s22062423 - 21 Mar 2022
Cited by 5 | Viewed by 3412
Abstract
Ballistocardiography (BCG) is considered a good alternative to HRV analysis with its non-contact and unobtrusive acquisition characteristics. However, consensus about its validity has not yet been established. In this study, 50 healthy subjects (26.2 ± 5.5 years old, 22 females, 28 males) were [...] Read more.
Ballistocardiography (BCG) is considered a good alternative to HRV analysis with its non-contact and unobtrusive acquisition characteristics. However, consensus about its validity has not yet been established. In this study, 50 healthy subjects (26.2 ± 5.5 years old, 22 females, 28 males) were invited. Comprehensive statistical analysis, including Coefficients of Variation (CV), Lin’s Concordance Correlation Coefficient (LCCC), and Bland-Altman analysis (BA ratio), were utilized to analyze the consistency of BCG and ECG signals in HRV analysis. If the methods gave different answers, the worst case was taken as the result. Measures of consistency such as Mean, SDNN, LF gave good agreement (the absolute value of CV difference < 2%, LCCC > 0.99, BA ratio < 0.1) between J-J (BCG) and R-R intervals (ECG). pNN50 showed moderate agreement (the absolute value of CV difference < 5%, LCCC > 0.95, BA ratio < 0.2), while RMSSD, HF, LF/HF indicated poor agreement (the absolute value of CV difference ≥ 5% or LCCC ≤ 0.95 or BA ratio ≥ 0.2). Additionally, the R-R intervals were compared with P-P intervals extracted from the pulse wave (PW). Except for pNN50, which exhibited poor agreement in this comparison, the performances of the HRV indices estimated from the PW and the BCG signals were similar. Full article
(This article belongs to the Section Biosensors)
Show Figures

Figure 1

Figure 1
<p>Photograph of the devices used to simultaneously record BCG, ECG and PW signals.</p>
Full article ">Figure 2
<p>Peak detection of the BCG, ECG, PW signals. Circles indicate time points from which heart intervals are recorded. J for the BCG signals, R for the ECG and P for pulse wave (PW).</p>
Full article ">Figure 3
<p>Data from 50 subjects. (<b>a</b>) linear regression of R-R and J-J intervals. (<b>b</b>) linear regression of R-R and P-P intervals.</p>
Full article ">Figure 4
<p>Pairs of HRV metrics (title above each plot) obtained from 50 subjects plotted against the line of identity (representing perfect agreement). <span class="html-italic">x</span>- and <span class="html-italic">y</span>-axes show BCG and ECG values, respectively. (<b>a</b>) Mean. (<b>b</b>) SDNN. (<b>c</b>) pNN50. (<b>d</b>) RMSSD. (<b>e</b>) LF. (<b>f</b>) HF. (<b>g</b>) LF/HF.</p>
Full article ">Figure 5
<p>Pairs of HRV metrics obtained from 50 subjects plotted against the line of identity (representing perfect agreement). <span class="html-italic">x</span>- and <span class="html-italic">y</span>-axes show PW and ECG values, respectively. (<b>a</b>) Mean. (<b>b</b>) SDNN. (<b>c</b>) pNN50. (<b>d</b>) RMSSD. (<b>e</b>) LF. (<b>f</b>) HF. (<b>g</b>) LF/HF.</p>
Full article ">Figure 6
<p>Pairs of HRV metrics obtained from the medium-term data plotted against the line of identity. <span class="html-italic">x</span>- and <span class="html-italic">y</span>-axes show BCG and ECG values, respectively. (Results from each of the three subjects are shown in different colors.). (<b>a</b>) Mean. (<b>b</b>) SDNN. (<b>c</b>) pNN50. (<b>d</b>) RMSSD. (<b>e</b>) LF. (<b>f</b>) HF. (<b>g</b>) LF/HF.</p>
Full article ">Figure 7
<p>Pairs of HRV metrics obtained from the medium-term data plotted against the line of identity. <span class="html-italic">x</span>- and <span class="html-italic">y</span>-axes show PW and ECG values, respectively. (Results from each of the three subjects are shown in different colors.) (<b>a</b>) is for Mean. (<b>b</b>) is for SDNN. (<b>c</b>) is for pNN50. (<b>d</b>) is for RMSSD. (<b>e</b>) is for LF. (<b>f</b>) is for HF. (<b>g</b>) is for LF/HF.</p>
Full article ">Figure A1
<p>Bland-Altman plots for the HRV parameters calculated from J-J and R-R intervals. Data from 50 subjects. (<b>a</b>) Mean. (<b>b</b>) SDNN. (<b>c</b>) pNN50. (<b>d</b>) RMSSD. (<b>e</b>) LF. (<b>f</b>) HF. (<b>g</b>) LF/HF. Heavy black line shows mean difference, thin lines represent the 95% confidence intervals and red dots show the measurement data.</p>
Full article ">Figure A2
<p>Bland-Altman plots for the HRV parameters calculated from P-P and R-R intervals. Data from 50 subjects. (<b>a</b>) Mean. (<b>b</b>) SDNN. (<b>c</b>) pNN50. (<b>d</b>) RMSSD. (<b>e</b>) LF. (<b>f</b>) HF. (<b>g</b>) LF/HF. Heavy black line shows mean difference, thin lines represent the 95% confidence intervals and red dots show the measurement data.</p>
Full article ">Figure A3
<p>Bland-Altman plots for the HRV parameters calculated from J-J and R-R intervals of subject A. (<b>a</b>) Mean. (<b>b</b>) SDNN. (<b>c</b>) pNN50. (<b>d</b>) RMSSD. (<b>e</b>) LF. (<b>f</b>) HF. (<b>g</b>) LF/HF. Heavy black line shows mean difference, thin lines represent the 95% confidence intervals and red dots show the measurement data.</p>
Full article ">Figure A4
<p>Bland-Altman plots for the HRV parameters calculated from P-P and R-R intervals of subject A. (<b>a</b>) Mean. (<b>b</b>) SDNN. (<b>c</b>) pNN50. (<b>d</b>) RMSSD. (<b>e</b>) LF. (<b>f</b>) HF. (<b>g</b>) LF/HF. Heavy black line shows mean difference, thin lines represent the 95% confidence intervals and red dots show the measurement data.</p>
Full article ">Figure A5
<p>Bland-Altman plots for the HRV parameters calculated from J-J and R-R intervals of subject B. (<b>a</b>) is for Mean. (<b>b</b>) is for SDNN. (<b>c</b>) is for pNN50. (<b>d</b>) is for RMSSD. (<b>e</b>) is for LF. (<b>f</b>) is for HF. (<b>g</b>) is for LF/HF. The black line represents the 95% confidence interval and the red dot represents the measurement data.</p>
Full article ">Figure A6
<p>Bland-Altman plots for the HRV parameters calculated from P-P and R-R intervals of subject B. (<b>a</b>) is for Mean. (<b>b</b>) is for SDNN. (<b>c</b>) is for pNN50. (<b>d</b>) is for RMSSD. (<b>e</b>) is for LF. (<b>f</b>) is for HF. (<b>g</b>) is for LF/HF. The black line represents the 95% confidence interval and the red dot represents the measurement data.</p>
Full article ">Figure A7
<p>Bland-Altman plots for the HRV parameters calculated from J-J and R-R intervals of subject C. (<b>a</b>) is for Mean. (<b>b</b>) is for SDNN. (<b>c</b>) is for pNN50. (<b>d</b>) is for RMSSD. (<b>e</b>) is for LF. (<b>f</b>) is for HF. (<b>g</b>) is for LF/HF. The black line represents the 95% confidence interval and the red dot represents the measurement data.</p>
Full article ">Figure A8
<p>Bland-Altman plots for the HRV parameters calculated from P-P and R-R intervals of subject C. (<b>a</b>) is for Mean. (<b>b</b>) is for SDNN. (<b>c</b>) is for pNN50. (<b>d</b>) is for RMSSD. (<b>e</b>) is for LF. (<b>f</b>) is for HF. (<b>g</b>) is for LF/HF. The black line represents the 95% confidence interval and the red dot represents the measurement data.</p>
Full article ">
32 pages, 8732 KiB  
Article
n-Player Stochastic Duel Game Model with Applied Deep Learning and Its Modern Implications
by Manik Gupta, Bhisham Sharma, Akarsh Tripathi, Shashank Singh, Abhishek Bhola, Rajani Singh and Ashutosh Dhar Dwivedi
Sensors 2022, 22(6), 2422; https://doi.org/10.3390/s22062422 - 21 Mar 2022
Cited by 7 | Viewed by 3526
Abstract
This paper provides a conceptual foundation for stochastic duels and contains a further study of the game models based on the theory of stochastic duels. Some other combat assessment techniques are looked upon briefly; a modern outlook on the applications of the theory [...] Read more.
This paper provides a conceptual foundation for stochastic duels and contains a further study of the game models based on the theory of stochastic duels. Some other combat assessment techniques are looked upon briefly; a modern outlook on the applications of the theory through video games is provided; and the possibility of usage of data generated by popular shooter-type video games is discussed. Impactful works to date are carefully chosen; a timeline of the developments in the theory of stochastic duels is provided; and a brief literature review for the same is conducted, enabling readers to have a broad outlook at the theory of stochastic duels. A new evaluation model is introduced in order to match realistic scenarios. Improvements are suggested and, additionally, a trust mechanism is introduced to identify the intent of a player in order to make the model a better fit for realistic modern problems. The concept of teaming of players is also considered in the proposed mode. A deep-learning model is developed and trained on data generated by video games to support the results of the proposed model. The proposed model is compared to previously published models in a brief comparison study. Contrary to the conventional stochastic duel game combat model, this new proposed model deals with pair-wise duels throughout the game duration. This model is explained in detail, and practical applications of it in the context of the real world are also discussed. The approach toward solving modern-day problems through the use of game theory is presented in this paper, and hence, this paper acts as a foundation for researchers looking forward to an innovation with game theory. Full article
(This article belongs to the Special Issue Fuzzy Systems and Neural Networks for Engineering Applications)
Show Figures

Figure 1

Figure 1
<p>Stochastic duel setup.</p>
Full article ">Figure 2
<p>Growth in shooter games revenue (in USD million) [<a href="#B9-sensors-22-02422" class="html-bibr">9</a>,<a href="#B10-sensors-22-02422" class="html-bibr">10</a>].</p>
Full article ">Figure 3
<p>Growth in daily active users of different shooter-type video games.</p>
Full article ">Figure 4
<p>A duel in Valorant.</p>
Full article ">Figure 5
<p>A duel in PUBG.</p>
Full article ">Figure 6
<p>Representation of storage of trust data.</p>
Full article ">Figure 7
<p>Flow of the trust evaluation module.</p>
Full article ">Figure 8
<p>Flow of the main simulation.</p>
Full article ">Figure 9
<p>A standard RNN with single layer (<b>A</b>) versus LSTM with four layers (<b>B</b>).</p>
Full article ">Figure 10
<p>Structure of data frame fed to LSTM model in the implementation.</p>
Full article ">Figure 11
<p>Duels occurring across the map throughout the game.</p>
Full article ">Figure 12
<p>Histograms for 73rd and 74th time step from the implementation.</p>
Full article ">Figure 13
<p>Observations from the histograms from the implementation.</p>
Full article ">Figure 14
<p>Scatter plot of the time series of 0.5 quantiles from the implementation.</p>
Full article ">Figure 15
<p>Variations in trust factors of players with time from the implementation.</p>
Full article ">Figure 16
<p>Success probabilities of top ~11% of players from a set of 91 players from a match of PUBG.</p>
Full article ">Figure 17
<p>Success probabilities of top ~11% of players from a set of 99 players from a match of PUBG.</p>
Full article ">Figure 18
<p>Success probabilities of top ~11% of players from a set of 82 players from a match of PUBG.</p>
Full article ">Figure 19
<p>Success probabilities of top ~11% of players from a set of 90 players from a match of PUBG.</p>
Full article ">Figure 20
<p>Maximum trust values of top ~20% of players achieved at the end of the match from the implementation.</p>
Full article ">
23 pages, 7105 KiB  
Article
Identification Method for Internal Forces of Segmental Tunnel Linings via the Combination of Laser Scanning and Hybrid Structural Analysis
by Yumeng Zhang, Jurij Karlovšek and Xian Liu
Sensors 2022, 22(6), 2421; https://doi.org/10.3390/s22062421 - 21 Mar 2022
Cited by 7 | Viewed by 2346
Abstract
This paper provides a new solution to identify the internal forces of segmental tunnel linings by combining laser scanning and hybrid structural analysis. First, a hybrid structural analysis method for quantifying the internal forces based on displacement monitoring is established, which requires comprehensive [...] Read more.
This paper provides a new solution to identify the internal forces of segmental tunnel linings by combining laser scanning and hybrid structural analysis. First, a hybrid structural analysis method for quantifying the internal forces based on displacement monitoring is established, which requires comprehensive displacement monitoring with high precision and a complete trace history. Motivated by the development of laser scanning, two remedial solutions are proposed for typically insufficient engineering conditions, i.e., lack of displacement developing process and poor accuracy of measurements, which is highlighted in this paper. Therefore, with the help of remedial solutions, the structural analysis is able to be adopted with the application of laser scanning. The tool for developing remedial solutions is the first-order theory of slender circular arches. Virtual tests, based on a calibrated finite element model, were performed to verify the feasibility of the presented hybrid analysis and remedial solutions. In addition, parametric analyses were conducted to study the error propagation from laser scanning to the results of hybrid analysis. The resolution and measurement noise of laser scanning were investigated and discussed. On this basis, advice on combining laser scanning and hybrid structural analysis is proposed. Finally, on-site application of the hybrid analysis on an actual tunnel is presented and discussed. Full article
Show Figures

Figure 1

Figure 1
<p>The direction of displacement.</p>
Full article ">Figure 2
<p>The schematic diagram of initial position and current position of segment.</p>
Full article ">Figure 3
<p>The exemplary assembly and load distribution of the segmental tunnel ring.</p>
Full article ">Figure 4
<p>The position of virtual measurement points.</p>
Full article ">Figure 5
<p>The radial displacement (<b>a</b>), tangential displacement (<b>b</b>), bending moment (<b>c</b>), and axial force (<b>d</b>) of virtual test and Group 1.</p>
Full article ">Figure 6
<p>The radial displacement (<b>a</b>), tangential displacement (<b>b</b>), bending moment (<b>c</b>), and axial force (<b>d</b>) of virtual test and Group 2.</p>
Full article ">Figure 7
<p>The radial displacement (<b>a</b>), tangential displacement (<b>b</b>), bending moment (<b>c</b>), and axial force (<b>d</b>) obtained by the hybrid analysis and remedial solution I at the condition that the measurement precision is 0.1 mm.</p>
Full article ">Figure 8
<p>The <math display="inline"><semantics> <mrow> <mi>N</mi> <mi>R</mi> <mi>M</mi> <mi>S</mi> <mi>E</mi> </mrow> </semantics></math> of hybrid analysis for various relative distance resolutions (<b>a</b>) and various angular resolutions (<b>b</b>).</p>
Full article ">Figure 9
<p>The <math display="inline"><semantics> <mrow> <mi>N</mi> <mi>R</mi> <mi>M</mi> <mi>S</mi> <mi>E</mi> </mrow> </semantics></math> of hybrid analysis for various relative distance noise (<b>a</b>) and various angular noise (<b>b</b>).</p>
Full article ">Figure 10
<p>(<b>a</b>) The layout of segment B2 and (<b>b</b>) the sectional view of cross-section 1-1 (unit: mm).</p>
Full article ">Figure 11
<p>(<b>a</b>) The layout of the metro tunnel and (<b>b</b>) the corresponding laser scanning results.</p>
Full article ">Figure 12
<p>The identification of longitudinal joints.</p>
Full article ">Figure 13
<p>Remaining measurement points after removing equipment profile.</p>
Full article ">Figure 14
<p>The results of bending moment (<b>a</b>) and axial force (<b>b</b>) of hybrid solution on a real segmental lining ring.</p>
Full article ">Figure 15
<p>Possible initial irregularity of (<b>a</b>) segment B2, L1, and (<b>b</b>) segment L2.</p>
Full article ">Figure A1
<p>The nomenclature of Equation (A1).</p>
Full article ">
21 pages, 3677 KiB  
Article
Underwater Sound Source Localization Based on Passive Time-Reversal Mirror and Ray Theory
by Kuan-Wen Liu, Ching-Jer Huang, Gee-Pinn Too, Zong-You Shen and Yung-Da Sun
Sensors 2022, 22(6), 2420; https://doi.org/10.3390/s22062420 - 21 Mar 2022
Cited by 4 | Viewed by 3565
Abstract
This study investigates the performance of a passive time-reversal mirror (TRM) combined with acoustic ray theory in localizing underwater sound sources with high frequencies (3–7 kHz). The TRM was installed on a floating buoy and comprised four hydrophones. The ray-tracing code BELLHOP was [...] Read more.
This study investigates the performance of a passive time-reversal mirror (TRM) combined with acoustic ray theory in localizing underwater sound sources with high frequencies (3–7 kHz). The TRM was installed on a floating buoy and comprised four hydrophones. The ray-tracing code BELLHOP was used to determine the transfer function between a sound source and a field point. The transfer function in the frequency domain obtained from BELLHOP was transformed into the time domain. The pressure field was then obtained by taking the convolution of the transfer function in the time domain with the time-reversed signals that were received by the hydrophones in the TRM. The location with the maximum pressure value was designated as the location of the source. The performance of the proposed methodology for source localization was tested in a towing tank and in the ocean. The aforementioned tests revealed that even when the distances between a source and the TRM were up to 1600 m, the distance deviations between estimated and actual source locations were mostly less than 2 m. Errors originated mainly from inaccurate depth estimation, and the literature indicates that they can be reduced by increasing the number of TRM elements and their apertures. Full article
(This article belongs to the Section Physical Sensors)
Show Figures

Figure 1

Figure 1
<p>A time-reversal mirror (TRM) in the time domain. (<b>a</b>) Sound source signal <span class="html-italic">s</span>(<span class="html-italic">t</span>), (<b>b</b>) received sound signal <span class="html-italic">r</span>(<span class="html-italic">t</span>), (<b>c</b>) time-reversed signal of <span class="html-italic">r</span>(<span class="html-italic">t</span>), and (<b>d</b>) signal received at the location of the probe source.</p>
Full article ">Figure 2
<p>Layout of laboratory tests in the towing tank. The interval between two adjacent hydrophones is 0.5 m, the interval between the topmost hydrophone and the water surface is 1 m, and the interval between the bottommost hydrophone and the tank bottom is 1 m.</p>
Full article ">Figure 3
<p>Typical time series of signals received by the second hydrophone (<math display="inline"><semantics> <mrow> <msub> <mi>h</mi> <mn>2</mn> </msub> <mo>=</mo> <mn>1.5</mn> <mo> </mo> <mrow> <mo> </mo> <mi mathvariant="normal">m</mi> </mrow> </mrow> </semantics></math>) in the TRM, which is 80 m from the sound source of 3 kHz.</p>
Full article ">Figure 4
<p>Typical time series of signals received by all hydrophones in the TRM, which is 80 m from the sound source.</p>
Full article ">Figure 5
<p>Sound pressure at the retrofocused location in the domain near the sound source, which locates at <math display="inline"><semantics> <mrow> <msub> <mi>r</mi> <mi>o</mi> </msub> <mo>=</mo> <mn>80</mn> <mrow> <mo> </mo> <mi mathvariant="normal">m</mi> </mrow> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <msub> <mi>z</mi> <mi>o</mi> </msub> <mo>=</mo> <mn>2.75</mn> <mrow> <mo> </mo> <mi mathvariant="normal">m</mi> </mrow> </mrow> </semantics></math>. The result indicates that the estimated source location was <math display="inline"><semantics> <mrow> <msub> <mi>r</mi> <mrow> <mi>o</mi> <mi>e</mi> </mrow> </msub> <mo>=</mo> <mn>80.89</mn> <mrow> <mo> </mo> <mi mathvariant="normal">m</mi> </mrow> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <msub> <mi>z</mi> <mrow> <mi>o</mi> <mi>e</mi> </mrow> </msub> <mo>=</mo> <mn>2.54</mn> <mrow> <mo> </mo> <mi mathvariant="normal">m</mi> </mrow> </mrow> </semantics></math>.</p>
Full article ">Figure 6
<p>Sound velocity profile at the test location in the offshore region off Small Liuqiu Island.</p>
Full article ">Figure 7
<p>Parameters and geometry of the TRM experiments conducted in the offshore region off Small Liuqiu Island.</p>
Full article ">Figure 8
<p>Time series of signals received by the third hydrophone in the TRM, which was 550 m from the sound source with a frequency of 3 kHz.</p>
Full article ">Figure 9
<p>Time series of sound signals within <math display="inline"><semantics> <mrow> <mn>2</mn> <mo>×</mo> <msup> <mrow> <mn>10</mn> </mrow> <mrow> <mo>−</mo> <mn>3</mn> </mrow> </msup> <mo> </mo> <mi mathvariant="normal">s</mi> </mrow> </semantics></math> that were received by the third hydrophone in the TRM, which was 550 m from the sound source with a frequency of 3 kHz.</p>
Full article ">Figure 10
<p>Sound pressure at the retrofocused location in the domain near the sound source, which locates at <math display="inline"><semantics> <mrow> <msub> <mi>r</mi> <mi>o</mi> </msub> <mo>=</mo> <mn>550</mn> <mrow> <mo> </mo> <mi mathvariant="normal">m</mi> </mrow> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <msub> <mi>z</mi> <mi>o</mi> </msub> <mo>=</mo> <mn>2.5</mn> <mo> </mo> <mi mathvariant="normal">m</mi> </mrow> </semantics></math>. The result indicates that the estimated source location was <math display="inline"><semantics> <mrow> <msub> <mi>r</mi> <mrow> <mi>o</mi> <mi>e</mi> </mrow> </msub> <mo>=</mo> <mn>548.6</mn> <mo> </mo> <mi mathvariant="normal">m</mi> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <msub> <mi>z</mi> <mrow> <mi>o</mi> <mi>e</mi> </mrow> </msub> <mo>=</mo> <mn>2.45</mn> <mo> </mo> <mi mathvariant="normal">m</mi> </mrow> </semantics></math>.</p>
Full article ">Figure 11
<p>Time series of signals received by the third hydrophone in the TRM, which was 1.6 km from the sound source with a frequency of 3 kHz.</p>
Full article ">Figure 12
<p>Sound pressure at the retrofocused location in the domain near the sound source, which locates at <math display="inline"><semantics> <mrow> <msub> <mi>r</mi> <mi>o</mi> </msub> <mo>=</mo> <mn>1600</mn> <mo> </mo> <mi mathvariant="normal">m</mi> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <msub> <mi>z</mi> <mi>o</mi> </msub> <mo>=</mo> <mn>2.5</mn> <mo> </mo> <mi mathvariant="normal">m</mi> </mrow> </semantics></math>. The result indicates that the estimated source location was <math display="inline"><semantics> <mrow> <msub> <mi>r</mi> <mrow> <mi>o</mi> <mi>e</mi> </mrow> </msub> <mo>=</mo> <mn>1601.9</mn> <mo> </mo> <mi mathvariant="normal">m</mi> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <msub> <mi>z</mi> <mrow> <mi>o</mi> <mi>e</mi> </mrow> </msub> <mo>=</mo> <mn>2.60</mn> <mo> </mo> <mi mathvariant="normal">m</mi> </mrow> </semantics></math>.</p>
Full article ">
18 pages, 2906 KiB  
Article
Motion Shield: An Automatic Notifications System for Vehicular Communications
by Petros Balios, Philotas Kyriakidis, Stelios Zimeras, Petros S. Bithas and Lambros Sarakis
Sensors 2022, 22(6), 2419; https://doi.org/10.3390/s22062419 - 21 Mar 2022
Cited by 1 | Viewed by 2445
Abstract
Motion Shield is an automatic crash notification system that uses a mobile phone to generate automatic alerts related to the safety of a user when the user is boarding a means of transportation. The objective of Motion Shield is to improve road safety [...] Read more.
Motion Shield is an automatic crash notification system that uses a mobile phone to generate automatic alerts related to the safety of a user when the user is boarding a means of transportation. The objective of Motion Shield is to improve road safety by considering a moving vehicle’s risk, estimating the probability of an emergency, and assessing the likelihood of an accident. The system, using multiple sources of external information, the mobile phone sensors’ readings, geolocated information, weather data, and historical evidence of traffic accidents, processes a plethora of parameters in order to predict the onset of an accident and act preventively. All the collected data are forwarded into a decision support system which dynamically calculates the mobility risk and driving behavior aspects in order to proactively send personalized notifications and alerts to the user and a public safety answering point (PSAP) (112). Full article
(This article belongs to the Special Issue Feature Papers in the Internet of Things Section 2022)
Show Figures

Figure 1

Figure 1
<p>Existing systems vs. Motion Shield—a comparative study.</p>
Full article ">Figure 2
<p>Description of the structure of the proposed system. It consists of three functioning levels: the application, the cloud, and the control level, with subsystems operating at their corresponding level.</p>
Full article ">Figure 3
<p>Description of how the mobile app operates in the application level.</p>
Full article ">Figure 4
<p>Description of what happens when the system detects an emergency (emergency signals management introduced in <a href="#sensors-22-02419-f003" class="html-fig">Figure 3</a>).</p>
Full article ">Figure 5
<p>Description of the crash management process introduced in <a href="#sensors-22-02419-f004" class="html-fig">Figure 4</a>.</p>
Full article ">Figure 6
<p>Decision process methodology.</p>
Full article ">Figure 7
<p>System simulation.</p>
Full article ">Figure 8
<p>Motion Shield dashboard.</p>
Full article ">Figure 9
<p>Description of what happens when the system loses contact with MD.</p>
Full article ">
18 pages, 1482 KiB  
Article
Microservice Security Framework for IoT by Mimic Defense Mechanism
by Fei Ying, Shengjie Zhao and Hao Deng
Sensors 2022, 22(6), 2418; https://doi.org/10.3390/s22062418 - 21 Mar 2022
Cited by 5 | Viewed by 3154
Abstract
Containers and microservices have become the most popular method for hosting IoT applications in cloud servers. However, one major security issue of this method is that if a container image contains software with security vulnerabilities, the associated microservices also become vulnerable at run-time. [...] Read more.
Containers and microservices have become the most popular method for hosting IoT applications in cloud servers. However, one major security issue of this method is that if a container image contains software with security vulnerabilities, the associated microservices also become vulnerable at run-time. Existing works attempted to reduce this risk with vulnerability-scanning tools. They, however, demand an up-to-date database and may not work with unpublished vulnerabilities. In this paper, we propose a novel system to strengthen container security from unknown attack using the mimic defense framework. Specifically, we constructed a resource pool with variant images and observe the inconsistency in execution results, from which we can identify potential vulnerabilities. To avoid continuous attack, we created a graph-based scheduling strategy to maximize the randomness and heterogeneity of the images used to replace the current images. We implemented a prototype using Kubernetes. Experimental results show that our framework makes hackers have to send 54.9% more random requests to complete the attack and increases the defence success rate by around 8.16% over the baseline framework to avoid the continuous unknown attacks. Full article
Show Figures

Figure 1

Figure 1
<p>The dynamic heterogeneous redundancy architecture.</p>
Full article ">Figure 2
<p>MDSF overall architecture.</p>
Full article ">Figure 3
<p>The diagram of the MDSF working process.</p>
Full article ">Figure 4
<p>The illustration of mimic transformation graph components.</p>
Full article ">Figure 5
<p>The systematic implementation of MDSF. The icons in blue are Kubernetes native components, and modules in red boxes are the developed plug-ins.</p>
Full article ">Figure 6
<p>The process of hackers trying to attack the IoT microservice by sending requests.</p>
Full article ">Figure 7
<p>The average number of attacks required under the random attack scenario.</p>
Full article ">Figure 8
<p>Defence success rate under the continuous attack scenario.</p>
Full article ">Figure 9
<p>Microservice response time under different CPU usage.</p>
Full article ">
20 pages, 2913 KiB  
Article
Analog-Domain Suppression of Strong Interference Using Hybrid Antenna Array
by Kai Wu, J. Andrew Zhang, Xiaojing Huang, Y. Jay Guo, Diep N. Nguyen, Asanka Kekirigoda and Kin-Ping Hui
Sensors 2022, 22(6), 2417; https://doi.org/10.3390/s22062417 - 21 Mar 2022
Cited by 4 | Viewed by 2355
Abstract
The proliferation of wireless applications, the ever-increasing spectrum crowdedness, as well as cell densification makes the issue of interference increasingly severe in many emerging wireless applications. Most interference management/mitigation methods in the literature are problem-specific and require some cooperation/coordination between different radio frequency [...] Read more.
The proliferation of wireless applications, the ever-increasing spectrum crowdedness, as well as cell densification makes the issue of interference increasingly severe in many emerging wireless applications. Most interference management/mitigation methods in the literature are problem-specific and require some cooperation/coordination between different radio frequency systems. Aiming to seek a more versatile solution to counteracting strong interference, we resort to the hybrid array of analog subarrays and suppress interference in the analog domain so as to greatly reduce the required quantization bits of the analog-to-digital converters and their power consumption. To this end, we design a real-time algorithm to steer nulls towards the interference directions and maintain flat in non-interference directions, solely using constant-modulus phase shifters. To ensure sufficient null depth for interference suppression, we also develop a two-stage method for accurately estimating interference directions. The proposed solution can be applicable to most (if not all) wireless systems as neither training/reference signal nor cooperation/coordination is required. Extensive simulations show that more than 65 dB of suppression can be achieved for 3 spatially resolvable interference signals yet with random directions. Full article
(This article belongs to the Special Issue Communications and Sensing Technologies for the Future)
Show Figures

Figure 1

Figure 1
<p>Illustration of the proposed scheme for suppressing strong interference signals based on a uniform linear array with the antenna spacing denoted by <span class="html-italic">d</span>. The array is divided into <span class="html-italic">M</span> subarrays, each having <span class="html-italic">N</span> antennas.</p>
Full article ">Figure 2
<p><span class="html-italic">Left</span>: The value of the objective function given in (<a href="#FD8-sensors-22-02417" class="html-disp-formula">8</a>) under the iterative solution given in (<a href="#FD14-sensors-22-02417" class="html-disp-formula">14</a>), where <math display="inline"><semantics> <mrow> <mi>N</mi> <mo>=</mo> <mn>16</mn> </mrow> </semantics></math>, <math display="inline"><semantics> <mrow> <msub> <mi>δ</mi> <mi>θ</mi> </msub> <mo>=</mo> <msup> <mn>0.1</mn> <mo>∘</mo> </msup> </mrow> </semantics></math>, <math display="inline"><semantics> <mrow> <msub> <mi mathvariant="sans-serif">Θ</mi> <mi mathvariant="normal">j</mi> </msub> <mo>=</mo> <mrow> <mo>{</mo> <msup> <mn>30.5</mn> <mo>∘</mo> </msup> <mo>,</mo> <msup> <mn>60.9</mn> <mo>∘</mo> </msup> <mo>,</mo> <mo>−</mo> <msup> <mn>50.3</mn> <mo>∘</mo> </msup> <mo>}</mo> </mrow> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <mi>I</mi> <mo>=</mo> <mn>800</mn> </mrow> </semantics></math> is the total number of iterations. <span class="html-italic">Right</span>: Features of the obtained beam in the spatial passband. Three trials are performed with <math display="inline"><semantics> <msub> <mi mathvariant="bold">w</mi> <mn>0</mn> </msub> </semantics></math> randomly and independently generated for each trial.</p>
Full article ">Figure 3
<p>Illustrating the beams steered by the beamformers obtained in <a href="#sensors-22-02417-f002" class="html-fig">Figure 2</a>.</p>
Full article ">Figure 4
<p>The impact of the initialization on the convergence performance, where the left axis observes the beam flatness and the right one observes the converging value of the objective function in (<a href="#FD8-sensors-22-02417" class="html-disp-formula">8</a>).</p>
Full article ">Figure 5
<p>The amplitude response of the beams steered by the analog subarray, where subfigures (<b>a</b>–<b>c</b>) are obtained using <math display="inline"><semantics> <msubsup> <mi mathvariant="bold">w</mi> <mn mathvariant="bold">0</mn> <mo>*</mo> </msubsup> </semantics></math> given in (<a href="#FD25-sensors-22-02417" class="html-disp-formula">25</a>), and subfigures (<b>d</b>–<b>f</b>) correspond to <math display="inline"><semantics> <msub> <mi mathvariant="bold">w</mi> <mi mathvariant="normal">r</mi> </msub> </semantics></math> with randomly generated phases. The left, middle, and right columns are for <math display="inline"><semantics> <mrow> <mi>N</mi> <mo>=</mo> <mn>8</mn> </mrow> </semantics></math>, 16, and 24, respectively.</p>
Full article ">Figure 6
<p>MSE of the AoA estimates versus INR (=<math display="inline"><semantics> <mrow> <msubsup> <mi>σ</mi> <mrow> <mi mathvariant="normal">i</mi> </mrow> <mn>2</mn> </msubsup> <mo>/</mo> <msubsup> <mi>σ</mi> <mrow> <mi mathvariant="normal">n</mi> </mrow> <mn>2</mn> </msubsup> <mo>)</mo> </mrow> </semantics></math>, where <math display="inline"><semantics> <mrow> <mi>P</mi> <mo>=</mo> <mn>1</mn> </mrow> </semantics></math>. The curves with circle, square, and triangle markers are for <math display="inline"><semantics> <mrow> <mi>N</mi> <mo>=</mo> <mn>8</mn> </mrow> </semantics></math>, 16, and 24, respectively.</p>
Full article ">Figure 7
<p>CDF of interference power after subarray beamforming, where <math display="inline"><semantics> <mrow> <mi>N</mi> <mo>=</mo> <mn>16</mn> </mrow> </semantics></math>. The curves with circle, square, and triangle markers are for <math display="inline"><semantics> <mrow> <msubsup> <mi>σ</mi> <mrow> <mi mathvariant="normal">i</mi> </mrow> <mn>2</mn> </msubsup> <mo>=</mo> <mo>−</mo> <mn>10</mn> </mrow> </semantics></math> dB, <math display="inline"><semantics> <mrow> <mo>−</mo> <mn>4</mn> </mrow> </semantics></math> dB, and 8 dB, respectively.</p>
Full article ">Figure 8
<p>(<b>Upper</b>) CDF of the sum of the absolute AoA estimation errors of multiple signals, where <math display="inline"><semantics> <mrow> <mi>N</mi> <mo>=</mo> <mn>16</mn> </mrow> </semantics></math>, <math display="inline"><semantics> <mrow> <mi>P</mi> <mo>=</mo> <mn>3</mn> </mrow> </semantics></math>, <math display="inline"><semantics> <mrow> <mi>K</mi> <mo>=</mo> <mn>50</mn> </mrow> </semantics></math>, and <math display="inline"><semantics> <mrow> <msubsup> <mi>σ</mi> <mrow> <mi mathvariant="normal">i</mi> </mrow> <mn>2</mn> </msubsup> <mo>=</mo> <mn>0</mn> </mrow> </semantics></math> dB; (<b>lower</b>) illustrating the jamming suppression ability achieved using different sets of AoA estimates, where square, plus, and triangular markers denote H-ESPRIT, the first stage of the proposed method, and the second stage, respectively.</p>
Full article ">Figure 9
<p>Illustration of the amplitude responses of AINB beams designed by Algorithm 1, where <math display="inline"><semantics> <mrow> <mi>N</mi> <mo>=</mo> <mn>16</mn> </mrow> </semantics></math>, <math display="inline"><semantics> <mrow> <mi>P</mi> <mo>=</mo> <mn>3</mn> </mrow> </semantics></math>, <math display="inline"><semantics> <mrow> <mi>K</mi> <mo>=</mo> <mn>50</mn> </mrow> </semantics></math>, <math display="inline"><semantics> <mrow> <msubsup> <mi>σ</mi> <mrow> <mi mathvariant="normal">i</mi> </mrow> <mn>2</mn> </msubsup> <mo>=</mo> <mn>0</mn> </mrow> </semantics></math>, and the angles set in <a href="#sensors-22-02417-f002" class="html-fig">Figure 2</a> are used. The upper figure plots the AoA estimation errors over <math display="inline"><semantics> <msup> <mn>10</mn> <mn>3</mn> </msup> </semantics></math> independent trials, where plus, triangle, and square markers are for <math display="inline"><semantics> <mrow> <msup> <mn>30.5</mn> <mo>∘</mo> </msup> </mrow> </semantics></math>, <math display="inline"><semantics> <mrow> <msup> <mn>60.9</mn> <mo>∘</mo> </msup> </mrow> </semantics></math>, and <math display="inline"><semantics> <mrow> <mo>−</mo> <msup> <mn>50.3</mn> <mo>∘</mo> </msup> </mrow> </semantics></math>, respectively. Note that the second inset from the left in the lower sub-figure is the copy of <a href="#sensors-22-02417-f009" class="html-fig">Figure 9</a> with the <span class="html-italic">y</span>-axis limited to <math display="inline"><semantics> <mrow> <mo>[</mo> <mo>−</mo> <mn>40</mn> <mo>,</mo> <mtext> </mtext> <mn>0</mn> <mo>]</mo> </mrow> </semantics></math> dB. It is provided to highlight the spatial amplitude response in the region of non-interference directions.</p>
Full article ">Figure 10
<p>Convergence curves of performing Algorithm 1, where <math display="inline"><semantics> <mrow> <mi>N</mi> <mo>=</mo> <mn>16</mn> </mrow> </semantics></math>, <math display="inline"><semantics> <mrow> <msubsup> <mi>σ</mi> <mrow> <mi mathvariant="normal">i</mi> </mrow> <mn>2</mn> </msubsup> <mo>=</mo> <mn>0</mn> </mrow> </semantics></math> dB, and sub-figures (<b>a</b>,<b>b</b>) are for the AINB designs in <a href="#sensors-22-02417-f007" class="html-fig">Figure 7</a> and <a href="#sensors-22-02417-f009" class="html-fig">Figure 9</a>, respectively. Among all the independent trials performed for the figures, 10 trials are randomly selected with their convergence curves presented here.</p>
Full article ">Figure 11
<p>Illustrating the impact of the quantization bit of phase shifters in subarrays on interference suppression.</p>
Full article ">
48 pages, 3881 KiB  
Review
Towards Synoptic Water Monitoring Systems: A Review of AI Methods for Automating Water Body Detection and Water Quality Monitoring Using Remote Sensing
by Liping Yang, Joshua Driscol, Sarigai Sarigai, Qiusheng Wu, Christopher D. Lippitt and Melinda Morgan
Sensors 2022, 22(6), 2416; https://doi.org/10.3390/s22062416 - 21 Mar 2022
Cited by 32 | Viewed by 8558
Abstract
Water features (e.g., water quantity and water quality) are one of the most important environmental factors essential to improving climate-change resilience. Remote sensing (RS) technologies empowered by artificial intelligence (AI) have become one of the most demanded strategies to automating water information extraction [...] Read more.
Water features (e.g., water quantity and water quality) are one of the most important environmental factors essential to improving climate-change resilience. Remote sensing (RS) technologies empowered by artificial intelligence (AI) have become one of the most demanded strategies to automating water information extraction and thus intelligent monitoring. In this article, we provide a systematic review of the literature that incorporates artificial intelligence and computer vision methods in the water resources sector with a focus on intelligent water body extraction and water quality detection and monitoring through remote sensing. Based on this review, the main challenges of leveraging AI and RS for intelligent water information extraction are discussed, and research priorities are identified. An interactive web application designed to allow readers to intuitively and dynamically review the relevant literature was also developed. Full article
Show Figures

Figure 1

Figure 1
<p>Geospatial distribution and simple statistics of the reviewed papers. Note that a freely accessible interactive version of the charts can be accessed via our web app tool (the web app tool URL and its brief demo video are provided in <a href="#app1-sensors-22-02416" class="html-app">Appendix A</a>). We can easily see that the major countries are China and the United States and that the number of published papers by year (2011 to 2021) has dramatically increased since 2018 and 2019. (<b>a</b>) Spatial distribution of reviewed papers based on the first author’s institution location. (<b>b</b>) Topic distribution (water body, water quality, both). (<b>c</b>) Country distribution. (<b>d</b>) Number of published papers by year from 2011 to 2021 on the relevant topics.</p>
Full article ">Figure 1 Cont.
<p>Geospatial distribution and simple statistics of the reviewed papers. Note that a freely accessible interactive version of the charts can be accessed via our web app tool (the web app tool URL and its brief demo video are provided in <a href="#app1-sensors-22-02416" class="html-app">Appendix A</a>). We can easily see that the major countries are China and the United States and that the number of published papers by year (2011 to 2021) has dramatically increased since 2018 and 2019. (<b>a</b>) Spatial distribution of reviewed papers based on the first author’s institution location. (<b>b</b>) Topic distribution (water body, water quality, both). (<b>c</b>) Country distribution. (<b>d</b>) Number of published papers by year from 2011 to 2021 on the relevant topics.</p>
Full article ">Figure 2
<p>Word cloud visualization of all the reviewed papers (<b>top</b>), water body papers (<b>bottom left</b>), and water quality papers (<b>bottom right</b>). Note that the word clouds are generated from paper titles, abstracts, and keywords. The word clouds provide an informative (general and specific) focus of each set of the papers. For example, both water body and water quality papers share the focus on RS, DL, and neural networks (NN). We can also see that water body extraction tasks tend to focus on the use of convolutional neural networks (CNN), whereas for water quality modeling the use of long short-term memory (LSTM) networks is more prevalent. We can also see that there are specific, unique keywords for water quality, such as “turbidity”, “chl”, and “algal bloom”.</p>
Full article ">Figure A1
<p>Our highly interactive web app (accessible publicly at: <a href="https://geoair-lab.github.io/WaterFeatureAI-WebApp/index.html" target="_blank">https://geoair-lab.github.io/WaterFeatureAI-WebApp/index.html</a>, accessed on 5 December 2021) provides the track of scholars and publications with just a few clicks. See an example on the pop-up. Our readers can access (1) a direct link to the PDF file of the paper (note that if there is no free, publicly available version of the paper, we link directly to the journal page of the paper so our readers can obtain the paper if their institution purchases the journal database), (2) the scholar profile (Google Scholar/ResearchGate URL) of the first author, and (3) “Cited by” Google Scholar page. (<b>a</b>) Water body and quality AI literature map pop-up. (<b>b</b>) “Cited by” Google Scholar page corresponding to the paper shown in (<b>a</b>).</p>
Full article ">Figure A1 Cont.
<p>Our highly interactive web app (accessible publicly at: <a href="https://geoair-lab.github.io/WaterFeatureAI-WebApp/index.html" target="_blank">https://geoair-lab.github.io/WaterFeatureAI-WebApp/index.html</a>, accessed on 5 December 2021) provides the track of scholars and publications with just a few clicks. See an example on the pop-up. Our readers can access (1) a direct link to the PDF file of the paper (note that if there is no free, publicly available version of the paper, we link directly to the journal page of the paper so our readers can obtain the paper if their institution purchases the journal database), (2) the scholar profile (Google Scholar/ResearchGate URL) of the first author, and (3) “Cited by” Google Scholar page. (<b>a</b>) Water body and quality AI literature map pop-up. (<b>b</b>) “Cited by” Google Scholar page corresponding to the paper shown in (<b>a</b>).</p>
Full article ">Figure A2
<p>Example confusion matrix. The classified data indicate the ML/DL model predicted results and the reference data refer to the actual manually annotated data (image source: [<a href="#B161-sensors-22-02416" class="html-bibr">161</a>]).</p>
Full article ">
14 pages, 5647 KiB  
Article
One4all—A New SCADA Approach
by Bogdan Vaduva, Ionut-Flaviu Pop and Honoriu Valean
Sensors 2022, 22(6), 2415; https://doi.org/10.3390/s22062415 - 21 Mar 2022
Cited by 2 | Viewed by 2781
Abstract
The main purpose of this paper is to introduce a new concept, named “one4all” in the realm of SCADA (Supervisory Control and Data Acquisition) systems, used by a regional company (particularly a water supplying company) for managing the different views of its users. [...] Read more.
The main purpose of this paper is to introduce a new concept, named “one4all” in the realm of SCADA (Supervisory Control and Data Acquisition) systems, used by a regional company (particularly a water supplying company) for managing the different views of its users. As a secondary purpose, the paper presents an integration of such an SCADA system with a GIS (Geographical Information System) system. All the regional water supply companies in Romania manage water and wastewater networks, many sensors and actuators, dozens of water pump plants, several water treatment and wastewater plants, tanks and many hydrophores in different parts of their operating range. Due to the wide geographical operating range, an SCADA system needs to be put in place, but the management of such a system in a traditional way is hard to implement, especially when the human resource is low. The methodology presented in this paper, involving adding helper tables and dynamic template windows within an SCADA tool (“one4all” tool), will show how efficiently the human resource can be used. Additionally, the paper shows that companies as described above, can use a single SCADA system that generates different views for all the managed sub regions instead of different systems for every sub region. Implementing only one SCADA system built with the concept “one4all” in mind, and integrating it with a GIS system that is built on the same principle, represents a new approach that will bring value to any organization willing to adopt it. The concept of “one4all”, implemented as a software tool for an SCADA system, is a new concept that will help any developer to easily build applications that generate different views for different users based on their permissions and their operating range. Finally, the paper presents some examples of the same concept, implemented in a different vertical (GIS) and programming language, thus presenting that a “one4all” concept is viable and helpful, bringing value to the information technology industry. Full article
(This article belongs to the Section Remote Sensors)
Show Figures

Figure 1

Figure 1
<p>Schema of the “one4all” tool.</p>
Full article ">Figure 2
<p>Huba Control sensor type: (<b>a</b>) overview image of the used sensor ensemble; (<b>b</b>) detailed view of our sensor.</p>
Full article ">Figure 3
<p>Level sensors: (<b>a</b>) Siemens ultrasonic level sensor; (<b>b</b>) TL-136 liquid level transmitter.</p>
Full article ">Figure 4
<p>Default view for a user with Administrator role (green dots represents the status of the current operated locations/cities).</p>
Full article ">Figure 5
<p>Custom view for a user with Operator role. (green means that the value shown it’s within normal limits, red means otherwise).</p>
Full article ">Figure 6
<p>Default mobile view for both Administrator and Operator role.</p>
Full article ">Figure 7
<p>Comparison between invoiced and actual consumption. (The highlighted pipe network has the red color; the clients are the green dots).</p>
Full article ">Figure 8
<p>Dynamic template window for pumping stations.</p>
Full article ">Figure 9
<p>JavaScript/Angular 2+ “one4all” framework example—default view.</p>
Full article ">Figure 10
<p>JavaScript/Angular 2+ “one4all” framework example—edit view.</p>
Full article ">
32 pages, 7223 KiB  
Article
Sensing System for Plegic or Paretic Hands Self-Training Motivation
by Igor Zubrycki, Ewa Prączko-Pawlak and Ilona Dominik
Sensors 2022, 22(6), 2414; https://doi.org/10.3390/s22062414 - 21 Mar 2022
Viewed by 2591
Abstract
Patients after stroke with paretic or plegic hands require frequent exercises to promote neuroplasticity and to improve hand joint mobilization. Available devices for hand exercising are intended for persons with some level of hand control or provide continuous passive motion with limited patient [...] Read more.
Patients after stroke with paretic or plegic hands require frequent exercises to promote neuroplasticity and to improve hand joint mobilization. Available devices for hand exercising are intended for persons with some level of hand control or provide continuous passive motion with limited patient involvement. Patients can benefit from self-exercising where they use the other hand to exercise the plegic or paretic one. However, post-stroke neuropsychological complications, apathy, and cognitive impairments such as forgetfulness make regular self-exercising difficult. This paper describes Przypominajka v2—a system intended to support self-exercising, remind about it, and motivate patients. We propose a glove-based device with an on-device machine-learning-based exercise scoring, a tablet-based interface, and a web-based application for therapists. The feasibility of on-device inference and the accuracy of correct exercise classification was evaluated on four healthy participants. Whole system use was described in a case study with a patient with a paretic hand. The anomaly classification has an accuracy of 91.3% and f1 value of 91.6% but achieves poorer results for new users (78% and 81%). The case study showed that patients had a positive reaction to exercising with Przypominajka, but there were issues relating to sensor glove: ease of putting on and clarity of instructions. The paper presents a new way in which sensor systems can support the rehabilitation of after-stroke patients with an on-device machine-learning-based classification that can accurately score and contribute to patient motivation. Full article
Show Figures

Figure 1

Figure 1
<p>The prototype version of the device.</p>
Full article ">Figure 2
<p>User journeys: with the current self-training scheme and assisted training with Przypominajka device.</p>
Full article ">Figure 3
<p>Diagram showing the elements of the Przypominajka v2 system, their role, and communication path.</p>
Full article ">Figure 4
<p>Voltage divider circuit used in measuring the voltage on the flex sensor (<math display="inline"><semantics> <msub> <mi>V</mi> <mrow> <mi>a</mi> <mi>d</mi> <mi>c</mi> </mrow> </msub> </semantics></math>), represented as a variable resistor.</p>
Full article ">Figure 5
<p>Data series from the sensor glove when the user is exercising correctly. Roll, pitch angles and Sacc, Sflex are computed features. The bottom graph shows the anomaly classifications (anomaly classification scores) using the neural network (<math display="inline"><semantics> <msub> <mi>y</mi> <mrow> <mi>n</mi> <mi>n</mi> </mrow> </msub> </semantics></math>) and tree-based classifier (<math display="inline"><semantics> <msub> <mi>y</mi> <mrow> <mi>t</mi> <mi>r</mi> <mi>e</mi> <mi>e</mi> </mrow> </msub> </semantics></math>). Shown is the “wrist and fingers extension” exercise from the test set.</p>
Full article ">Figure 6
<p>Decision tree that is used on the device to categorize the session. “Gini” means the Gini criterion split quality [<a href="#B22-sensors-22-02414" class="html-bibr">22</a>].</p>
Full article ">Figure 7
<p>Convolutional neural network for classification of exercise data. During training, categorical cross-entropy loss function was used.</p>
Full article ">Figure 8
<p>List of screens displayed on the device.</p>
Full article ">Figure 9
<p>View of the prototype web application for therapists and family.</p>
Full article ">Figure 10
<p>Diagram of the relationship between the patient, device, application, and rehabilitation specialist.</p>
Full article ">Figure 11
<p>Flowchart of interaction between the patient and the device.</p>
Full article ">Figure 12
<p>Main motivational aspect of Przypominajka—during the exercise, correct training is awarded with stars.</p>
Full article ">Figure 13
<p>Results for exercise classification using convolutional neural networks. (<b>a</b>) Bar plots of exercise classification values for five-fold cross validation. <math display="inline"><semantics> <mrow> <msub> <mi>N</mi> <mi>s</mi> </msub> <mo>=</mo> <mn>42</mn> </mrow> </semantics></math>. (<b>b</b>) Bar plots of exercise classification values for leave-one-out cross validation. <math display="inline"><semantics> <mrow> <msub> <mi>N</mi> <mi>s</mi> </msub> <mo>=</mo> <mn>42</mn> </mrow> </semantics></math>. (<b>c</b>) Exercise classification results for five-fold cross validation (5FCV) and leave-one-out cross validation (LOOCV) for different length of time window <math display="inline"><semantics> <msub> <mi>N</mi> <mi>s</mi> </msub> </semantics></math> and using all features (normal).</p>
Full article ">Figure 14
<p>Confusion matrices for classification task (normalized by category cardinality). (<b>a</b>) Confusion matrix from five-fold cross validation. (<b>b</b>) Confusion matrix from leave-one-subject-out cross validation.</p>
Full article ">Figure 15
<p>Results for anomaly classification: cnn—convolutional-neural-network-based anomaly classification; dt—decision-tree-based anomaly classification. Numbers below represent the time window length, <math display="inline"><semantics> <msub> <mi>N</mi> <mi>s</mi> </msub> </semantics></math>. (<b>a</b>) Five-fold cross validation results. (<b>b</b>) Leave-one-out validation results.</p>
Full article ">Figure 16
<p>Results for anomaly classification using convolutional neural network. Best case: <math display="inline"><semantics> <mrow> <msub> <mi>N</mi> <mi>s</mi> </msub> <mo>=</mo> <mn>42</mn> </mrow> </semantics></math>. (<b>a</b>) Bar plots of anomaly classification values for five-fold cross validation. (<b>b</b>) Bar plots of anomaly classification values for leave-one-out cross validation.</p>
Full article ">Figure 17
<p>Photographs from a trial session with a Przypominajka user. (<b>a</b>) Patient training with Przypominajka v2. (<b>b</b>) Patient putting on the Przypominajka v2.</p>
Full article ">Figure A1
<p>Convolutional neural network for classification of anomalies. During learning, a binary cross entropy (log loss) loss function was used.</p>
Full article ">Figure A2
<p>Results for learning on a single user’s data and classifying the same user’s data. (<b>a</b>) Bar plots for anomaly classification for a single user, length is <math display="inline"><semantics> <mrow> <msub> <mi>N</mi> <mi>s</mi> </msub> <mo>=</mo> <mn>42</mn> <mo>.</mo> </mrow> </semantics></math> (<b>b</b>) Bar plots for exercise classification for a single user, length is <math display="inline"><semantics> <mrow> <msub> <mi>N</mi> <mi>s</mi> </msub> <mo>=</mo> <mn>4.2</mn> </mrow> </semantics></math>.</p>
Full article ">
14 pages, 13886 KiB  
Article
Development of an Integrated Virtual Reality System with Wearable Sensors for Ergonomic Evaluation of Human–Robot Cooperative Workplaces
by Teodorico Caporaso, Stanislao Grazioso and Giuseppe Di Gironimo
Sensors 2022, 22(6), 2413; https://doi.org/10.3390/s22062413 - 21 Mar 2022
Cited by 15 | Viewed by 3786
Abstract
This work proposes a novel virtual reality system which makes use of wearable sensors for testing and validation of cooperative workplaces from the ergonomic point of view. The main objective is to show, in real time, the ergonomic evaluation based on a muscular [...] Read more.
This work proposes a novel virtual reality system which makes use of wearable sensors for testing and validation of cooperative workplaces from the ergonomic point of view. The main objective is to show, in real time, the ergonomic evaluation based on a muscular activity analysis within the immersive virtual environment. The system comprises the following key elements: a robotic simulator for modeling the robot and the working environment; virtual reality devices for human immersion and interaction within the simulated environment; five surface electromyographic sensors; and one uniaxial accelerometer for measuring the human ergonomic status. The methodology comprises the following steps: firstly, the virtual environment is constructed with an associated immersive tutorial for the worker; secondly, an ergonomic toolbox is developed for muscular analysis. This analysis involves multiple ergonomic outputs: root mean square for each muscle, a global electromyographic score, and a synthetic index. They are all visualized in the immersive environment during the execution of the task. To test this methodology, experimental trials are conducted on a real use case in a human–robot cooperative workplace typical of the automotive industry. The results showed that the methodology can effectively be applied in the analysis of human–robot interaction, to endow the workers with self–awareness with respect to their physical conditions. Full article
(This article belongs to the Special Issue Advances in Design and Integration of Wearable Sensors for Ergonomics)
Show Figures

Figure 1

Figure 1
<p>A schematic representation of the system architecture. On the left, an image of a real scenario: the user wears the wearable sensors (i.e., sEMG and accelerometer) and VR devices (i.e., headset and controllers). On the bottom–right, the block of “Virtual Simulation”, composed of a photosequence of the DHM tutorial (<b>top</b>) and an image of the virtual environment (<b>bottom</b>). On the top-right, the block of the “Ergonomic Assessment” with the input data: the virtual simulation and the “Preliminary MVC”. In the block on the top, there is an image in virtual simulation with the “EMG Real Time Processing” and on the bottom is an image of the “Final Ergonomic Assessment”.</p>
Full article ">Figure 2
<p>A flowchart showing all the steps implemented in the ergonomic analysis.</p>
Full article ">Figure 3
<p>(<b>Left</b>) Example of image shown during the real-time acquisition; (<b>Center</b>) example of image shown during the final ergonomic assessment related to a generic phase; (<b>Right</b>) example of image related to the assessment of the whole task.</p>
Full article ">Figure 4
<p>Vertical acceleration of the CoM as function of the time. In red circles, the notable points correspond to the different events. Notice that, different to definitions in the section, we have used the following nomenclature: 1 = <math display="inline"><semantics> <mrow> <mi>B</mi> <mi>R</mi> <mi>G</mi> </mrow> </semantics></math>; 2 = <math display="inline"><semantics> <mrow> <mi>A</mi> <mi>B</mi> <mi>G</mi> </mrow> </semantics></math>; 3 = <math display="inline"><semantics> <mrow> <mi>T</mi> <mi>B</mi> <mi>W</mi> </mrow> </semantics></math>; 4 = <math display="inline"><semantics> <mrow> <mi>B</mi> <mi>R</mi> </mrow> </semantics></math>; 5 = <span class="html-italic">P</span>; 6 = <math display="inline"><semantics> <mrow> <mi>A</mi> <mi>B</mi> <mi>P</mi> </mrow> </semantics></math>.</p>
Full article ">Figure 5
<p>The events of the real task, and the associated view in the virtual environment (placed above in the block over the related real figure), corresponding to (<b>A</b>) beginning of <math display="inline"><semantics> <mrow> <mi>B</mi> <mi>R</mi> <mi>G</mi> </mrow> </semantics></math> phase, (<b>B</b>) end of <math display="inline"><semantics> <mrow> <mi>B</mi> <mi>R</mi> <mi>G</mi> </mrow> </semantics></math> phase: grasping event, (<b>C</b>) end event of the <math display="inline"><semantics> <mrow> <mi>A</mi> <mi>B</mi> <mi>G</mi> </mrow> </semantics></math>, (<b>D</b>) beginning event of <math display="inline"><semantics> <mrow> <mi>B</mi> <mi>R</mi> </mrow> </semantics></math> phase, (<b>E</b>=<b>F</b>) events during the <span class="html-italic">P</span>, (<b>G</b>) end event of the <math display="inline"><semantics> <mrow> <mi>A</mi> <mi>B</mi> <mi>P</mi> </mrow> </semantics></math> phase. Notice that events E and F are both represented in the same picture, because the subject is in the same position.</p>
Full article ">
17 pages, 4095 KiB  
Article
An Unsupervised Tunnel Damage Identification Method Based on Convolutional Variational Auto-Encoder and Wavelet Packet Analysis
by Yonglai Zhang, Xiongyao Xie, Hongqiao Li and Biao Zhou
Sensors 2022, 22(6), 2412; https://doi.org/10.3390/s22062412 - 21 Mar 2022
Cited by 18 | Viewed by 2613
Abstract
Finding a low-cost and highly efficient method for identifying subway tunnel damage can greatly reduce catastrophic accidents. At present, tunnel health monitoring is mainly based on the observation of apparent diseases and vibration monitoring, which is combined with a manual inspection to perceive [...] Read more.
Finding a low-cost and highly efficient method for identifying subway tunnel damage can greatly reduce catastrophic accidents. At present, tunnel health monitoring is mainly based on the observation of apparent diseases and vibration monitoring, which is combined with a manual inspection to perceive the tunnel health status. However, these methods have disadvantages such as high cost, short working time, and low identification efficiency. Thus, in this study, a tunnel damage identification algorithm based on the vibration response of in-service train and WPE-CVAE is proposed, which can automatically identify tunnel damage and give the damage location. The method is an unsupervised novelty detection that requires only sufficient normal data on healthy structure for training. This study introduces the theory and implementation process of this method in detail. Through laboratory model tests, the damage of the void behind the tunnel wall is designed to verify the performance of the algorithm. In the test case, the proposed method achieves the damage identification performance with a 96.25% recall rate, 86.75% hit rate, and 91.5% accuracy. Furthermore, compared with the other unsupervised methods, the method performance and noise immunity are better than others, so it has a certain practical value. Full article
Show Figures

Figure 1

Figure 1
<p>The proposed tunnel damage detection method.</p>
Full article ">Figure 2
<p>Framework of the proposed tunnel damage detection method.</p>
Full article ">Figure 3
<p>Architecture of CVAE model.</p>
Full article ">Figure 4
<p>The model and the test system in the laboratory.</p>
Full article ">Figure 5
<p>The shape and placement of the voids: (<b>a</b>) 3D-printed void, (<b>b</b>) void size and position.</p>
Full article ">Figure 6
<p>Damage Setup.</p>
Full article ">Figure 7
<p>Original signal of the vehicle in modelling test.</p>
Full article ">Figure 8
<p>Wavelet packet energy spectrum.</p>
Full article ">Figure 9
<p>Void identification using CVAE.</p>
Full article ">Figure 10
<p>Identify void position using <span class="html-italic">TDI<sub>WPE</sub></span> taking sample-A as an example.</p>
Full article ">Figure 11
<p>Synthetic WGN of different power.</p>
Full article ">
17 pages, 1232 KiB  
Article
Development of a 3D Relative Motion Method for Human–Robot Interaction Assessment
by Felipe Ballen-Moreno, Margarita Bautista, Thomas Provot, Maxime Bourgain, Carlos A. Cifuentes and Marcela Múnera
Sensors 2022, 22(6), 2411; https://doi.org/10.3390/s22062411 - 21 Mar 2022
Cited by 6 | Viewed by 2684
Abstract
Exoskeletons have been assessed by qualitative and quantitative features known as performance indicators. Within these, the ergonomic indicators have been isolated, creating a lack of methodologies to analyze and assess physical interfaces. In this sense, this work presents a three-dimensional relative motion assessment [...] Read more.
Exoskeletons have been assessed by qualitative and quantitative features known as performance indicators. Within these, the ergonomic indicators have been isolated, creating a lack of methodologies to analyze and assess physical interfaces. In this sense, this work presents a three-dimensional relative motion assessment method. This method quantifies the difference of orientation between the user’s limb and the exoskeleton link, providing a deeper understanding of the Human–Robot interaction. To this end, the AGoRA exoskeleton was configured in a resistive mode and assessed using an optoelectronic system. The interaction quantified a difference of orientation considerably at a maximum value of 41.1 degrees along the sagittal plane. It extended the understanding of the Human–Robot Interaction throughout the three principal human planes. Furthermore, the proposed method establishes a performance indicator of the physical interfaces of an exoskeleton. Full article
(This article belongs to the Section Sensors and Robotics)
Show Figures

Figure 1

Figure 1
<p>The AGoRA exoskeleton. Uni-lateral actuation on the right side.</p>
Full article ">Figure 2
<p>Scheme of thigh’s vectors. Reference vectors are used to establish the user’s local frame. The <math display="inline"><semantics> <mover accent="true"> <msub> <mi>t</mi> <mrow> <mi>u</mi> <mi>p</mi> </mrow> </msub> <mo>→</mo> </mover> </semantics></math> vector is defined by the middle point between EPSD and EASD markers. Similarly, the <math display="inline"><semantics> <mover accent="true"> <msub> <mi>t</mi> <mrow> <mi>l</mi> <mi>o</mi> <mi>w</mi> </mrow> </msub> <mo>→</mo> </mover> </semantics></math> is created by the middle point between CLD and CMD markers. Finally, previous vectors are used to define the longitudinal vector of the thigh <math display="inline"><semantics> <mover accent="true"> <mrow> <mi>v</mi> <mi>e</mi> <mi>c</mi> <msub> <mi>t</mi> <mi>y</mi> </msub> </mrow> <mo>→</mo> </mover> </semantics></math>.</p>
Full article ">Figure 3
<p>2D-projection of the descriptive scheme of rotation matrices.</p>
Full article ">Figure 4
<p>Controller scheme of the assistance mode. The admittance controller’ model is defined as a mass-damper system, including a module of position limitation, velocity saturation, and emergency button. These modules are aimed at the device’s security. (A.C.: Admittance Controller, F.L.: Feedforward Loop, F.M.: Friction Model, M.M.: Modulation Method, G.P.D.: Gait Phase Detection, U.: User, A.S.: Actuation System, V.D.: Velocity Driver, V.S.: Velocity Saturation, P.L.: Position Limitation, M.P.L.: Module of Position Limitation).</p>
Full article ">Figure 5
<p>Markers setup used in the pilot study. Highlighted in red are the user’s markers and the exoskeleton’s markers in blue.</p>
Full article ">Figure 6
<p>Flowchart of the data processing and implementation.</p>
Full article ">Figure 7
<p>The difference of orientation’s outcomes per subject. (<b>a</b>) Subject 1, (<b>b</b>) Subject 2, (<b>c</b>) Subject 3, (<b>d</b>) Subject 4, (<b>e</b>) Subject 5, (<b>f</b>) Subject 6. The red curve refers to the <math display="inline"><semantics> <mrow> <mi>R</mi> <mi>o</mi> <msub> <mi>t</mi> <mi>X</mi> </msub> </mrow> </semantics></math>, the blue curve refers to the <math display="inline"><semantics> <mrow> <mi>R</mi> <mi>o</mi> <msub> <mi>t</mi> <mi>Y</mi> </msub> </mrow> </semantics></math>, and the green curve refers to the <math display="inline"><semantics> <mrow> <mi>R</mi> <mi>o</mi> <msub> <mi>t</mi> <mi>Z</mi> </msub> </mrow> </semantics></math>. In all cases, the dotted signal represents the average of the cycles for each orientation signal per subject; and the shaded curve represents the standard deviation of the cycles for each orientation signal per subject.</p>
Full article ">
21 pages, 2422 KiB  
Article
EggBlock: Design and Implementation of Solar Energy Generation and Trading Platform in Edge-Based IoT Systems with Blockchain
by Subin Kwak, Joohyung Lee, Jangkyum Kim and Hyeontaek Oh
Sensors 2022, 22(6), 2410; https://doi.org/10.3390/s22062410 - 21 Mar 2022
Cited by 7 | Viewed by 3190
Abstract
In this paper, to balance power supplement from the solar energy’s intermittent and unpredictable generation, we design a solar energy generation and trading platform (EggBlock) using Internet of Things (IoT) systems and blockchain technique. Without a centralized broker, the proposed EggBlock platform can [...] Read more.
In this paper, to balance power supplement from the solar energy’s intermittent and unpredictable generation, we design a solar energy generation and trading platform (EggBlock) using Internet of Things (IoT) systems and blockchain technique. Without a centralized broker, the proposed EggBlock platform can promote energy trading between users equipped with solar panels, and balance demand and generation. By applying the second price sealed-bid auction, which is one of the suitable pricing mechanisms in the blockchain technique, it is possible to derive truthful bidding of market participants according to their utility function and induce the proceed transaction. Furthermore, for efficient generation of solar energy, EggBlock proposes a Q-learning-based dynamic panel control mechanism. Specifically, we set the instantaneous direction of the solar panel and the amount of power generation as the state and reward, respectively. The angle of the panel to be moved becomes an action at the next time step. Then, we continuously update the Q-table using transfer learning, which can cope with recent changes in the surrounding environment or weather. We implement the proposed EggBlock platform using Ethereum’s smart contract for reliable transactions. At the end of the paper, measurement-based experiments show that the proposed EggBlock achieves reliable and transparent energy trading on the blockchain and converges to the optimal direction with short iterations. Finally, the results of the study show that an average energy generation gain of 35% is obtained. Full article
(This article belongs to the Topic IoT for Energy Management Systems and Smart Cities)
Show Figures

Figure 1

Figure 1
<p>System model.</p>
Full article ">Figure 2
<p>Auction-based energy transaction model.</p>
Full article ">Figure 3
<p>Ethereum architecture.</p>
Full article ">Figure 4
<p>Sequence diagram for the energy trading.</p>
Full article ">Figure 5
<p>Blueprint of controllers in testbed.</p>
Full article ">Figure 6
<p>Testbed of platform.</p>
Full article ">Figure 7
<p>Process of energy trading in web page. (<b>a</b>) Real time user’s information; (<b>b</b>) Purchase section; (<b>c</b>) Purchase progress pop-up window; (<b>d</b>) Ethereum transaction preview; (<b>e</b>) Transaction in progress; (<b>f</b>) Transaction completion.</p>
Full article ">Figure 7 Cont.
<p>Process of energy trading in web page. (<b>a</b>) Real time user’s information; (<b>b</b>) Purchase section; (<b>c</b>) Purchase progress pop-up window; (<b>d</b>) Ethereum transaction preview; (<b>e</b>) Transaction in progress; (<b>f</b>) Transaction completion.</p>
Full article ">Figure 7 Cont.
<p>Process of energy trading in web page. (<b>a</b>) Real time user’s information; (<b>b</b>) Purchase section; (<b>c</b>) Purchase progress pop-up window; (<b>d</b>) Ethereum transaction preview; (<b>e</b>) Transaction in progress; (<b>f</b>) Transaction completion.</p>
Full article ">Figure 8
<p>Provided information in mobile application. (<b>a</b>) Main page; (<b>b</b>) Contract address; (<b>c</b>) Market price; (<b>d</b>) Price with volume; (<b>e</b>) Account lookup; (<b>f</b>) Transaction history.</p>
Full article ">Figure 8 Cont.
<p>Provided information in mobile application. (<b>a</b>) Main page; (<b>b</b>) Contract address; (<b>c</b>) Market price; (<b>d</b>) Price with volume; (<b>e</b>) Account lookup; (<b>f</b>) Transaction history.</p>
Full article ">Figure 9
<p>Adjusting parameters according to the amount of solar energy generated per day. (<b>a</b>) Adjusting number of episode; (<b>b</b>) Adjusting learning rate; (<b>c</b>) Adjusting discount factor.</p>
Full article ">Figure 10
<p>Simulation result. (<b>a</b>) Compared with static system; (<b>b</b>) Compared with regular system; (<b>c</b>) Compared with heuristic system; (<b>d</b>) Total amount of generated energy.</p>
Full article ">Figure 11
<p>Determination of transaction ratio of seller according to environmental changes. (<b>a</b>) Compare with static system; (<b>b</b>) Compare with static system.</p>
Full article ">Figure 12
<p>Determination of bidding cost of buyer <span class="html-italic">i</span> according to environmental changes. (<b>a</b>) Compared with static system; (<b>b</b>) Compared with static system.</p>
Full article ">Figure 13
<p>Energy trading test.</p>
Full article ">
23 pages, 5193 KiB  
Article
A Novel Analytical Modeling Approach for Quality Propagation of Transient Analysis of Serial Production Systems
by Shihong Liu, Shichang Du, Lifeng Xi, Yiping Shao and Delin Huang
Sensors 2022, 22(6), 2409; https://doi.org/10.3390/s22062409 - 21 Mar 2022
Cited by 2 | Viewed by 1952
Abstract
Production system modeling (PSM) for quality propagation involves mapping the principles between components and systems. While most existing studies focus on the steady-state analysis, the transient quality analysis remains largely unexplored. It is of significance to fully understand quality propagation, especially during transients, [...] Read more.
Production system modeling (PSM) for quality propagation involves mapping the principles between components and systems. While most existing studies focus on the steady-state analysis, the transient quality analysis remains largely unexplored. It is of significance to fully understand quality propagation, especially during transients, to shorten product changeover time, decrease quality loss, and improve quality. In this paper, a novel analytical PSM approach is established based on the Markov model, to explore product quality propagation for transient analysis of serial multi-stage production systems. The cascade property for quality propagation among correlated sequential stages was investigated, taking into account both the status of the current stage and the quality of the outputs from upstream stages. Closed-form formulae to evaluate transient quality performances of multi-stage systems were formulated, including the dynamics of system quality, settling time, and quality loss. An iterative procedure utilizing the aggregation technique is presented to approximate transient quality performance with computational efficiency and high accuracy. Moreover, system theoretic properties of quality measures were analyzed and the quality bottleneck identification method was investigated. In the case study, the modeling error was 0.36% and the calculation could clearly track system dynamics; quality bottleneck was identified to decrease the quality loss and facilitate continuous improvement. The experimental results illustrate the applicability of the proposed PSM approach. Full article
Show Figures

Figure 1

Figure 1
<p>Multi-stage production systems having RQIF.</p>
Full article ">Figure 2
<p>Diagrams of state transitions in multi-stage production systems.</p>
Full article ">Figure 3
<p>The recursive process for multi-stage production systems.</p>
Full article ">Figure 4
<p>The evolution of product quality: comparison between calculation and simulation with 95% confidence interval.</p>
Full article ">Figure 5
<p>Difference of the system quality performance between the analytical model and simulation.</p>
Full article ">Figure 6
<p>Settling time as a function of <math display="inline"><semantics> <mrow> <msub> <mo>α</mo> <mn>1</mn> </msub> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <msub> <mo>β</mo> <mn>1</mn> </msub> </mrow> </semantics></math> for (<b>a</b>) three-stage, (<b>b</b>) five-stage, and (<b>c</b>) ten-stage production systems.</p>
Full article ">Figure 7
<p>Settling time as functions of <math display="inline"><semantics> <mrow> <msub> <mo>η</mo> <mn>2</mn> </msub> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <msub> <mo>θ</mo> <mn>2</mn> </msub> </mrow> </semantics></math> for (<b>a</b>) three-stage, (<b>b</b>) five-stage, and (<b>c</b>) ten-stage production systems.</p>
Full article ">Figure 8
<p>Quality loss as a function of <math display="inline"><semantics> <mrow> <msub> <mo>α</mo> <mn>1</mn> </msub> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <msub> <mo>β</mo> <mn>1</mn> </msub> </mrow> </semantics></math> for (<b>a</b>) three-stage, (<b>b</b>) five-stage, and (<b>c</b>) ten-stage production systems.</p>
Full article ">Figure 9
<p>Quality loss as a function of <math display="inline"><semantics> <mrow> <msub> <mo>η</mo> <mn>2</mn> </msub> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <msub> <mo>θ</mo> <mn>2</mn> </msub> </mrow> </semantics></math> for (<b>a</b>) three-stage, (<b>b</b>) five-stage, and (<b>c</b>) ten-stage production systems.</p>
Full article ">Figure 10
<p>Steady-state qualities as functions of <math display="inline"><semantics> <mrow> <msub> <mo>α</mo> <mn>1</mn> </msub> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <msub> <mo>β</mo> <mn>1</mn> </msub> </mrow> </semantics></math> for (<b>a</b>) three-stage and (<b>b</b>) ten-stage systems, as functions of <math display="inline"><semantics> <mrow> <msub> <mo>η</mo> <mn>2</mn> </msub> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <msub> <mo>θ</mo> <mn>2</mn> </msub> </mrow> </semantics></math> for (<b>c</b>) three-stage and (<b>d</b>) ten-stage systems.</p>
Full article ">Figure 11
<p>(<b>a</b>) Profiles of valve shell. (<b>b</b>) Production process.</p>
Full article ">Figure 12
<p>The evolutions for system quality performance during transients in the case: (<b>a</b>) product quality through the system, (<b>b</b>) system quality states at the last stage.</p>
Full article ">Figure 13
<p>Quality loss rate curve over 150 time slots (the red dashed line is the benchmark of 5%).</p>
Full article ">Figure 14
<p>Change of (<b>a</b>) quality loss, (<b>b</b>) settling time, and (<b>c</b>) steady-state quality corresponding to the parameter change.</p>
Full article ">
32 pages, 3325 KiB  
Article
Heuristic Greedy Scheduling of Electric Vehicles in Vehicle-to-Grid Microgrid Owned Aggregators
by Alaa E. Abdel-Hakim and Farag K. Abo-Elyousr
Sensors 2022, 22(6), 2408; https://doi.org/10.3390/s22062408 - 21 Mar 2022
Cited by 7 | Viewed by 2573
Abstract
In on-grid microgrids, electric vehicles (EVs) have to be efficiently scheduled for cost-effective electricity consumption and network operation. The stochastic nature of the involved parameters along with their large number and correlations make such scheduling a challenging task. This paper aims at identifying [...] Read more.
In on-grid microgrids, electric vehicles (EVs) have to be efficiently scheduled for cost-effective electricity consumption and network operation. The stochastic nature of the involved parameters along with their large number and correlations make such scheduling a challenging task. This paper aims at identifying pertinent innovative solutions for reducing the relevant total costs of the on-grid EVs within hybrid microgrids. To optimally scale the EVs, a heuristic greedy approach is considered. Unlike most existing scheduling methodologies in the literature, the proposed greedy scheduler is model-free, training-free, and yet efficient. The proposed approach considers different factors such as the electricity price, on-grid EVs state of arrival and departure, and the total revenue to meet the load demands. The greedy-based approach behaves satisfactorily in terms of fulfilling its objective for the hybrid microgrid system, which is established of photovoltaic, wind turbine, and a local utility grid. Meanwhile, the on-grid EVs are being utilized as an energy storage exchange location. A real time hardware-in-the-loop experimentation is comprehensively conducted to maximize the earned profit. Through different uncertainty scenarios, the ability of the proposed greedy approach to obtain a global optimal solution is assessed. A data simulator was developed for the purposes of generating evaluation datasets, which captures uncertainties in the behaviors of the system’s parameters. The greedy-based strategy is considered applicable, scalable, and efficient in terms of total operating expenditures. Furthermore, as EVs penetration became more versatile, total expenses decreased significantly. Using simulated data of an effective operational duration of 500 years, the proposed approach succeeded in cutting down the energy consumption costs by about 50–85%, beating existing state-of-the-arts results. The proposed approach is proved to be tolerant to the large amounts of uncertainties that are involved in the system’s operational data. Full article
(This article belongs to the Section Vehicular Sensing)
Show Figures

Figure 1

Figure 1
<p>The system under study.</p>
Full article ">Figure 2
<p>The components of the data simulator.</p>
Full article ">Figure 3
<p>The top best selling cars and their rated capacities.</p>
Full article ">Figure 4
<p>Mean <math display="inline"><semantics> <mrow> <msub> <mi>E</mi> <mrow> <mi>r</mi> <mi>e</mi> <mi>s</mi> </mrow> </msub> <mrow> <mo>(</mo> <mi>t</mi> <mo>)</mo> </mrow> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <mi>L</mi> <mo>(</mo> <mi>t</mi> <mo>)</mo> </mrow> </semantics></math> daily profiles.</p>
Full article ">Figure 5
<p>The used raw historical energy prices.</p>
Full article ">Figure 6
<p>The simulated energy sell and purchase prices to and from the public network with different global uncertainty levels. (<b>a</b>) <math display="inline"><semantics> <msub> <mi>U</mi> <mn>10</mn> </msub> </semantics></math>, (<b>b</b>) <math display="inline"><semantics> <msub> <mi>U</mi> <mn>25</mn> </msub> </semantics></math>, (<b>c</b>) <math display="inline"><semantics> <msub> <mi>U</mi> <mn>50</mn> </msub> </semantics></math>, (<b>d</b>) <math display="inline"><semantics> <msub> <mi>U</mi> <mn>75</mn> </msub> </semantics></math>, (<b>e</b>) <math display="inline"><semantics> <msub> <mi>U</mi> <mn>95</mn> </msub> </semantics></math>.</p>
Full article ">Figure 7
<p>The simulated <math display="inline"><semantics> <msub> <mi>E</mi> <mrow> <mi>r</mi> <mi>e</mi> <mi>s</mi> </mrow> </msub> </semantics></math> and <math display="inline"><semantics> <mrow> <mi>L</mi> <mo>(</mo> <mi>t</mi> <mo>)</mo> </mrow> </semantics></math> with different global uncertainty levels. (<b>a</b>) <math display="inline"><semantics> <msub> <mi>U</mi> <mn>10</mn> </msub> </semantics></math>, (<b>b</b>) <math display="inline"><semantics> <msub> <mi>U</mi> <mn>25</mn> </msub> </semantics></math>, (<b>c</b>) <math display="inline"><semantics> <msub> <mi>U</mi> <mn>50</mn> </msub> </semantics></math>, (<b>d</b>) <math display="inline"><semantics> <msub> <mi>U</mi> <mn>75</mn> </msub> </semantics></math>, (<b>e</b>) <math display="inline"><semantics> <msub> <mi>U</mi> <mn>95</mn> </msub> </semantics></math>.</p>
Full article ">Figure 8
<p>The temporal variation of the adopted charging decision by the greedy algorithm with a global certainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>10</mn> </msub> </semantics></math>.</p>
Full article ">Figure 9
<p>The temporal variation of the adopted charging decision by the greedy algorithm with a global certainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>25</mn> </msub> </semantics></math>.</p>
Full article ">Figure 10
<p>The temporal variation of the adopted charging decision by the greedy algorithm with a global certainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>50</mn> </msub> </semantics></math>.</p>
Full article ">Figure 11
<p>The temporal variation of the adopted charging decision by the greedy algorithm with a global certainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>75</mn> </msub> </semantics></math>.</p>
Full article ">Figure 12
<p>The temporal variation of the adopted charging decision by the greedy algorithm with a global certainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>95</mn> </msub> </semantics></math>.</p>
Full article ">Figure 13
<p>The average temporal charging and discharging ratios of EVs according to the greedy policy with a global certainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>10</mn> </msub> </semantics></math>.</p>
Full article ">Figure 14
<p>The average temporal charging and discharging ratios of EVs according to the greedy policy with a global certainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>25</mn> </msub> </semantics></math>.</p>
Full article ">Figure 15
<p>The average temporal charging and discharging ratios of EVs according to the greedy policy with a global certainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>50</mn> </msub> </semantics></math>.</p>
Full article ">Figure 16
<p>The average temporal charging and discharging ratios of EVs according to the greedy policy with a global certainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>75</mn> </msub> </semantics></math>.</p>
Full article ">Figure 17
<p>The average temporal charging and discharging ratios of EVs according to the greedy policy with a global certainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>95</mn> </msub> </semantics></math>.</p>
Full article ">Figure 18
<p>The total operation cost in terms of net energy purchase and sell revenue with a global certainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>10</mn> </msub> </semantics></math>.</p>
Full article ">Figure 19
<p>The total operation cost in terms of net energy purchase and sell revenue with a global certainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>25</mn> </msub> </semantics></math>.</p>
Full article ">Figure 20
<p>The total operation cost in terms of net energy purchase and sell revenue with a global certainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>50</mn> </msub> </semantics></math>.</p>
Full article ">Figure 21
<p>The total operation cost in terms of net energy purchase and sell revenue with a global certainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>75</mn> </msub> </semantics></math>.</p>
Full article ">Figure 22
<p>The total operation cost in terms of net energy purchase and sell revenue with a global certainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>95</mn> </msub> </semantics></math>.</p>
Full article ">Figure 23
<p>The total cost saving achieved by the proposed greedy scheduler when compared with scheduling policies fixed uncertainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>10</mn> </msub> </semantics></math>. (<b>a</b>) Monthly, (<b>b</b>) quarterly, (<b>c</b>) semiannually, and (<b>d</b>) annually.</p>
Full article ">Figure 24
<p>The total cost saving achieved by the proposed greedy scheduler when compared with scheduling policies fixed uncertainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>25</mn> </msub> </semantics></math>. (<b>a</b>) Monthly, (<b>b</b>) quarterly, (<b>c</b>) semiannually, and (<b>d</b>) annually.</p>
Full article ">Figure 25
<p>The total cost saving achieved by the proposed greedy scheduler when compared with scheduling policies fixed uncertainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>50</mn> </msub> </semantics></math>. (<b>a</b>) Monthly, (<b>b</b>) quarterly, (<b>c</b>) semiannually, and (<b>d</b>) annually.</p>
Full article ">Figure 26
<p>The total cost saving achieved by the proposed greedy scheduler when compared with scheduling policies fixed uncertainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>75</mn> </msub> </semantics></math>. (<b>a</b>) Monthly, (<b>b</b>) quarterly, (<b>c</b>) semiannually, and (<b>d</b>) annually.</p>
Full article ">Figure 27
<p>The total cost saving achieved by the proposed greedy scheduler when compared with scheduling policies fixed uncertainty level <math display="inline"><semantics> <msub> <mi>U</mi> <mn>95</mn> </msub> </semantics></math>. (<b>a</b>) Monthly, (<b>b</b>) quarterly, (<b>c</b>) semiannually, and (<b>d</b>) annually.</p>
Full article ">
16 pages, 4181 KiB  
Article
Performance Degradation Prediction Using LSTM with Optimized Parameters
by Yawei Hu, Ran Wei, Yang Yang, Xuanlin Li, Zhifu Huang, Yongbin Liu, Changbo He and Huitian Lu
Sensors 2022, 22(6), 2407; https://doi.org/10.3390/s22062407 - 21 Mar 2022
Cited by 12 | Viewed by 3204
Abstract
Predicting the degradation of mechanical components, such as rolling bearings is critical to the proper monitoring of the condition of mechanical equipment. A new method, based on a long short-term memory network (LSTM) algorithm, has been developed to improve the accuracy of degradation [...] Read more.
Predicting the degradation of mechanical components, such as rolling bearings is critical to the proper monitoring of the condition of mechanical equipment. A new method, based on a long short-term memory network (LSTM) algorithm, has been developed to improve the accuracy of degradation prediction. The model parameters are optimized via improved particle swarm optimization (IPSO). Regarding how this applies to the rolling bearings, firstly, multi-dimension feature parameters are extracted from the bearing’s vibration signals and fused into responsive features by using the kernel joint approximate diagonalization of eigen-matrices (KJADE) method. Then, the between-class and within-class scatter (SS) are calculated to develop performance degradation indicators. Since network model parameters influence the predictive accuracy of the LSTM model, an IPSO algorithm is used to obtain the optimal prediction model via the LSTM model parameters’ optimization. Finally, the LSTM model, with said optimal parameters, was used to predict the degradation trend of the bearing’s performance. The experiment’s results show that the proposed method can effectively identify the trends of degradation and performance. Moreover, the predictive accuracy of this proposed method is greater than that of the extreme learning machine (ELM) and support vector regression (SVR), which are the algorithms conventionally used in degradation modeling. Full article
(This article belongs to the Special Issue Machine Health Monitoring and Fault Diagnosis Techniques)
Show Figures

Figure 1

Figure 1
<p>Structure of long short-term memory hidden unit.</p>
Full article ">Figure 2
<p>Parameter optimization flowchart.</p>
Full article ">Figure 3
<p>Performance degradation prediction by IPSO.</p>
Full article ">Figure 4
<p>Experimental setup.</p>
Full article ">Figure 5
<p>Exemplary diagram of bearing vibration data: (<b>a</b>) rolling fault; (<b>b</b>) inner fault; (<b>c</b>) outer fault.</p>
Full article ">Figure 6
<p>Performance degradation predictions for outer bearings for the: (<b>a</b>) LSTM; (<b>b</b>) PSO-LSTM; (<b>c</b>) IPSO-LSTM.</p>
Full article ">Figure 7
<p>Performance degradation predictions of roller bearings for the: (<b>a</b>) LSTM; (<b>b</b>) PSO-LSTM; (<b>c</b>) IPSO-LSTM.</p>
Full article ">Figure 8
<p>Performance degradation predictions of inner bearings for the: (<b>a</b>) LSTM; (<b>b</b>) PSO-LSTM; (<b>c</b>) IPSO-LSTM.</p>
Full article ">Figure 9
<p>Optimization iteration results for the: (<b>a</b>) outer bearing; (<b>b</b>) roller bearing; (<b>c</b>) inner bearing.</p>
Full article ">Figure 10
<p>Performance degradation predictions of the outer bearings for the: (<b>a</b>) ELM; (<b>b</b>) SVR; (<b>c</b>) IPSO-LSTM.</p>
Full article ">Figure 11
<p>Performance degradation predictions of roller bearings for the: (<b>a</b>) ELM; (<b>b</b>) SVR; (<b>c</b>) IPSO-LSTM.</p>
Full article ">Figure 12
<p>Performance degradation predictions of the inner bearings for the: (<b>a</b>) ELM; (<b>b</b>) SVR; (<b>c</b>) IPSO-LSTM.</p>
Full article ">Figure 13
<p>Experimental setup.</p>
Full article ">Figure 14
<p>The full-life original vibration signal.</p>
Full article ">Figure 15
<p>Performance degradation predictions of the roller bearings for the: (<b>a</b>) LSTM; (<b>b</b>) PSO-LSTM; (<b>c</b>) IPSO-LSTM.</p>
Full article ">Figure 16
<p>Optimization iteration results of roller bearing.</p>
Full article ">Figure 17
<p>Performance degradation predictions of the roller bearing for the: (<b>a</b>) ELM; (<b>b</b>) SVR; (<b>c</b>) IPSO-LSTM.</p>
Full article ">
12 pages, 1841 KiB  
Article
Method to Minimize the Errors of AI: Quantifying and Exploiting Uncertainty of Deep Learning in Brain Tumor Segmentation
by Joohyun Lee, Dongmyung Shin, Se-Hong Oh and Haejin Kim
Sensors 2022, 22(6), 2406; https://doi.org/10.3390/s22062406 - 21 Mar 2022
Cited by 7 | Viewed by 2760
Abstract
Despite the unprecedented success of deep learning in various fields, it has been recognized that clinical diagnosis requires extra caution when applying recent deep learning techniques because false prediction can result in severe consequences. In this study, we proposed a reliable deep learning [...] Read more.
Despite the unprecedented success of deep learning in various fields, it has been recognized that clinical diagnosis requires extra caution when applying recent deep learning techniques because false prediction can result in severe consequences. In this study, we proposed a reliable deep learning framework that could minimize incorrect segmentation by quantifying and exploiting uncertainty measures. The proposed framework demonstrated the effectiveness of a public dataset: Multimodal Brain Tumor Segmentation Challenge 2018. By using this framework, segmentation performances, particularly for small lesions, were improved. Since the segmentation of small lesions is difficult but also clinically significant, this framework could be effectively applied to the medical imaging field. Full article
Show Figures

Figure 1

Figure 1
<p>Flow diagram of our study. Brain tumor segmentation on MRI was automatically performed, and three types of lesions (enhancing tumor, necrotic/non-enhancing tumor, and edema) were distinguished. The proposed framework can minimize the error of the baseline model. To evaluate the framework, we used a public dataset, BraTS18. T1 = T1-weighted; T1ce = T1 contrast-enhanced; T2 = T2-weighted; FLAIR = Fluid Attenuated Inversion Recovery; HGG = high-grade glioma (glioblastoma); LGG = low-grade glioma.</p>
Full article ">Figure 2
<p>Overview of the proposed framework. (<b>a</b>) Feedforward multimodal MRI images into a baseline model with Monte Carlo dropout and generate a baseline segmentation map (Step. 1) (<b>b</b>) Quantify uncertainty values of baseline segmentation map by four different measures (Step. 2). Feedforward both images and uncertainty maps into the proposed model and generate proposed segmentation map (Step. 3); MC dropout = Monte Carlo dropout; 3D CNN = 3-dimensional convolutional neural network; UAM = uncertainty attention module.</p>
Full article ">Figure 3
<p>Architecture of uncertainty attention module (UAM). This subnetwork module can effectively exploit uncertainty maps by applying an attention mechanism. This module is plugged into any neural network. This architecture, including the operations, was highly optimized by an ablation study. Conv = convolution; AvgPool = average pooling; MaxPool = max pooling; F<sub>avg</sub> = feature maps from average pooling operation; F<sub>max</sub> = feature maps from max pooling operation. (<b>a</b>) UAM architecture overview. (<b>b</b>) Specific architecture of green box.</p>
Full article ">Figure 4
<p>Uncertainty quantification results: Automated segmentation results by baseline model, corresponding uncertainty maps, image, and manual segmentation by experienced neurologists (ground truth). Each scan is from a different patient. The color code of the segmentation map and uncertainty map is described below. Red in the uncertainty map means an uncertain predictive area, and blue means a certain predictive area. ET = enhancing tumor; NCR/NET = necrotic and non-enhancing tumor; ED = peritumoral edema. (<b>a</b>) Totally correct prediction and UMs. (<b>b</b>) Totally incorrect prediction and UMs. (<b>c</b>) Slightly incorrect prediction and UMs. (<b>d</b>) Moderately incorrect prediction and UMs.</p>
Full article ">Figure 5
<p>Uncertainty exploitation results: Automatic segmentation results by baseline/proposed method and manual segmentation by experienced neurologists (ground-truth). The images are subsequent results of <a href="#sensors-22-02406-f004" class="html-fig">Figure 4</a>. The proposed method can exploit uncertainty maps to perform brain tumor segmentation. (<b>a</b>) scans with no tumor. (<b>b</b>) scans with ET and ED. (<b>c</b>) scans with all lesions. (<b>d</b>) scans with all lesions.</p>
Full article ">
12 pages, 5107 KiB  
Article
Multi-Scale Attention 3D Convolutional Network for Multimodal Gesture Recognition
by Huizhou Chen, Yunan Li, Huijuan Fang, Wentian Xin, Zixiang Lu and Qiguang Miao
Sensors 2022, 22(6), 2405; https://doi.org/10.3390/s22062405 - 21 Mar 2022
Cited by 15 | Viewed by 3116
Abstract
Gesture recognition is an important direction in computer vision research. Information from the hands is crucial in this task. However, current methods consistently achieve attention on hand regions based on estimated keypoints, which will significantly increase both time and complexity, and may lose [...] Read more.
Gesture recognition is an important direction in computer vision research. Information from the hands is crucial in this task. However, current methods consistently achieve attention on hand regions based on estimated keypoints, which will significantly increase both time and complexity, and may lose position information of the hand due to wrong keypoint estimations. Moreover, for dynamic gesture recognition, it is not enough to consider only the attention in the spatial dimension. This paper proposes a multi-scale attention 3D convolutional network for gesture recognition, with a fusion of multimodal data. The proposed network achieves attention mechanisms both locally and globally. The local attention leverages the hand information extracted by the hand detector to focus on the hand region, and reduces the interference of gesture-irrelevant factors. Global attention is achieved in both the human-posture context and the channel context through a dual spatiotemporal attention module. Furthermore, to make full use of the differences between different modalities of data, we designed a multimodal fusion scheme to fuse the features of RGB and depth data. The proposed method is evaluated using the Chalearn LAP Isolated Gesture Dataset and the Briareo Dataset. Experiments on these two datasets prove the effectiveness of our network and show it outperforms many state-of-the-art methods. Full article
(This article belongs to the Special Issue Sensing Systems for Sign Language Recognition)
Show Figures

Figure 1

Figure 1
<p>Our pipeline of the proposed network. This network takes I3D [<a href="#B4-sensors-22-02405" class="html-bibr">4</a>] as the backbone and consists of three parts: (<b>1</b>) A local attention module to enhance the network’s attention to the hand region. (<b>2</b>) A dual spatiotemporal attention module to extract global spatiotemporal posture context information. (<b>3</b>) A multimodal fusion network for fusing different modality features.</p>
Full article ">Figure 2
<p>Sample of different data used in local attention: (<b>a</b>) raw RGB data; (<b>b</b>) hand data processed by hand detector; (<b>c</b>) fusion of raw RGB data and hand data.</p>
Full article ">Figure 3
<p>Architecture of SVAM. SVAM is designed for capturing the vision dependence in the spatiotemporal domain. This module takes the feature extracted by I3D as input. <span class="html-italic">Q</span>, <span class="html-italic">K</span>, and V correspond to query, key, and value matrices in the attention mechanism. The output feature is the result of the selective aggregation of features at all positions with the weighted sum of the input features.</p>
Full article ">Figure 4
<p>Architecture of SCAM. SCAM takes the feature extracted by I3D as input, which is designed for capturing the dependence between channels in the spatiotemporal domain. <math display="inline"><semantics> <mrow> <msup> <mi>A</mi> <mrow> <mo stretchy="false">(</mo> <mn>1</mn> <mo stretchy="false">)</mo> </mrow> </msup> <mo>,</mo> <msup> <mi>A</mi> <mrow> <mo stretchy="false">(</mo> <mn>2</mn> <mo stretchy="false">)</mo> </mrow> </msup> <mo>,</mo> <msup> <mi>A</mi> <mrow> <mo stretchy="false">(</mo> <mn>3</mn> <mo stretchy="false">)</mo> </mrow> </msup> </mrow> </semantics></math> correspond to query, key, and value matrices in the attention mechanism. The output feature of each channel is the result of the selective aggregation of features on all channels, and the weighted sum of the input features.</p>
Full article ">Figure 5
<p>Comparison of channel feature map between DA-3D and MSA-3D: (<b>a</b>) features of each channel extracted after the third layer of DA-3D network; (<b>b</b>) features of each channel extracted after the third layer of MSA-3D network.</p>
Full article ">Figure 6
<p>Comparison of channel feature map between I3D and MSA-3D: (<b>a</b>) features of each channel extracted after the third layer of I3D network; (<b>b</b>) features of each channel extracted after the third layer of MSA-3D network.</p>
Full article ">
15 pages, 4193 KiB  
Communication
Integrated Resource Management for Fog Networks
by Jui-Pin Yang and Hui-Kai Su
Sensors 2022, 22(6), 2404; https://doi.org/10.3390/s22062404 - 21 Mar 2022
Viewed by 1848
Abstract
In this paper, we consider integrated resource management for fog networks inclusive of intelligent energy perception, service level agreement (SLA) planning and replication-based hotspot offload (RHO). In the beginning, we propose an intelligent energy perception scheme which dynamically classifies the fog nodes into [...] Read more.
In this paper, we consider integrated resource management for fog networks inclusive of intelligent energy perception, service level agreement (SLA) planning and replication-based hotspot offload (RHO). In the beginning, we propose an intelligent energy perception scheme which dynamically classifies the fog nodes into a hot set, a warm set or a cold set, based on their load conditions. The fog nodes in the hot set are responsible for a quality of service (QoS) guarantee and the fog nodes in the cold set are maintained at a low-energy state to save energy consumption. Moreover, the fog nodes in the warm set are used to balance the QoS guarantee and energy consumption. Secondly, we propose an SLA mapping scheme which effectively identifies the SLA elements with the same semantics. Finally, we propose a replication-based load-balancing scheme, namely RHO. The RHO can leverage the skewed access pattern caused by the hotspot services. In addition, it greatly reduces communication overheads because the load conditions are updated only when the load variations exceed a specific threshold. Finally, we use computer simulations to compare the performance of the RHO with other schemes under a variety of load conditions. In a word, we propose a comprehensive and feasible solution that contributes to the integrated resource management of fog networks. Full article
(This article belongs to the Section Communications)
Show Figures

Figure 1

Figure 1
<p>System architecture of fog networks.</p>
Full article ">Figure 2
<p>The framework of integrated resource management.</p>
Full article ">Figure 3
<p>Architecture of intelligent energy perception.</p>
Full article ">Figure 4
<p>SLA mapping mechanism.</p>
Full article ">Figure 5
<p>Request-generating models.</p>
Full article ">Figure 6
<p>The average requests where sixteen fog nodes have high loads of hotspot services.</p>
Full article ">Figure 7
<p>The average requests where thirty-two fog nodes have high loads of hotspot services.</p>
Full article ">Figure 8
<p>The average requests where sixteen fog nodes have different load conditions.</p>
Full article ">
16 pages, 4764 KiB  
Article
Distorted Acquisition of Dynamic Events Sensed by Frequency-Scanning Fiber-Optic Interrogators and a Mitigation Strategy
by Hari Datta Bhatta, Roy Davidi, Arie Yeredor and Moshe Tur
Sensors 2022, 22(6), 2403; https://doi.org/10.3390/s22062403 - 21 Mar 2022
Cited by 2 | Viewed by 1977
Abstract
Fiber-optic dynamic interrogators, which use periodic frequency scanning, actually sample a time-varying measurand on a non-uniform time grid. Commonly, however, the sampled values are reported on a uniform time grid, synchronized with the periodic scanning. It is the novel and noteworthy message of [...] Read more.
Fiber-optic dynamic interrogators, which use periodic frequency scanning, actually sample a time-varying measurand on a non-uniform time grid. Commonly, however, the sampled values are reported on a uniform time grid, synchronized with the periodic scanning. It is the novel and noteworthy message of this paper that this artificial assignment may give rise to significant distortions in the recovered signal. These distortions increase with both the signal frequency and measurand dynamic range for a given sampling rate and frequency scanning span of the interrogator. They may reach disturbing values in dynamic interrogators, which trade-off scanning speed with scanning span. The paper also calls for manufacturers of such interrogators to report the sampled values along with their instants of acquisition, allowing interpolation algorithms to substantially reduce the distortion. Experimental verification of a simulative analysis includes: (i) a commercial dynamic interrogator of ‘continuous’ FBG fibers that attributes the measurand values to a uniform time grid; as well as (ii) a dynamic Brillouin Optical time Domain (BOTDA) laboratory setup, which provides the sampled measurand values together with the sampling instants. Here, using the available measurand-dependent sampling instants, we demonstrate a significantly cleaner signal recovery using spline interpolation. Full article
(This article belongs to the Topic Advances in Optical Sensors)
Show Figures

Figure 1

Figure 1
<p>(<b>a</b>) A sinusoidal measurand signal of a normalized temporal frequency of <math display="inline"><semantics> <mrow> <msub> <mi>f</mi> <mrow> <mi>s</mi> <mi>i</mi> <mi>g</mi> <mi>n</mi> <mi>a</mi> <mi>l</mi> </mrow> </msub> <mo>/</mo> <msub> <mi>f</mi> <mrow> <mi>s</mi> <mi>c</mi> <mi>a</mi> <mi>n</mi> </mrow> </msub> </mrow> </semantics></math> = 0.23 (50 Hz/220 Hz) and filling factor of <math display="inline"><semantics> <mrow> <msub> <mi>ν</mi> <mrow> <mi>s</mi> <mi>i</mi> <mi>g</mi> <mi>n</mi> <mi>a</mi> <mi>l</mi> <mo>−</mo> <mi>a</mi> <mi>m</mi> <mi>p</mi> </mrow> </msub> <mo>/</mo> <msubsup> <mi>ν</mi> <mrow> <mi>s</mi> <mi>c</mi> <mi>a</mi> <mi>n</mi> </mrow> <mrow> <mi>s</mi> <mi>p</mi> <mi>a</mi> <mi>n</mi> </mrow> </msubsup> <mo>=</mo> <mn>0.3</mn> </mrow> </semantics></math> (solid-blue sinusoidal curve), is scanned by a periodic (every <math display="inline"><semantics> <mrow> <mtext> </mtext> <msub> <mi>T</mi> <mrow> <mi>s</mi> <mi>c</mi> <mi>a</mi> <mi>n</mi> </mrow> </msub> </mrow> </semantics></math> ) saw-tooth waveform (green). (<b>b</b>) The saw-tooth scanning results in a time-dependent detected power (FBG reflection [<a href="#B7-sensors-22-02403" class="html-bibr">7</a>,<a href="#B8-sensors-22-02403" class="html-bibr">8</a>], or Brillouin probe amplification [<a href="#B11-sensors-22-02403" class="html-bibr">11</a>,<a href="#B12-sensors-22-02403" class="html-bibr">12</a>,<a href="#B13-sensors-22-02403" class="html-bibr">13</a>]: red dot curves (arbitrary units). The purple X’s designate the intersection of the signal with the saw-tooth waveform, also indicating the instants where the detected power reaches it maximum. The black filled circles are the measurand sampled values (the ordinates of the X’s), attributed to the beginning of the corresponding scan periods. Only the middle ~6 scan periods are shown from a simulated temporal range of <math display="inline"><semantics> <mrow> <mrow> <mo>[</mo> <mrow> <mo>−</mo> <mn>550</mn> <mtext> </mtext> <mn>549</mn> </mrow> <mo>]</mo> </mrow> <msub> <mi>T</mi> <mrow> <mi>s</mi> <mi>c</mi> <mi>a</mi> <mi>n</mi> </mrow> </msub> </mrow> </semantics></math>.</p>
Full article ">Figure 2
<p>The original sinusoidal signal (blue) of <a href="#sensors-22-02403-f001" class="html-fig">Figure 1</a>, together with its Nyquist–Shannon sinc-reconstruction (red) from the sampled values, <math display="inline"><semantics> <mrow> <msubsup> <mrow> <mrow> <mo>{</mo> <mrow> <msub> <mi>s</mi> <mi>n</mi> </msub> </mrow> <mo>}</mo> </mrow> </mrow> <mrow> <mi>n</mi> <mo>=</mo> <mn>0</mn> </mrow> <mrow> <mi>N</mi> <mo>−</mo> <mn>1</mn> </mrow> </msubsup> </mrow> </semantics></math>, assuming the latter are attributed (see horizontal arrows) to the scans’ starting points (vertical dashed green lines). Shown are the middle ~20 scan periods out of 1100, starting at <math display="inline"><semantics> <mrow> <mo>−</mo> <mn>550</mn> <mtext> </mtext> <msub> <mi>T</mi> <mrow> <mi>s</mi> <mi>c</mi> <mi>a</mi> <mi>n</mi> </mrow> </msub> </mrow> </semantics></math>.</p>
Full article ">Figure 3
<p>Hamming-weighed FFT-based spectrum of the signal acquired from its per-period intersections with the saw-tooth scanning waveform (<a href="#sensors-22-02403-f001" class="html-fig">Figure 1</a>), exhibiting significant harmonic distortion. The highest harmonic at <math display="inline"><semantics> <mrow> <mi>ξ</mi> <mo>=</mo> <mn>0.46</mn> </mrow> </semantics></math> is the signal’s second harmonic, whereas the other peaks are folded ones (see text). The time record was 1100⋅<math display="inline"><semantics> <mrow> <msub> <mi>T</mi> <mrow> <mi>s</mi> <mi>c</mi> <mi>a</mi> <mi>n</mi> </mrow> </msub> </mrow> </semantics></math> long, starting at −550<math display="inline"><semantics> <mrow> <mtext> </mtext> <msub> <mi>T</mi> <mrow> <mi>s</mi> <mi>c</mi> <mi>a</mi> <mi>n</mi> </mrow> </msub> </mrow> </semantics></math>. Incidentally, using the true signal values on the same temporal grid of period <math display="inline"><semantics> <mrow> <msub> <mi>T</mi> <mrow> <mi>s</mi> <mi>c</mi> <mi>a</mi> <mi>n</mi> </mrow> </msub> <mo>,</mo> </mrow> </semantics></math> gives rise only to a single peak at <math display="inline"><semantics> <mi>ξ</mi> </semantics></math> = 0.23.</p>
Full article ">Figure 4
<p>The power (magnitude-squared value) of the second harmonic of an originally pure sinusoidal signal, when acquired from its temporally non-uniform per-period intersections with the linear (instantaneous fly back) saw-tooth scanning waveform of <a href="#sensors-22-02403-f001" class="html-fig">Figure 1</a>. Simulated results are shown for a range of scaled signal frequencies (<math display="inline"><semantics> <mi>ξ</mi> </semantics></math>-legends box) and filling factors (<math display="inline"><semantics> <mi>η</mi> </semantics></math> -abscissa). The higher <math display="inline"><semantics> <mi>ξ</mi> </semantics></math> and/or <math display="inline"><semantics> <mi>η</mi> </semantics></math>, the worse the harmonic distortion. The corresponding total harmonic distortion curves lie within half a dB from the displayed second harmonic ones. The black squares represent experimental results for the Brillouin setup of <a href="#sec4-sensors-22-02403" class="html-sec">Section 4</a>. Note that a different scan pattern, such as a triangular one, will result in different curves.</p>
Full article ">Figure 5
<p>The sinusoidal green curve represents sinc-based reconstruction of the signal from <math display="inline"><semantics> <mrow> <msubsup> <mrow> <mrow> <mo>{</mo> <mrow> <msub> <mover accent="true"> <mi>s</mi> <mo>^</mo> </mover> <mi>n</mi> </msub> <mo>,</mo> <msub> <mover accent="true"> <mi>τ</mi> <mo>^</mo> </mover> <mi>n</mi> </msub> </mrow> <mo>}</mo> </mrow> </mrow> <mrow> <mi>n</mi> <mo>=</mo> <mo>−</mo> <mn>550</mn> </mrow> <mrow> <mn>549</mn> </mrow> </msubsup> </mrow> </semantics></math>, where <math display="inline"><semantics> <mrow> <msubsup> <mrow> <mrow> <mo>{</mo> <mrow> <msub> <mover accent="true"> <mi>s</mi> <mo>^</mo> </mover> <mi>n</mi> </msub> </mrow> <mo>}</mo> </mrow> </mrow> <mrow> <mi>n</mi> <mo>=</mo> <mo>−</mo> <mn>550</mn> </mrow> <mrow> <mn>549</mn> </mrow> </msubsup> </mrow> </semantics></math> are the spline-interpolated signal values on the computable uniform time grid <math display="inline"><semantics> <mrow> <msubsup> <mrow> <mrow> <mo>{</mo> <mrow> <msub> <mover accent="true"> <mi>τ</mi> <mo>^</mo> </mover> <mi>n</mi> </msub> </mrow> <mo>}</mo> </mrow> </mrow> <mrow> <mi>n</mi> <mo>=</mo> <mo>−</mo> <mn>550</mn> </mrow> <mrow> <mn>549</mn> </mrow> </msubsup> </mrow> </semantics></math>, Equation (4). The blue pluses (+) represent a few values of the original sinusoidal signal, and their very tight proximity to the recovered green curve attests to the high quality of the reconstruction. The red curve is the one from <a href="#sensors-22-02403-f002" class="html-fig">Figure 2</a>, representing sinc-based reconstruction from <math display="inline"><semantics> <mrow> <msubsup> <mrow> <mrow> <mo>{</mo> <mrow> <msub> <mi>s</mi> <mi>n</mi> </msub> </mrow> <mo>}</mo> </mrow> </mrow> <mrow> <mi>n</mi> <mo>=</mo> <mn>0</mn> </mrow> <mrow> <mi>N</mi> <mo>−</mo> <mn>1</mn> </mrow> </msubsup> </mrow> </semantics></math>, being attributed to the uniform time grid at the start of the scans.</p>
Full article ">Figure 6
<p>Spectrum of the pure sinusoidal signal of <a href="#sensors-22-02403-f001" class="html-fig">Figure 1</a>, calculated from <math display="inline"><semantics> <mrow> <msubsup> <mrow> <mrow> <mo>{</mo> <mrow> <msub> <mover accent="true"> <mi>s</mi> <mo>^</mo> </mover> <mi>n</mi> </msub> <mo>,</mo> <msub> <mover accent="true"> <mi>τ</mi> <mo>^</mo> </mover> <mi>n</mi> </msub> </mrow> <mo>}</mo> </mrow> </mrow> <mrow> <mi>n</mi> <mo>=</mo> <mo>−</mo> <mn>550</mn> </mrow> <mrow> <mn>549</mn> </mrow> </msubsup> </mrow> </semantics></math>, where <math display="inline"><semantics> <mrow> <mo>{</mo> <msub> <mover accent="true"> <mi>s</mi> <mo>^</mo> </mover> <mi>n</mi> </msub> <mo>}</mo> </mrow> </semantics></math> are spline interpolated signal values on the computable uniform time grid <math display="inline"><semantics> <mrow> <msubsup> <mrow> <mrow> <mo>{</mo> <mrow> <msub> <mover accent="true"> <mi>τ</mi> <mo>^</mo> </mover> <mi>n</mi> </msub> </mrow> <mo>}</mo> </mrow> </mrow> <mrow> <mi>n</mi> <mo>=</mo> <mo>−</mo> <mn>550</mn> </mrow> <mrow> <mn>549</mn> </mrow> </msubsup> </mrow> </semantics></math>, Equation (4), based on the known sampled values <math display="inline"><semantics> <mrow> <mrow> <mo>{</mo> <mrow> <msub> <mi>s</mi> <mi>n</mi> </msub> </mrow> <mo>}</mo> </mrow> </mrow> </semantics></math> and their actual sampling instants <math display="inline"><semantics> <mrow> <msubsup> <mrow> <mrow> <mo>{</mo> <mrow> <msub> <mi>τ</mi> <mi>n</mi> </msub> </mrow> <mo>}</mo> </mrow> </mrow> <mrow> <mi>n</mi> <mo>=</mo> <mo>−</mo> <mn>550</mn> </mrow> <mrow> <mn>549</mn> </mrow> </msubsup> </mrow> </semantics></math>. Note the considerably lower harmonics, when compared with those of <a href="#sensors-22-02403-f003" class="html-fig">Figure 3</a>.</p>
Full article ">Figure 7
<p>Brillouin amplification in single-mode fibers. Pump light at an arbitrary frequency/wavelength, e.g., <math display="inline"><semantics> <mrow> <msub> <mi>λ</mi> <mi>B</mi> </msub> </mrow> </semantics></math> = 1550 nm, propagating in one direction in the fiber core generates narrowband gain for light propagating in the opposite direction. Gain is maximized when the frequency difference, <math display="inline"><semantics> <mrow> <msub> <mi>υ</mi> <mrow> <mi>p</mi> <mi>u</mi> <mi>m</mi> <mi>p</mi> </mrow> </msub> <mo>−</mo> <msub> <mi>υ</mi> <mrow> <mi>p</mi> <mi>r</mi> <mi>o</mi> <mi>b</mi> <mi>e</mi> </mrow> </msub> </mrow> </semantics></math>, equals the so-called Brillouin Frequency Shift, <math display="inline"><semantics> <mrow> <msub> <mi>υ</mi> <mrow> <mi>B</mi> <mi>F</mi> <mi>S</mi> </mrow> </msub> </mrow> </semantics></math>. For silica-based single-mode fibers around 1550 nm, <math display="inline"><semantics> <mrow> <msub> <mi>υ</mi> <mrow> <mi>B</mi> <mi>F</mi> <mi>S</mi> </mrow> </msub> </mrow> </semantics></math> is ~11 GHz and the Brillouin gain bandwidth is ~30 MHz for pulses longer than ~40 ns. Of crucial importance for sensing applications is the fact that <math display="inline"><semantics> <mrow> <msub> <mi>υ</mi> <mrow> <mi>B</mi> <mi>F</mi> <mi>S</mi> </mrow> </msub> </mrow> </semantics></math> is a function of both strain and temperature, mainly through the dependence of the local acoustic velocity, <math display="inline"><semantics> <mrow> <msub> <mi>V</mi> <mi>A</mi> </msub> <mo>,</mo> </mrow> </semantics></math> on these two measurands.</p>
Full article ">Figure 8
<p>A longitudinally vibrating fiber is interrogated by either an all-polarization-maintaining F-BOTDA setup, producing temporally non-uniform samples, or by a uniformly sampling white-light spectrometer-based interrogator that measures the response of an on-fiber FBG. The <math display="inline"><semantics> <mrow> <msub> <mi>λ</mi> <mi>B</mi> </msub> </mrow> </semantics></math> of the inscribed FBG is away from the Brillouin scanning region. AWG: Arbitrary Waveform Generator, RF: Radio frequency, SOA: Semiconductor Optical Amplifier/switch, EDFA: Erbium Doped Fiber Amplifier, ISO: Optical isolator, FBG: Fiber Bragg Grating inscribed on the FUT, PD: Photo diode, CIR: Circulator, EOM: Electro-Optic Modulator, LD: Narrowband Laser Diode, DAQ: Data Acquisition, VSG: Vector Signal Generator, ATT: Attenuator.</p>
Full article ">Figure 9
<p>Strain signal spectrum at 50 Hz longitudinal vibrations, interrogated by the spectrometer-based temporally uniform interrogator. Highest harmonic (at 100 Hz) is &gt;37 dB below the signal.</p>
Full article ">Figure 10
<p>(<b>Left</b>) Hamming-weighed FFT spectrum of raw BFS vs. time 50 Hz vibration data, obtained from the experimental setup of <a href="#sensors-22-02403-f008" class="html-fig">Figure 8</a>. The scan rate is 164 Hz, the scan range is 108 MHz and the vibration amplitude is 17 MHz, resulting in <math display="inline"><semantics> <mrow> <msub> <mi>f</mi> <mrow> <mi>s</mi> <mi>i</mi> <mi>g</mi> <mi>n</mi> <mi>a</mi> <mi>l</mi> </mrow> </msub> <mo>/</mo> <msub> <mi>f</mi> <mrow> <mi>s</mi> <mi>c</mi> <mi>a</mi> <mi>n</mi> </mrow> </msub> </mrow> </semantics></math> = 0.3 and <math display="inline"><semantics> <mrow> <msub> <mi>ν</mi> <mrow> <mi>s</mi> <mi>i</mi> <mi>g</mi> <mi>n</mi> <mi>a</mi> <mi>l</mi> <mo>−</mo> <mi>a</mi> <mi>m</mi> <mi>p</mi> </mrow> </msub> <mo>/</mo> <msubsup> <mi>ν</mi> <mrow> <mi>s</mi> <mi>c</mi> <mi>a</mi> <mi>n</mi> </mrow> <mrow> <mi>s</mi> <mi>p</mi> <mi>a</mi> <mi>n</mi> </mrow> </msubsup> </mrow> </semantics></math> = 0.16, respectively. Note the strong (−16.3 dB) second harmonic (dotted square), occurring at the folded frequency of 64 Hz (=164/2 − (2 × 50 − 164/2)). It is due to the fact the FFT algorithm implicitly treats its input temporally non-uniform data as uniform (The other peaks are folded higher harmonics). (<b>Right</b>) Using the measured instants of acquisition, <math display="inline"><semantics> <mrow> <msubsup> <mrow> <mrow> <mo>{</mo> <mrow> <msub> <mi>τ</mi> <mi>n</mi> </msub> </mrow> <mo>}</mo> </mrow> </mrow> <mrow> <mi>n</mi> <mo>=</mo> <mn>0</mn> </mrow> <mrow> <mi>N</mi> <mo>−</mo> <mn>1</mn> </mrow> </msubsup> </mrow> </semantics></math>, and the procedure of spline interpolation of <a href="#sec3-sensors-22-02403" class="html-sec">Section 3</a>, the second harmonic is significantly attenuated to −29 dB (dotted square). Record duration is 9 s.</p>
Full article ">Figure 11
<p>(<b>Left</b>) Hamming-weighed FFT spectrum of raw BFS vs. time 50 Hz vibration data, obtained from the experimental setup of <a href="#sensors-22-02403-f008" class="html-fig">Figure 8</a>. Here, the scan rate is 412 Hz, the scan range is 112 MHz and the vibration amplitude 17 MHz, resulting <math display="inline"><semantics> <mrow> <msub> <mi>f</mi> <mrow> <mi>s</mi> <mi>i</mi> <mi>g</mi> <mi>n</mi> <mi>a</mi> <mi>l</mi> </mrow> </msub> <mo>/</mo> <msub> <mi>f</mi> <mrow> <mi>s</mi> <mi>c</mi> <mi>a</mi> <mi>n</mi> </mrow> </msub> </mrow> </semantics></math> = 0.12 and <math display="inline"><semantics> <mrow> <msub> <mi>ν</mi> <mrow> <mi>s</mi> <mi>i</mi> <mi>g</mi> <mi>n</mi> <mi>a</mi> <mi>l</mi> <mo>−</mo> <mi>a</mi> <mi>m</mi> <mi>p</mi> </mrow> </msub> <mo>/</mo> <msubsup> <mi>ν</mi> <mrow> <mi>s</mi> <mi>c</mi> <mi>a</mi> <mi>n</mi> </mrow> <mrow> <mi>s</mi> <mi>p</mi> <mi>a</mi> <mi>n</mi> </mrow> </msubsup> </mrow> </semantics></math> = 0.15, respectively. Note the −26 dB second harmonic peak at 100 Hz (dotted square). While lower than the −16.3 dB one of <a href="#sensors-22-02403-f010" class="html-fig">Figure 10</a>, it is still higher than the spectrometer-based measurement of below −37 dB (The observed peaks are again folded high harmonics). (<b>Right</b>) Using the measured instants of acquisition, <math display="inline"><semantics> <mrow> <msubsup> <mrow> <mrow> <mo>{</mo> <mrow> <msub> <mi>τ</mi> <mi>n</mi> </msub> </mrow> <mo>}</mo> </mrow> </mrow> <mrow> <mi>n</mi> <mo>=</mo> <mn>0</mn> </mrow> <mrow> <mi>N</mi> <mo>−</mo> <mn>1</mn> </mrow> </msubsup> </mrow> </semantics></math>, and the procedure of spline interpolation of <a href="#sec3-sensors-22-02403" class="html-sec">Section 3</a>, the second harmonic is down to −44.7 dB (dotted square) but there is now a dominant harmonic at −31 dB. Record duration is 3.6 s.</p>
Full article ">Figure 12
<p>Setup for the CFBG experiment, using a polyimide-coated composite FUT. Taking advantage of the high spatial resolution of the CFBG interrogator (&lt;1 cm), a very short CFBG fiber is used. The coreless fiber segment, serving as a high insertion loss, bidirectional isolator, allows for the CFBG interrogation to be augmented by an independent and simultaneous uniformly triggered FBG interrogation of the FUT vibrations.</p>
Full article ">Figure 13
<p>Hamming-weighed FFT spectra of the strain of the vibrating fiber in <a href="#sensors-22-02403-f012" class="html-fig">Figure 12</a>, simultaneously measured by the two interrogators. The scaled vibration frequency and amplitude were <math display="inline"><semantics> <mrow> <mi>ξ</mi> <mo>=</mo> <msub> <mi>f</mi> <mrow> <mi>s</mi> <mi>i</mi> <mi>g</mi> <mi>n</mi> <mi>a</mi> <mi>l</mi> </mrow> </msub> <mo>/</mo> <msub> <mi>f</mi> <mrow> <mi>s</mi> <mi>c</mi> <mi>a</mi> <mi>n</mi> </mrow> </msub> <mo>=</mo> <mn>0.2</mn> </mrow> </semantics></math> and <math display="inline"><semantics> <mrow> <mi>η</mi> <mo>=</mo> <msub> <mi>ν</mi> <mrow> <mi>s</mi> <mi>i</mi> <mi>g</mi> <mi>n</mi> <mi>a</mi> <mi>l</mi> <mo>−</mo> <mi>a</mi> <mi>m</mi> <mi>p</mi> </mrow> </msub> <mo>/</mo> <msubsup> <mi>ν</mi> <mrow> <mi>s</mi> <mi>c</mi> <mi>a</mi> <mi>n</mi> </mrow> <mrow> <mi>s</mi> <mi>p</mi> <mi>a</mi> <mi>n</mi> </mrow> </msubsup> <mo>=</mo> <mn>0.38</mn> </mrow> </semantics></math>. (<b>Left</b>) Results from the uniformly triggered interrogator of <a href="#sec4-sensors-22-02403" class="html-sec">Section 4</a>. (<b>Right</b>) Results from the frequency-scanning CFG interrogator. While its noise level is higher, the peaks at 10 and 30 Hz are still barely seen (these &lt;−60 dB peaks are not folded harmonics, but are rather due to the insufficient spectral purity of the oscillator-shaker combination).</p>
Full article ">
9 pages, 1394 KiB  
Communication
A Study of the Detection of SARS-CoV-2 ORF1ab Gene by the Use of Electrochemiluminescent Biosensor Based on Dual-Probe Hybridization
by Chunying Jiang, Xihui Mu, Shuai Liu, Zhiwei Liu, Bin Du, Jiang Wang and Jianjie Xu
Sensors 2022, 22(6), 2402; https://doi.org/10.3390/s22062402 - 21 Mar 2022
Cited by 11 | Viewed by 2222
Abstract
To satisfy the need to develop highly sensitive methods for detecting the severe acute respiratory syndrome coronavirus type 2 (SARS-CoV-2) and further enhance detection efficiency and capability, a new method was created for detecting SARS-CoV-2 of the open reading frames 1ab (ORF1ab) target [...] Read more.
To satisfy the need to develop highly sensitive methods for detecting the severe acute respiratory syndrome coronavirus type 2 (SARS-CoV-2) and further enhance detection efficiency and capability, a new method was created for detecting SARS-CoV-2 of the open reading frames 1ab (ORF1ab) target gene by a electrochemiluminescence (ECL) biosensor based on dual-probe hybridization through the use of a detection model of “magnetic capture probes—targeted nucleic acids—Ru(bpy)32+ labeled signal probes”. The detection model used magnetic particles coupled with a biotin-labeled complementary nucleic acid sequence of the SARS-CoV-2 ORF1ab target gene as the magnetic capture probes and Ru(bpy)32+ labeled amino modified another complementary nucleic acid sequence as the signal probes, which combined the advantages of the highly specific dual-probe hybridization and highly sensitive ECL biosensor technology. In the range of 0.1 fM~10 µM, the method made possible rapid and sensitive detection of the ORF1ab gene of the SARS-CoV-2 within 30 min, and the limit of detection (LOD) was 0.1 fM. The method can also meet the analytical requirements for simulated samples such as saliva and urine with the definite advantages of a simple operation without nucleic acid amplification, high sensitivity, reasonable reproducibility, and anti-interference solid abilities, expounding a new way for efficient and sensitive detection of SARS-CoV-2. Full article
(This article belongs to the Section Biosensors)
Show Figures

Figure 1

Figure 1
<p>The schematic for detecting SARS-CoV-2 ORF1ab gene through the use of the ECL biosensor, based on dual-probe hybridization.</p>
Full article ">Figure 2
<p>Determination of the optimal immobilized amount of biotin probes on the surface of the magnetic particles.</p>
Full article ">Figure 3
<p>The UV–vis spectrum of the solution Ru(bpy)<sub>3</sub><sup>2+</sup>-NHS ester labeled the amino probes. Curve a is the spectrum of Ru(bpy)<sub>3</sub><sup>2+</sup>-NHS ester. Curve b is the spectrum of amino probes. Curve c is the spectrum of Ru(bpy)32+ labeled signal probes.</p>
Full article ">Figure 4
<p>(<b>a</b>) Standard curve of detecting different concentrations of the nucleic acid of SARS-CoV-2 using an ECL biosensor based on dual-probe hybridization. (<b>b</b>) The response curve of detecting different concentrations of the nucleic acid of SARS-CoV-2 using an ECL biosensor based on dual-probe hybridization.</p>
Full article ">Figure 5
<p>Response curves of detecting different viruses using an ECL biosensor based on dual-probe hybridization.</p>
Full article ">
19 pages, 4771 KiB  
Article
Development of a Novel Railway Positioning System Using RFID Technology
by Osama Olaby, Moussa Hamadache, David Soper, Phil Winship and Roger Dixon
Sensors 2022, 22(6), 2401; https://doi.org/10.3390/s22062401 - 21 Mar 2022
Cited by 11 | Viewed by 4657
Abstract
Currently, a number of positioning systems are in use to locate trains on the railway network; but these generally have limited precision. Thus, this paper focuses on testing and validating the suitability of radio frequency identification (RFID) technology, for aligning vehicles to switch [...] Read more.
Currently, a number of positioning systems are in use to locate trains on the railway network; but these generally have limited precision. Thus, this paper focuses on testing and validating the suitability of radio frequency identification (RFID) technology, for aligning vehicles to switch and crossing (S&C) positions on the railway network. This offers the possibility of accurately knowing the position of vehicles equipped with monitoring equipment, such as the network rail track recording vehicle (TRV), and aligning the data with reference to the locations of the S&C (and ideally to key elements within a particular S&C). The concept is to install two tags, one on the switch-toe sleeper and the second on the crossing-nose sleeper, with an RFID reader that will be installed underneath the vehicle. Thus, the key features of the S&C, the switch toe and crossing nose, will be considered as a definitive reference point for the inspection vehicle’s position. As a monitoring vehicle passes over a piece of S&C, the proposed positioning system will provide information about this S&C’s ID, which is stored inside the RFID tags and will indicate the S&C’s GPS coordinates. As part of the research in this paper, more than 400 tests have been performed to investigate two different RFID technologies, passive and semi-passive, tested in a variety of conditions: including different passage speeds, different distances between the RFID reader and the tags, and varied strength signal transmitted between the reader and the tags. Based on lab testing and analysis of the recorded data, it is concluded that passive RFID technology is the most suitable of the two technologies. The conclusions find that the proposed RFID-based solution can offer a more precise positioning solution to be a reference point for the train location within the network. Full article
Show Figures

Figure 1

Figure 1
<p>Layout of the complete positioning system, including the RFID subsystem, the data communication subsystem (DCS) and the asset information subsystem (AIS).</p>
Full article ">Figure 2
<p>A descriptive photo of the experimental demonstrator.</p>
Full article ">Figure 3
<p>A close-up view of the RFID antenna/reader and the tag(s). (<b>a</b>) Passive technology arrangements; (<b>b</b>) Semi-passive technology arrangement.</p>
Full article ">Figure 4
<p>The different carrying model vehicles and their attachments used in the testing lab. (<b>a</b>) Passive RFID tags attached to a small chassis; (<b>b</b>) Semi-passive RFID tags attached to a small chassis; (<b>c</b>) Two passive/semi-passive RFID tags attached to a long model vehicle (tags are uncovered); (<b>d</b>) Two passive/semi-passive RFID tags attached to a new long model vehicle (tags are covered with a plastic wagon model kit).</p>
Full article ">Figure 5
<p>Calculation method of the position accuracy.</p>
Full article ">Figure 6
<p>The Speedway software, the MultiReader, interface screenshot.</p>
Full article ">Figure 7
<p>The developed C# program interface screenshot.</p>
Full article ">Figure 8
<p>The semi-passive TRANSIT software “P81Test” interface screenshot.</p>
Full article ">Figure A1
<p>Plan view of the implementation environment showing the locations of the catapult, and the breaking/acceleration sections.</p>
Full article ">Figure A2
<p>Flowchart describing the measurement’s algorithm and position accuracy calculation.</p>
Full article ">
13 pages, 1238 KiB  
Article
An Integrated Millimeter-Wave Satellite Radiometer Working at Room-Temperature with High Photon Conversion Efficiency
by Kerlos Atia Abdalmalak, Gabriel Santamaria Botello, Mallika Irene Suresh, Enderson Falcón-Gómez, Alejandro Rivera Lavado and Luis Enrique García-Muñoz
Sensors 2022, 22(6), 2400; https://doi.org/10.3390/s22062400 - 21 Mar 2022
Cited by 4 | Viewed by 2945
Abstract
In this work, the design of an integrated 183GHz radiometer frontend for earth observation applications on satellites is presented. By means of the efficient electro-optic modulation of a laser pump with the observed millimeter-wave signal followed by the detection of the generated [...] Read more.
In this work, the design of an integrated 183GHz radiometer frontend for earth observation applications on satellites is presented. By means of the efficient electro-optic modulation of a laser pump with the observed millimeter-wave signal followed by the detection of the generated optical sideband, a room-temperature low-noise receiver frontend alternative to conventional Low Noise Amplifiers (LNAs) or Schottky mixers is proposed. Efficient millimeter-wave to 1550 nm upconversion is realized via a nonlinear optical process in a triply resonant high-Q Lithium Niobate (LN) Whispering Gallery Mode (WGM) resonator. By engineering a micromachined millimeter-wave cavity that maximizes the overlap with the optical modes while guaranteeing phase matching, the system has a predicted normalized photon-conversion efficiency 101 per mW pump power, surpassing the state-of-the-art by around three orders of magnitude at millimeter-wave frequencies. A piezo-driven millimeter-wave tuning mechanism is designed to compensate for the fabrication and assembly tolerances and reduces the complexity of the manufacturing process. Full article
(This article belongs to the Special Issue Application and Technology Trends in Optoelectronic Sensors)
Show Figures

Figure 1

Figure 1
<p>Photonic nonlinear upconversion process.</p>
Full article ">Figure 2
<p>Comparison between millimeter-wave and optical modes for the following: (<b>a</b>) a disk resonator; (<b>b</b>) the proposed metal-enclosed resonator. Figures not drawn to scale.</p>
Full article ">Figure 3
<p>The upconversion scheme with microstrip and prism for millimeter-wave and optical coupling, respectively.</p>
Full article ">Figure 4
<p>Ratio between reflected optical power to the incident one vs. resonator curvature radius.</p>
Full article ">Figure 5
<p>Frequency-dependent S-parameters showing millimeter-wave coupling to the resonator.</p>
Full article ">Figure 6
<p>The electric field distribution along the main scheme components with an input power of 1 W.</p>
Full article ">Figure 7
<p>Effect of fabrication tolerances in the resonator radius on resonance frequency.</p>
Full article ">Figure 8
<p>Tuning of the millimeter-wave resonance frequency by using a metallic movable ring.</p>
Full article ">Figure 9
<p>Overview of the integrated system.</p>
Full article ">Figure 10
<p>Coupling of the signals into the resonator in the upconversion scheme: left shows the millimeter-wave coupling structure only; right shows both millimeter-wave and optical.</p>
Full article ">
15 pages, 2840 KiB  
Article
Photoacoustic-MR Image Registration Based on a Co-Sparse Analysis Model to Compensate for Brain Shift
by Parastoo Farnia, Bahador Makkiabadi, Maysam Alimohamadi, Ebrahim Najafzadeh, Maryam Basij, Yan Yan, Mohammad Mehrmohammadi and Alireza Ahmadian
Sensors 2022, 22(6), 2399; https://doi.org/10.3390/s22062399 - 21 Mar 2022
Cited by 5 | Viewed by 2180
Abstract
Brain shift is an important obstacle to the application of image guidance during neurosurgical interventions. There has been a growing interest in intra-operative imaging to update the image-guided surgery systems. However, due to the innate limitations of the current imaging modalities, accurate brain [...] Read more.
Brain shift is an important obstacle to the application of image guidance during neurosurgical interventions. There has been a growing interest in intra-operative imaging to update the image-guided surgery systems. However, due to the innate limitations of the current imaging modalities, accurate brain shift compensation continues to be a challenging task. In this study, the application of intra-operative photoacoustic imaging and registration of the intra-operative photoacoustic with pre-operative MR images are proposed to compensate for brain deformation. Finding a satisfactory registration method is challenging due to the unpredictable nature of brain deformation. In this study, the co-sparse analysis model is proposed for photoacoustic-MR image registration, which can capture the interdependency of the two modalities. The proposed algorithm works based on the minimization of mapping transform via a pair of analysis operators that are learned by the alternating direction method of multipliers. The method was evaluated using an experimental phantom and ex vivo data obtained from a mouse brain. The results of the phantom data show about 63% improvement in target registration error in comparison with the commonly used normalized mutual information method. The results proved that intra-operative photoacoustic images could become a promising tool when the brain shift invalidates pre-operative MRI. Full article
(This article belongs to the Section Biomedical Sensors)
Show Figures

Figure 1

Figure 1
<p>Brain-mimicking phantom design and fabrication. (<b>a</b>) The dimensions of the phantom were about 150 × 40 mm, (<b>b</b>) a 3D model of the phantom including two simulated vessels with 1.2 and 1.4 mm inside diameters were inserted randomly into the phantom. (<b>c</b>) The cross-section of the phantom with vessels filled using two different contrast agents CuSO<sub>4</sub> (H<sub>2</sub>O)<sub>5</sub> and human blood.</p>
Full article ">Figure 2
<p>Schematic of the PA imaging setup, which includes a tunable pulsed laser and a programmable ultrasound data acquisition system.</p>
Full article ">Figure 3
<p>Ex vivo head of mouse data: (<b>a</b>) MR image and (<b>b</b>) PA image. Five registration targets are shown in red and blue markers in (<b>a</b>,<b>b</b>), respectively, to assess the performance of the registration algorithm [<a href="#B67-sensors-22-02399" class="html-bibr">67</a>].</p>
Full article ">Figure 4
<p>(<b>a</b>) Pre-operative MR image, (<b>b</b>) intra-operative MR image, and (<b>c</b>) brain deformation field was achieved by registration of intra-operative and pre-operative MR images using residual complexity method.</p>
Full article ">Figure 5
<p>The workflow for automatic multi-modal image registration to compensate for brain deformation. MR and PA images including pre-defined targets were set as a reference and float images, respectively. After applying brain deformation on PA images, registration of MR and deformed PA was conducted and evaluated.</p>
Full article ">Figure 6
<p>The results of multi-modal image registration of phantom data. First row: original image of phantom data before deformation from three different modalities: (<b>a</b>) MRI, (<b>b</b>) US, and (<b>c</b>) PA; second row: deformed images of (<b>d</b>) MRI, (<b>e</b>) US, and (<b>f</b>) PA. The third row shows the results of registered images of (<b>g</b>) MR-MR, (<b>h</b>) US-MR, and (<b>i</b>) PA-MR using the NMI algorithm. The last row shows the results of registered images of (<b>j</b>) MR-MR, (<b>k</b>) US-MR, and (<b>l</b>) PA-MR using JACSM. The blue arrows in the third and last rows represent the surface of the phantom in different modalities. Blue arrows A are related to the surface of the phantom in original MR images and blue arrows B are related to the surface of the phantom in deformed MR, deformed US, and deformed PA images. White arrows in (<b>i</b>,<b>l</b>) show that the PA-MR registration results for vessels were located in the depth of the phantom.</p>
Full article ">Figure 7
<p>The results of multi-modal image registration of mouse brain data: (<b>a</b>) MRI, (<b>b</b>) PA image, (<b>c</b>) PA image after applying non-linear deformation, and (<b>d</b>) registration of deformed PA and MRI of mouse data. Registration of MRI images before and after deformation was shown in (<b>e</b>) as a gold standard. Panel (<b>f</b>) shows the mean of RMSE, TRE, and HD of PA-MR image registration for all data of the mouse brain.</p>
Full article ">
19 pages, 438 KiB  
Article
Joint Resource Allocation in Secure OFDM Two-Way Untrusted Relay System
by Yifeng Jin, Xunan Li, Guocheng Lv, Meihui Zhao and Ye Jin
Sensors 2022, 22(6), 2398; https://doi.org/10.3390/s22062398 - 21 Mar 2022
Viewed by 1795
Abstract
The security issue of wireless communication is a common concern because of its broadcast nature, especially when the relay becomes an eavesdropper. In the orthogonal frequency division multiplexing (OFDM) relay system, when the relay is untrusted, the security of the system faces serious [...] Read more.
The security issue of wireless communication is a common concern because of its broadcast nature, especially when the relay becomes an eavesdropper. In the orthogonal frequency division multiplexing (OFDM) relay system, when the relay is untrusted, the security of the system faces serious threats. Although there exist some resource allocation schemes in a single-carrier system with untrusted relaying, it is difficult to apply them to the multi-carrier system. Hence, a resource allocation scheme for the multi-carrier system is needed. Compared to the one-way relay system, a two-way relay system can improve the data transmission efficiency. In this paper, we consider joint secure resource allocation for a two-way cooperative OFDM system with an untrusted relay. The joint resource allocation problem of power allocation and subcarrier pairing is formulated to maximize the sum secrecy rate of the system under individual power constraints. To solve the non-convex problem efficiently, we propose an algorithm based on the alternative optimization method. The proposed algorithm is evaluated by simulation results and compared with the benchmarks in the literature. According to the numerical results, in a high signal-to-noise ratio (SNR) scenario, the proposed algorithm improves the achievable sum secrecy rate of the system by more than 15% over conventional algorithms. Full article
(This article belongs to the Special Issue Security and Communication Networks)
Show Figures

Figure 1

Figure 1
<p>An OFDM two-way system with an untrusted relay. Solid lines: signal transmission on subcarriers in the first slot. Dashed lines: signal forward transmission on subcarriers in the second slot.</p>
Full article ">Figure 2
<p>Flowchart of the proposed algorithm.</p>
Full article ">Figure 3
<p>Sum secrecy rate versus transmit power per node when <span class="html-italic">N</span> = 16.</p>
Full article ">Figure 4
<p>Sum secrecy rate versus number of subcarriers when transmit power per node is 20 dBm.</p>
Full article ">Figure 5
<p>Allocated power versus index of subcarriers when transmit power per node is 20 dBm; <span class="html-italic">N</span> = 8.</p>
Full article ">Figure 6
<p>Sum secrecy rate versus distance from user <math display="inline"><semantics> <mi mathvariant="normal">A</mi> </semantics></math> to the relay <math display="inline"><semantics> <mi mathvariant="normal">R</mi> </semantics></math> when <span class="html-italic">N</span> = 16 and transmit power per node is 20 dBm.</p>
Full article ">Figure 7
<p>Sum secrecy rate versus transmit power of relay <math display="inline"><semantics> <mi mathvariant="normal">R</mi> </semantics></math> when <span class="html-italic">N</span> = 16 and transmit power of user nodes is 20 dBm.</p>
Full article ">
24 pages, 10918 KiB  
Review
Concise Historic Overview of Strain Sensors Used in the Monitoring of Civil Structures: The First One Hundred Years
by Branko Glisic
Sensors 2022, 22(6), 2397; https://doi.org/10.3390/s22062397 - 20 Mar 2022
Cited by 35 | Viewed by 4544
Abstract
Strain is one of the most frequently monitored parameters in civil structural health monitoring (SHM) applications, and strain-based approaches were among the first to be explored and applied in SHM. There are multiple reasons why strain plays such an important role in SHM: [...] Read more.
Strain is one of the most frequently monitored parameters in civil structural health monitoring (SHM) applications, and strain-based approaches were among the first to be explored and applied in SHM. There are multiple reasons why strain plays such an important role in SHM: strain is directly related to stress and deflection, which reflect structural performance, safety, and serviceability. Strain field anomalies are frequently indicators of unusual structural behaviors (e.g., damage or deterioration). Hence, the earliest concepts of strain sensing were explored in the mid-XIX century, the first effective strain sensor appeared in 1919, and the first onsite applications followed in the 1920′s. Today, one hundred years after the first developments, two generations of strain sensors, based on electrical and fiber-optic principles, firmly reached market maturity and established themselves as reliable tools applied in strain-based SHM. Along with sensor developments, the application methods evolved: the first generation of discrete sensors featured a short gauge length and provided a basis for local material monitoring; the second generation greatly extended the applicability and effectiveness of strain-based SHM by providing long gauge and one-dimensional (1D) distributed sensing, thus enabling global structural and integrity monitoring. Current research focuses on a third generation of strain sensors for two-dimensional (2D) distributed and quasi-distributed sensing, based on new advanced technologies. On the occasion of strain sensing centenary, and as an homage to all researchers, practitioners, and educators who contributed to strain-based SHM, this paper presents an overview of the first one hundred years of strain sensing technological progress, with the objective to identify relevant transformative milestones and indicate possible future research directions. Full article
(This article belongs to the Special Issue Section “Sensor Networks”: 10th Anniversary)
Show Figures

Figure 1

Figure 1
<p>Stress-related parameters (stress derivatives) inferred from long-term strain-based SHM of a real structure (Streicker Bridge): (<b>a</b>) loss of prestressing force over several years, and (<b>b</b>) distribution of prestressing force along the full length of the bridge and its comparison with design values (modified from the slides of the author’s university course CEE 537 Structural Health Monitoring).</p>
Full article ">Figure 2
<p>Deformed shapes (deflections) inferred from strain-based SHM (using trapezoid and rectangular rules for double integration of curvature) of a real structure (Streicker Bridge) and their comparison with numerical models: (<b>a</b>) due to removal of formworks during construction and (<b>b</b>) during load test of the bridge (modified from the slides of author’s university course CEE 537 Structural Health Monitoring).</p>
Full article ">Figure 3
<p>Damage detection and characterization using a strain-based SHM for a real structure (Streicker Bridge): (<b>a</b>) “jumps” in strain time series enable damage detection (crack occurrence) and quantification, (<b>b</b>) evaluation of residual crack size after two prestressing stages enables assessment of structural condition and performance (modified from the slides of author’s university course CEE 537 Structural Health Monitoring).</p>
Full article ">Figure 4
<p>Examples of modern strain gauges with different configurations: (<b>a</b>) ordinary strain gauge, (<b>b</b>) “rosette”—system of three strain gauges that can infer a 2D strain tensor, and (<b>c</b>) full-bridge strain gauge—system consisting of four resistors that specifically use differential measurement to perform thermal self-compensation (modified from the slides of author’s university course CEE 537 Structural Health Monitoring).</p>
Full article ">Figure 5
<p>(<b>a</b>) Schematic representation of an embeddable VW strain sensor designed by Davidenkoff (reprinted with permission from Ref. [<a href="#B3-sensors-22-02397" class="html-bibr">3</a>]. 1934. ASTM International) and examples of modern VW strain sensors: (<b>b</b>) embeddable, (<b>c</b>) two types of surface mounting, and (<b>d</b>) different packagings of surface mounting (top) and embeddable (bottom) VW strain sensors (photos courtesy of Roctest, Saint-Lambert, QC, Canada, <a href="http://www.roctest.com" target="_blank">www.roctest.com</a>, and Telemac, Gretz-Armanvilliers, France, <a href="http://www.telemac.fr" target="_blank">www.telemac.fr</a>, last accessed on 28 February 2022); sensor sizes in the figure are not to scale.</p>
Full article ">Figure 6
<p>(<b>a</b>) Schematic of an electrical telemeter and (<b>b</b>) view of closed and open packaging of an electrical telemeter [<a href="#B44-sensors-22-02397" class="html-bibr">44</a>].</p>
Full article ">Figure 7
<p>Schematic of the implementation of a monitoring system in Stevenson Creek Experimental Dam (image credit: The Stevenson Creek test dam (1925). Southern California Edison Collection of Photographs (photCL SCE), The Huntington Library, <a href="https://go.exlibris.link/461Zn0Q0" target="_blank">https://go.exlibris.link/461Zn0Q0</a>, last accessed on 28 February 2022).</p>
Full article ">Figure 8
<p>(<b>a</b>) View of the components of the Carlson strain meter ( Reprinted with permission from Ref. [<a href="#B45-sensors-22-02397" class="html-bibr">45</a>]. 1939. Massachusetts Institute of Technology – MIT), (<b>b</b>) modern packaging of the sensor, and (<b>c</b>) so-called “spider configuration” with multiple sensors enabling assessment of a 3D strain tensor (photos courtesy of: RST Instruments, Ltd., Maple Ridge, BC, Canada, <a href="http://www.rstinstruments.com" target="_blank">www.rstinstruments.com</a>, last accessed on 28 February 2022); sensor sizes in the figure are not to scale.</p>
Full article ">Figure 9
<p>(<b>a</b>) Example of experimental results of dependence of error in strain measurement in concrete as a function of the ratio between the gauge-length of sensor and the diameter of the aggregate and (<b>b</b>) example of experimental results that show a change in the strain at the location of the sensor due to cracking as a function of the distance between the sensor and the crack tip; the gauge length of the sensors was 5 mm (modified from the slides of author’s university course CEE 537 Structural Health Monitoring); markers in both figures represent measurements and dashed curves represent trendlines.</p>
Full article ">Figure 10
<p>Examples of discrete fiber optic strain sensors: (<b>a</b>) short-gauge EFPI sensor, (<b>b</b>) short-gauge FBG sensors, (<b>c</b>) long-gauge SOFO sensors, and (d) long-gauge intensity-based sensor (photos (<b>a</b>–<b>c</b>) courtesy of Roctest, Saint-Lambert, QC, Canada, <a href="http://www.roctest.com" target="_blank">www.roctest.com</a>, last accessed on 28 February 2022 and SMARTEC SA, Manno, Switzerland, <a href="http://www.smartec.ch" target="_blank">www.smartec.ch</a>, last accessed on 28 February 2022; photo (<b>d</b>) courtesy of OSMOS Group SA, Paris, France, <a href="https://www.osmos-group.com" target="_blank">https://www.osmos-group.com</a>, last accessed on 28 February 2022); sensor sizes in the figure are not to scale.</p>
Full article ">Figure 11
<p>Schematic representation of differences between (<b>a</b>) distributed sensing and (<b>b</b>) discrete sensing (with parallel multiplexing) of a large structure (modified from the slides of author’s university course CEE 537 Structural Health Monitoring).</p>
Full article ">Figure 12
<p>Examples of distributed fiber optic strain sensors: (<b>a</b>) tape sensor and (<b>b</b>) profile sensor (photos courtesy of SMARTEC SA, Manno, Switzerland, <a href="http://www.smartec.ch" target="_blank">www.smartec.ch</a>, last accessed on 28 February 2022), and (<b>c</b>) different types of distributed sensors installed on a pipeline specimen (modified from the slides of author’s university course CEE 537 Structural Health Monitoring); sensor sizes in the figure are not to scale.</p>
Full article ">Figure 13
<p>Example of a quasi-distributed 2D sensing sheet: (<b>a</b>) schematic of sensor components (modified from the slides of author’s university course CEE 537 Structural Health Monitoring), (<b>b</b>) prototype installed over a shrinkage crack on Streicker Bridge foundation (modified from [<a href="#B118-sensors-22-02397" class="html-bibr">118</a>]), and (<b>c</b>) results of measurements showing the crack opening over time (modified from [<a href="#B118-sensors-22-02397" class="html-bibr">118</a>]).</p>
Full article ">Figure 14
<p>(<b>a</b>) Examples of imaging (randomly selected) and (<b>b</b>) confusion matrix for the crack detection method using digital image processing based on convolutional neural networks [<a href="#B121-sensors-22-02397" class="html-bibr">121</a>].</p>
Full article ">Figure 15
<p>Condensed timeline of the development of strain sensors and strain-based sensing techniques used in the SHM of civil structures (modified from the slides of author’s university course CEE 537 Structural Health Monitoring).</p>
Full article ">Figure 16
<p>Progress in spatial coverage (gauge length) of strain sensors (modified from the slides of author’s university course CEE 537 Structural Health Monitoring); color-coding: green = mature; orange = mature in part, but research is still needed; red = under research and development (photos of FOSS in the image are courtesy of SMARTEC SA, Manno, Switzerland, <a href="http://www.smartec.ch" target="_blank">www.smartec.ch</a>, last accessed on 28 February 2022).</p>
Full article ">Figure 17
<p>Progress in damage detection capabilities of strain sensors and their transformative impact on the scale of applicability in SHM (modified from the slides of author’s university course CEE 537 Structural Health Monitoring).</p>
Full article ">
18 pages, 7473 KiB  
Article
Investigation of the Temperature Compensation of Piezoelectric Weigh-In-Motion Sensors Using a Machine Learning Approach
by Hailu Yang, Yue Yang, Yue Hou, Yue Liu, Pengfei Liu, Linbing Wang and Yuedong Ma
Sensors 2022, 22(6), 2396; https://doi.org/10.3390/s22062396 - 20 Mar 2022
Cited by 8 | Viewed by 2849
Abstract
Piezoelectric ceramics have good electromechanical coupling characteristics and a high sensitivity to load. One typical engineering application of piezoelectric ceramic is its use as a signal source for Weigh-In-Motion (WIM) systems in road traffic monitoring. However, piezoelectric ceramics are also sensitive to temperature, [...] Read more.
Piezoelectric ceramics have good electromechanical coupling characteristics and a high sensitivity to load. One typical engineering application of piezoelectric ceramic is its use as a signal source for Weigh-In-Motion (WIM) systems in road traffic monitoring. However, piezoelectric ceramics are also sensitive to temperature, which affects their measurement accuracy. In this study, a new piezoelectric ceramic WIM sensor was developed. The output signals of sensors under different loads and temperatures were obtained. The results were corrected using polynomial regression and a Genetic Algorithm Back Propagation (GA-BP) neural network algorithm, respectively. The results show that the GA-BP neural network algorithm had a better effect on sensor temperature compensation. Before and after GA-BP compensation, the maximum relative error decreased from about 30% to less than 4%. The sensitivity coefficient of the sensor reduced from 1.0192 × 10−2/°C to 1.896 × 10−4/°C. The results show that the GA-BP algorithm greatly reduced the influence of temperature on the piezoelectric ceramic sensor and improved its temperature stability and accuracy, which helped improve the efficiency of clean-energy harvesting and conversion. Full article
(This article belongs to the Section Electronic Sensors)
Show Figures

Figure 1

Figure 1
<p>Sensor structure diagram: (<b>a</b>) internal structure; (<b>b</b>) internal layout plan; (<b>c</b>) internal real layout.</p>
Full article ">Figure 2
<p>Prepared sensor samples SP-1 and SP-2.</p>
Full article ">Figure 3
<p>Schematic diagram of the performance measurement of piezoelectric materials: (<b>a</b>) Refrigerator; (<b>b</b>) Vacuum-drying oven; (<b>c</b>) PZT-4 Patchs; (<b>d</b>) ZJ-6A d<sub>33</sub>/d<sub>31</sub> measuring instrument; (<b>e</b>) UT603 capacitance inductance meter.</p>
Full article ">Figure 4
<p>Effects of temperature on the key parameters of Piezoelectric ceramic PZT-4: (<b>a</b>) the piezoelectric coefficient d<sub>33</sub>; (<b>b</b>) the capacity C<sub>p</sub>.</p>
Full article ">Figure 5
<p>Sensor load test: (<b>a</b>) test schematic; (<b>b</b>) loading and temperature control device; (<b>c</b>) data acquisition equipment.</p>
Full article ">Figure 6
<p>Gain adjustment of charge amplifier.</p>
Full article ">Figure 7
<p>Sensor output temperature characteristics. (<b>a</b>) SP-1; (<b>b</b>) SP-2.</p>
Full article ">Figure 8
<p>Relative error percentage of measurement at different temperatures: (<b>a</b>) SP-1; (<b>b</b>) SP-2.</p>
Full article ">Figure 9
<p>Neural network structure algorithm.</p>
Full article ">Figure 10
<p>Temperature-fitting surface: (<b>a</b>) SP-1 fitting surface; (<b>b</b>) SP-2 fitting surface.</p>
Full article ">Figure 11
<p>Structural diagram of the neural network.</p>
Full article ">Figure 12
<p>Comparison of predicted value and real value for the training samples.</p>
Full article ">Figure 13
<p>Comparison of relative errors of prediction results for the training samples.</p>
Full article ">Figure 14
<p>Curve of optimum fitness.</p>
Full article ">Figure 15
<p>Comparison of predicted values and real values for all samples.</p>
Full article ">Figure 16
<p>Comparison of relative errors of prediction results for all samples.</p>
Full article ">Figure 17
<p>Temperature characteristics after compensation: (<b>a</b>) SP-1 output after compensation; (<b>b</b>) SP-2 output after compensation.</p>
Full article ">Figure 18
<p>Error percentage at different temperatures after compensation: (<b>a</b>) SP-1; (<b>b</b>) SP-2.</p>
Full article ">Figure 19
<p>Average relative error before and after compensation.</p>
Full article ">
11 pages, 2462 KiB  
Communication
Diagnosis of Partial Discharge Based on the Air Components for the 10 kV Air-Insulated Switchgear
by Qipeng Tan, Tiandong Zhang, Shaocheng Wu, Jiachen Gao and Bin Song
Sensors 2022, 22(6), 2395; https://doi.org/10.3390/s22062395 - 20 Mar 2022
Cited by 6 | Viewed by 2650
Abstract
Partial discharge (PD) is a common phenomenon of insulation aging in air-insulated switchgear and will change the gas composition in the equipment. However, it is still a challenge to diagnose and identify the defect types of PD. This paper conducts enclosed experiments based [...] Read more.
Partial discharge (PD) is a common phenomenon of insulation aging in air-insulated switchgear and will change the gas composition in the equipment. However, it is still a challenge to diagnose and identify the defect types of PD. This paper conducts enclosed experiments based on gas sensors to obtain the concentration data of the characteristic gases CO, NO2, and O3 under four typical defects. The random forest algorithm with grid search optimization is used for fault identification to explore a method of identifying defect types through gas concentration. The results show that the gases concentration variations do have statistical characteristics, and the RF algorithm can achieve high accuracy in prediction. The combination of a sensor and a machine learning algorithm provides the gas component analysis method a way to diagnose PD in an air-insulated switchgear. Full article
(This article belongs to the Special Issue Sensors for Measurements and Diagnostic in Electrical Power Systems)
Show Figures

Figure 1

Figure 1
<p>Experiment Platform: (<b>a</b>) schematic diagram of the experiment platform; (<b>b</b>) layout of the experiment platform.</p>
Full article ">Figure 2
<p>Four types of simulated defects: (<b>a</b>) metal protrusion, (<b>b</b>) air gap between the metal conductor and the insulator, (<b>c</b>) pollution on the insulator surface, and (<b>d</b>) charged metal particles.</p>
Full article ">Figure 3
<p>The volume fraction of characteristic gases over time: (<b>a</b>) metal protrusion, (<b>b</b>) air gap between the metal conductor and the insulator, (<b>c</b>) pollution on the insulator surface, and (<b>d</b>) charged metal particles.</p>
Full article ">Figure 4
<p>The framework of the algorithm and the optimization process.</p>
Full article ">Figure 5
<p>Generation of test set decision tree.</p>
Full article ">Figure 6
<p>Performance of random forest classifier.</p>
Full article ">
17 pages, 62958 KiB  
Article
Phase Optimization for Multipoint Haptic Feedback Based on Ultrasound Array
by Zhili Long, Shuyuan Ye, Zhao Peng, Yuyang Yuan and Zhuohua Li
Sensors 2022, 22(6), 2394; https://doi.org/10.3390/s22062394 - 20 Mar 2022
Viewed by 2131
Abstract
Ultrasound-based haptic feedback is a potential technology for human–computer interaction (HCI) with the advantages of a low cost, low power consumption and a controlled force. In this paper, phase optimization for multipoint haptic feedback based on an ultrasound array was investigated, and the [...] Read more.
Ultrasound-based haptic feedback is a potential technology for human–computer interaction (HCI) with the advantages of a low cost, low power consumption and a controlled force. In this paper, phase optimization for multipoint haptic feedback based on an ultrasound array was investigated, and the corresponding experimental verification is provided. A mathematical model of acoustic pressure was established for the ultrasound array, and then a phase-optimization model for an ultrasound transducer was constructed. We propose a pseudo-inverse (PINV) algorithm to accurately determine the phase contribution of each transducer in the ultrasound array. By controlling the phase difference of the ultrasound array, the multipoint focusing forces were formed, leading to various shapes such as geometries and letters, which can be visualized. Because the unconstrained PINV solution results in unequal amplitudes for each transducer, a weighted amplitude iterative optimization was deployed to further optimize the phase solution, by which the uniform amplitude distributions of each transducer were obtained. For the purpose of experimental verification, a platform of ultrasound haptic feedback consisting of a Field Programmable Gate Array (FPGA), an electrical circuit and an ultrasound transducer array was prototyped. The haptic performances of a single point, multiple points and dynamic trajectory were verified by controlling the ultrasound force exerted on the liquid surface. The experimental results demonstrate that the proposed phase-optimization model and theoretical results are effective and feasible, and the acoustic pressure distribution is consistent with the simulation results. Full article
(This article belongs to the Special Issue Biological, Liquid and Gas Sensors Based on Piezoelectric Resonators)
Show Figures

Figure 1

Figure 1
<p><span class="html-italic">N × N</span> ultrasound transducer array.</p>
Full article ">Figure 2
<p>Simulation of single focal point. (<b>a</b>,<b>b</b>) are the phase difference distribution of each transducer. (<b>c</b>) is the normalized ultrasound pressure distribution.</p>
Full article ">Figure 3
<p>Simulation of multipoint focusing. (<b>a</b>–<b>d</b>) show the desired points, phase difference distribution, amplitude distribution and the RMS values of the ultrasound pressure, respectively.</p>
Full article ">Figure 4
<p>Simulation for complex geometries. (<b>a</b>) is the desired focal geometries arranged in the forms of circle, rectangle and triangle, respectively. (<b>b</b>–<b>d</b>) present the corresponding phase difference distribution, amplitude distribution and ultrasound pressure distribution, respectively.</p>
Full article ">Figure 5
<p>Simulation for letters H, I and T. (<b>a</b>) demonstrates the desired focal letters of H, I and T, respectively. (<b>b</b>–<b>d</b>) show the corresponding phase distribution, amplitude distribution and ultrasound pressure distribution, respectively.</p>
Full article ">Figure 5 Cont.
<p>Simulation for letters H, I and T. (<b>a</b>) demonstrates the desired focal letters of H, I and T, respectively. (<b>b</b>–<b>d</b>) show the corresponding phase distribution, amplitude distribution and ultrasound pressure distribution, respectively.</p>
Full article ">Figure 6
<p>Iterative optimization for uniform amplitude. (<b>a</b>) Amplitude with 0 iterations (without optimization). (<b>b</b>) Amplitude with 1 iterations. (<b>c</b>) Amplitude with 3 iterations. (<b>d</b>) Amplitude with 7 iterations.</p>
Full article ">Figure 7
<p>Ultrasound pressure distributions without and with optimization. (<b>a</b>) Without optimization. (<b>b</b>) With optimization.</p>
Full article ">Figure 8
<p>Pressure amplitude comparison with and without optimization. (<b>a</b>) is the ultrasound pressure distribution without optimization, and (<b>b</b>) is the result with optimization.</p>
Full article ">Figure 9
<p>Experimental platform. (<b>a</b>) is the implementation procedure for the ultrasound haptic feedback from simulations in experiments. (<b>b</b>) shows the hardware architecture of the ultrasound control system. (<b>c</b>) shows that the transducer arrays are triggered in a certain phase sequence.</p>
Full article ">Figure 10
<p>Single-point haptic feedback. (<b>a</b>) Liquid surface of single-point focus. (<b>b</b>) Haptic sensing to the palm.</p>
Full article ">Figure 11
<p>Dynamic movement of the ultrasound focal force.</p>
Full article ">Figure 12
<p>Ultrasound pressure with multiple points on liquid surface. (<b>a</b>) Desired two-point focuses. (<b>b</b>) Desired three-point focuses. (<b>c</b>) Two-point pressure distribution. (<b>d</b>) Three-point pressure distribution.</p>
Full article ">Figure 13
<p>Ultrasound pressure with geometric shapes on liquid surface. (<b>a</b>) Line. (<b>b</b>) Circle. (<b>c</b>) Rectangle. (<b>d</b>) Triangle.</p>
Full article ">Figure 14
<p>Dynamic rectangular partial continuous trajectory.</p>
Full article ">
Previous Issue
Next Issue
Back to TopTop