Search Results (368)

In response to the challenges of bearing fault diagnosis under small sample sizes and variable operating conditions, this paper proposes a novel method based on the two-dimensional analysis of vibration acceleration signals and a Multi-Task Conditional Generative Adversarial Network (MTC-GAN). This method first constructs two-dimensional images of vibration signals by leveraging the physical properties of the bearing acceleration signals and employs Local Binary Patterns (LBP) to extract subtle texture features from these images, thereby generating fault feature signatures with high discriminative power across different operating conditions. Subsequently, MTC-GAN is utilized for data augmentation, and the trained discriminator is used to perform fault classification tasks, improving classification accuracy under conditions with small sample sizes. Experimental results demonstrate that the proposed method achieves excellent fault diagnosis accuracy and robustness under both small sample sizes and varying operating conditions. Compared to traditional methods, this approach exhibits higher efficiency and reliability in handling complex operating conditions and data scarcity. Full article

In order to solve the problems of a high mismatching rate and being easily affected by noise and gray transformation, an improved product defect detection method combining centroid distance and textural information is proposed in this paper. Based on image preprocessing, the improved fuzzy C-means clustering method is used to extract the closed contour features. Then, the contour center distance description operator is used for bidirectional matching, and a robust coarse matching contour pair is obtained. After the coarse matching contour pair is screened, the refined matching result is obtained by using the improved local binary pattern operator. Finally, by comparing whether the number of fine matching pairs is consistent with the number of template outlines, the detection of good and bad industrial products is realized, and the closed contour extraction experiment, the anti-rotation matching experiment, the anti-gray difference matching experiment, and the defect detection experiment of three different products are designed. The experimental results show that the improved product defect detection method has good performance in relation to anti-rotation transformation and anti-gray difference, the detection accuracy can reach more than 90%, and the detection time is up to 362.6 ms, which can meet the requirements of industrial real-time detection. Full article

The biomedical imaging field has grown enormously in the past decade. In the era of digitization, the demand for computer-assisted diagnosis is increasing day by day. The COVID-19 pandemic further emphasized how retrieving meaningful information from medical repositories can aid in improving the quality of patient’s diagnosis. Therefore, content-based retrieval of medical images has a very prominent role in fulfilling our ultimate goal of developing automated computer-assisted diagnosis systems. Therefore, this paper presents a content-based medical image retrieval system that extracts multi-resolution, noise-resistant, rotation-invariant texture features in the form of a novel pattern descriptor, i.e., $MsNrRiTxP$, from medical images. In the proposed approach, the input medical image is initially decomposed into three neutrosophic images on its transformation into the neutrosophic domain. Afterwards, three distinct pattern descriptors, i.e., $MsTrP$, $NrTxP$, and $RiTxP$, are derived at multiple scales from the three neutrosophic images. The proposed $MsNrRiTxP$ pattern descriptor is obtained by scale-wise concatenation of the joint histograms of $MsTrP\times RiTxP$ and $NrTxP\times RiTxP$. To demonstrate the efficacy of the proposed system, medical images of different modalities, i.e., CT and MRI, from four test datasets are considered in our experimental setup. The retrieval performance of the proposed approach is exhaustively compared with several existing, recent, and state-of-the-art local binary pattern-based variants. The retrieval rates obtained by the proposed approach for the noise-free and noisy variants of the test datasets are observed to be substantially higher than the compared ones. Full article

Background: In recent years, computational aesthetics and neuroaesthetics have provided novel insights into understanding beauty. Building upon the findings of traditional aesthetics, this study aims to combine these two research methods to explore an interdisciplinary approach to studying aesthetics. Method: Abstract artworks were used as experimental materials. Based on traditional aesthetics and in combination, features of composition, tone, and texture were selected. Computational aesthetic methods were then employed to correspond these features to physical quantities: blank space, gray histogram, Gray Level Co-occurrence Matrix (GLCM), Local Binary Pattern (LBP), and Gabor filters. An electroencephalogram (EEG) experiment was carried out, in which participants conducted aesthetic evaluations of the experimental materials in different contexts (genuine, fake), and their EEG data were recorded to analyze the impact of various feature classes in the aesthetic evaluation process. Finally, a Support Vector Machines (SVMs) was utilized to model the feature data, Event-Related Potentials (ERPs), context data, and subjective aesthetic evaluation data. Result: Behavioral data revealed higher aesthetic ratings in the genuine context. ERP data indicated that genuine contexts elicited more negative deflections in the prefrontal lobes between 200 and 1000 ms. Class II compositions demonstrated more positive deflections in the parietal lobes at 50–120 ms, while Class I tones evoked more positive amplitudes in the occipital lobes at 200–300 ms. Gabor features showed significant variations in the parieto-occipital area at an early stage. Class II LBP elicited a prefrontal negative wave with a larger amplitude. The results of the SVM models indicated that the model incorporating aesthetic subject and context data (ACC = 0.76866) outperforms the model using only parameters of the aesthetic object (ACC = 0.68657). Conclusion: A positive context tends to provide participants with a more positive aesthetic experience, but abstract artworks may not respond to this positivity. During aesthetic evaluation, the ERP data activated by different features show a trend from global to local. The SVM model based on multimodal data fusion effectively predicts aesthetics, further demonstrating the feasibility of the combined research approach of computational aesthetics and neuroaesthetics. Full article

In recent years, significant progress has been made in facial expression recognition methods. However, tasks related to facial expression recognition in real environments still require further research. This paper proposes a tri-cross-attention transformer with a multi-feature fusion network (TriCAFFNet) to improve facial expression recognition performance under challenging conditions. By combining LBP (Local Binary Pattern) features, HOG (Histogram of Oriented Gradients) features, landmark features, and CNN (convolutional neural network) features from facial images, the model is provided with a rich input to improve its ability to discern subtle differences between images. Additionally, tri-cross-attention blocks are designed to facilitate information exchange between different features, enabling mutual guidance among different features to capture salient attention. Extensive experiments on several widely used datasets show that our TriCAFFNet achieves the SOTA performance on RAF-DB with 92.17%, AffectNet (7 cls) with 67.40%, and AffectNet (8 cls) with 63.49%, respectively. Full article

Despite the significant advancements facilitated by previous research in introducing a plethora of retinal biomarkers, there is a lack of research addressing the clinical need for quantifying different biomarkers and prioritizing their importance for guiding clinical decision making in the context of retinal diseases. To address this issue, our study introduces a novel framework for quantifying biomarkers derived from optical coherence tomography (OCT) and optical coherence tomography angiography (OCTA) images in retinal diseases. We extract 452 feature parameters from five feature types, including local binary patterns (LBP) features of OCT and OCTA, capillary and large vessel features, and the foveal avascular zone (FAZ) feature. Leveraging this extensive feature set, we construct a classification model using a statistically relevant p value for feature selection to predict retinal diseases. We obtain a high accuracy of 0.912 and F1-score of 0.906 in the task of disease classification using this framework. We find that OCT and OCTA’s LBP features provide a significant contribution of 77.12% to the significance of biomarkers in predicting retinal diseases, suggesting their potential as latent indicators for clinical diagnosis. This study employs a quantitative analysis framework to identify potential biomarkers for retinal diseases in OCT and OCTA images. Our findings suggest that LBP parameters, skewness and kurtosis values of capillary, the maximum, mean, median, and standard deviation of large vessel, as well as the eccentricity, compactness, flatness, and anisotropy index of FAZ, may serve as significant indicators of retinal conditions. Full article

This study presents the development and validation of a robust semi-supervised learning framework specifically designed for the automated segmentation and classification of sandstone thin section images from the Yanchang Formation in the Ordos Basin. Traditional geological image analysis methods encounter significant challenges due to the labor-intensive and error-prone nature of manual labeling, compounded by the diversity and complexity of rock thin sections. Our approach addresses these challenges by integrating the GL-SLIC algorithm, which combines Gabor filters and Local Binary Patterns for effective superpixel segmentation, laying the groundwork for advanced component identification. The primary innovation of this research is the semi-supervised learning model that utilizes a limited set of manually labeled samples to generate high-confidence pseudo labels, thereby significantly expanding the training dataset. This methodology effectively tackles the critical challenge of insufficient labeled data in geological image analysis, enhancing the model’s generalization capability from minimal initial input. Our framework improves segmentation accuracy by closely aligning superpixels with the intricate boundaries of mineral grains and pores. Additionally, it achieves substantial improvements in classification accuracy across various rock types, reaching up to 96.3% in testing scenarios. This semi-supervised approach represents a significant advancement in computational geology, providing a scalable and efficient solution for detailed petrographic analysis. It not only enhances the accuracy and efficiency of geological interpretations but also supports broader hydrocarbon exploration efforts. Full article

The analysis of ground-penetrating radar (GPR) data is of vital importance for detecting various subsurface features that might manifest as hyperbolic peaks, which are indicators of a buried object or grayscale variation in the case of contrast in the soil texture. This method focuses on identifying exaggerated patterns through a series of image-processing steps. Two GPR images are initially read and preprocessed by extracting channels, flipping, and resizing. Then, specific regions of interest (ROIs) are cropped, and the Fourier transform is further applied to turn them into the frequency domain. With the help of their frequency signatures, these patterns are extracted from the images, and binary masks are constructed to obtain features of interest. These masked images were reconstructed and merged to make hyperbolic features visible. Finally, Local Binary Pattern (LBP) analysis is used to emphasize these hyperbolic peaks, thereby facilitating their recognition across the whole image. The proposed approach improves the detection of performance subsurface features in GPR data; hence, it is an important tool for geophysical surveys and other related applications. The results prove the high performance of the proposed procedure in improving GPR image characteristics. Full article

The exponential increase in waste generation is a significant global challenge with serious implications. Addressing this issue necessitates the enhancement of waste management processes. This study introduces a method that improves waste separation by integrating learning models at various levels. The method begins with the creation of image features as a new matrix using the Multi-Scale Local Binary Pattern (MLBP) technique. This technique optimally represents features and patterns across different scales. Following this, an ensemble model at the first level merges two Convolutional Neural Network (CNN) models, with each model performing the detection operation independently. A second-level CNN model is then employed to obtain the final output. This model uses the information from the first-level models and combines these features to perform a more accurate detection. The study’s novelty lies in the use of a second-level CNN model in the proposed ensemble system for fusing the results obtained from the first level, replacing conventional methods such as voting and averaging. Additionally, the study employs an MLBP feature selection approach for a more accurate description of the HW image features. It uses the Simulated Annealing (SA) algorithm for fine-tuning the hyperparameters of the CNN models, thereby optimizing the system’s performance. Based on the accuracy metric, the proposed method achieved an accuracy of 99.01% on the TrashNet dataset and 99.41% on the HGCD dataset. These results indicate a minimum improvement of 0.48% and 0.36%, respectively, compared to the other methods evaluated in this study. Full article

Texture recognition is a pivotal task in computer vision, crucial for applications in material sciences, medicine, and agriculture. Leveraging advancements in Deep Neural Networks (DNNs), researchers seek robust methods to discern intricate patterns in images. In the context of the burgeoning Tactile Internet (TI), efficient texture recognition algorithms are essential for real-time applications. This paper introduces a method named Local Binary Convolution Network with Intra-class Normalization (LBCNIN) for texture recognition. Incorporating features from the last layer of the backbone, LBCNIN employs a non-trainable Local Binary Convolution (LBC) layer, inspired by Local Binary Patterns (LBP), without fine-tuning the backbone. The encoded feature vector is fed into a linear Support Vector Machine (SVM) for classification, serving as the only trainable component. In the context of TI, the availability of images from multiple views, such as in 3D object semantic segmentation, allows for more data per object. Consequently, LBCNIN processes batches where each batch contains images from the same material class, with batch normalization employed as an intra-class normalization method, aiming to produce better results than single images. Comprehensive evaluations across texture benchmarks demonstrate LBCNIN’s ability to achieve very good results under different resource constraints, attributed to the variability in backbone architectures. Full article

The laser welding of magnesium alloys presents challenges attributed to their low laser-absorbing efficiency, resulting in instabilities during the welding process and substandard welding quality. Furthermore, the complexity of signals during laser welding processes makes it difficult to accurately monitor the molten state of magnesium alloys. In this study, magnesium alloys were welded using near-infrared and blue lasers. By varying the power of the near-infrared laser, the energy absorption pattern of magnesium alloys toward the composite laser was investigated. The U-Net model was employed for the segmentation of welding images to accurately extract the features of the melt pool and keyhole. Subsequently, the penetrating states were predicted using the convolutional neural network (CNN), and the novel approach employing Local Binary Pattern (LBP) features + a backpropagation (BP) neural network was applied for comparison. The extracted images achieved MPA and MIoU values of 89.54% and 81.81%, and the prediction accuracy of the model can reach up to 100%. The applicability of the two monitoring approaches in different scenarios was discussed, providing guidance for the quality of magnesium welding. Full article

Understanding the feeding dynamics of aquatic animals is crucial for aquaculture optimization and ecosystem management. This paper proposes a novel framework for analyzing fish feeding behavior based on a fusion of spectrogram-extracted features and deep learning architecture. Raw audio waveforms are first transformed into Log Mel Spectrograms, and a fusion of features such as the Discrete Wavelet Transform, the Gabor filter, the Local Binary Pattern, and the Laplacian High Pass Filter, followed by a well-adapted deep model, is proposed to capture crucial spectral and spectral information that can help distinguish between the various forms of fish feeding behavior. The Involutional Neural Network (INN)-based deep learning model is used for classification, achieving an accuracy of up to 97% across various temporal segments. The proposed methodology is shown to be effective in accurately classifying the feeding intensities of Oplegnathus punctatus, enabling insights pertinent to aquaculture enhancement and ecosystem management. Future work may include additional feature extraction modalities and multi-modal data integration to further our understanding and contribute towards the sustainable management of marine resources. Full article

Glaucoma is a chronic eye condition that seriously impairs vision and requires early diagnosis and treatment. Automated detection techniques are essential for obtaining a timely diagnosis. In this paper, we propose a novel method for feature selection that integrates the cuckoo search algorithm with Caputo fractional order (CFO-CS) to enhance the performance of glaucoma classification. However, when using the infinite series, the Caputo definition has memory length truncation issues. Therefore, we suggest a fixed memory step and an adjustable term count for optimization. We conducted experiments integrating various feature extraction techniques, including histograms of oriented gradients (HOGs), local binary patterns (LBPs), and deep features from MobileNet and VGG19, to create a unified vector. We evaluate the informative features selected from the proposed method using the k-nearest neighbor. Furthermore, we use data augmentation to enhance the diversity and quantity of the training set. The proposed method enhances convergence speed and the attainment of optimal solutions during training. The results demonstrate superior performance on the test set, achieving 92.62% accuracy, 94.70% precision, 93.52% F1-Score, 92.98% specificity, 92.36% sensitivity, and 85.00% Matthew’s correlation coefficient. The results confirm the efficiency of the proposed method, rendering it a generalizable and applicable technique in ophthalmology. Full article

In order to effectively protect and verify the copyright information of multimedia digital works, this paper proposes a zero-watermarking algorithm based on carrier image feature point descriptors. The constructed feature matrix of this algorithm consists of two parts: the feature descriptor vector calculated from scale-invariant feature reconstruction transform (SIFRT) and the multi-radius local binary pattern (MrLBP) descriptor vector. The algorithm performs a standardization, feature decomposition, and redundancy reduction on the traditional keypoint descriptor matrix, combines it with the texture feature matrix, and achieves the dimensional matching of copyright information. The advantage of this algorithm lies in its non-modification of the original data. Compared to computing global features, the local features computed from a subset of key points reduce the amount of attack interference introduced during copyright verification, thereby reducing the number of erroneous pixel values that are introduced. The algorithm introduces a timestamp mechanism when uploading the generated zero-watermarking image to a third-party copyright center, preventing subsequent tampering. Experimental data analysis demonstrates that the algorithm exhibits good discriminability, security, and robustness. Full article

Partial discharge (PD) is a crucial and intricate electrical occurrence observed in various types of electrical equipment. Identifying and characterizing PDs is essential for upholding the integrity and reliability of electrical assets. This paper proposes an ensemble methodology aiming to strike a balance between the model complexity and the predictive performance in PD pattern recognition. A simple convolutional neural network (SCNN) was constructed to efficiently decrease the model parameters (quantities). A quadratic support vector machine (QSVM) was established and ensembled with the SCNN model to effectively improve the PD recognition accuracy. The input for QSVM consisted of the circular local binary pattern (CLBP) extracted from the enhanced image. A testing prototype with three types of PD was constructed and 3D phase-resolved pulse sequence (PRPS) spectrograms were measured and recorded by ultra-high frequency (UHF) sensors. The proposed methodology was compared with three existing lightweight CNNs. The experiment results from the collected dataset emphasize the benefits of the proposed method, showcasing its advantages in high recognition accuracy and relatively few mode parameters, thereby rendering it more suitable for PD pattern recognition on resource-constrained devices. Full article