Submit to Entropy Review for Entropy Propose a Special Issue

Journal Menu

Journal Browser

Selected Papers from 5th International Electronic Conference on Entropy and Its Applications

Special Issue Editors
Special Issue Information
Benefits of Publishing in a Special Issue
Published Papers

A special issue of Entropy (ISSN 1099-4300). This special issue belongs to the section "Multidisciplinary Applications".

Deadline for manuscript submissions: closed (30 April 2020) | Viewed by 31398

Share This Special Issue

Special Issue Editor

Prof. Dr. Geert Verdoolaege

E-Mail Website
Guest Editor

Research Unit Nuclear Fusion, Department of Applied Physics, Ghent University, Sint-Pietersnieuwstraat 41, B-9000 Ghent, Belgium
Interests: probability theory; Bayesian inference; machine learning; information geometry; differential geometry; nuclear fusion; plasma physics; plasma turbulence; continuum mechanics; statistical mechanics
Special Issues, Collections and Topics in MDPI journals

Special Issue Information

Dear Colleagues,

The 5^th International Electronic Conference on Entropy and Its Applications (ECEA-5) is organized by Entropy from November 18 to 30, 2019 and hosted on the MDPI Sciforum platform. A broad range of topics is discussed concerning theory and applications related to the interdisciplinary concept of Entropy.
All conference contributors, both to oral and poster sessions, are encouraged to submit a full paper related to their contribution to this Special Issue of Entropy, with 20% discount on the APC charges. The Special Issue will maintain the topical subdivision of the conference in the following six fields:

Thermodynamics and Statistical Physics
Information Theory, Probability, Statistics and Artificial Intelligence
Quantum Information and Quantum Computing
Complex Systems
Biological Systems
Astrophysics, Cosmology and Black Holes

For more information about the topics, please visit the conference website: https://sciforum.net/conference/ecea-5.
We are looking forward to receiving your manuscript.

Prof. Dr. Geert Verdoolaege
Guest Editor

Manuscript Submission Information

Manuscripts should be submitted online at www.mdpi.com by registering and logging in to this website. Once you are registered, click here to go to the submission form. Manuscripts can be submitted until the deadline. All submissions that pass pre-check are peer-reviewed. Accepted papers will be published continuously in the journal (as soon as accepted) and will be listed together on the special issue website. Research articles, review articles as well as short communications are invited. For planned papers, a title and short abstract (about 100 words) can be sent to the Editorial Office for announcement on this website.

Submitted manuscripts should not have been published previously, nor be under consideration for publication elsewhere (except conference proceedings papers). All manuscripts are thoroughly refereed through a single-blind peer-review process. A guide for authors and other relevant information for submission of manuscripts is available on the Instructions for Authors page. Entropy is an international peer-reviewed open access monthly journal published by MDPI.

Please visit the Instructions for Authors page before submitting a manuscript. The Article Processing Charge (APC) for publication in this open access journal is 2600 CHF (Swiss Francs). Submitted papers should be well formatted and use good English. Authors may use MDPI's English editing service prior to publication or during author revisions.

Benefits of Publishing in a Special Issue

Ease of navigation: Grouping papers by topic helps scholars navigate broad scope journals more efficiently.
Greater discoverability: Special Issues support the reach and impact of scientific research. Articles in Special Issues are more discoverable and cited more frequently.
Expansion of research network: Special Issues facilitate connections among authors, fostering scientific collaborations.
External promotion: Articles in Special Issues are often promoted through the journal's social media, increasing their visibility.
e-Book format: Special Issues with more than 10 articles can be published as dedicated e-books, ensuring wide and rapid dissemination.

Further information on MDPI's Special Issue policies can be found here.

Published Papers (6 papers)

Download All Papers

Order results

Result details

Show export options Show export options

Select all

Export citation of selected articles as:

Research

16 pages, 3213 KiB

Open AccessArticle

Skyrmions and Spin Waves in Magneto–Ferroelectric Superlattices

by Ildus F. Sharafullin and Hung T. Diep

Entropy 2020, 22(8), 862; https://doi.org/10.3390/e22080862 - 4 Aug 2020

Cited by 3 | Viewed by 3612

Abstract

We present in this paper the effects of Dzyaloshinskii–Moriya (DM) magneto–electric coupling between ferroelectric and magnetic interface atomic layers in a superlattice formed by alternate magnetic and ferroelectric films. We consider two cases: magnetic and ferroelectric films have the simple cubic lattice and the triangular lattice. In the two cases, magnetic films have Heisenberg spins interacting with each other via an exchange J and a DM interaction with the ferroelectric interface. The electrical polarizations of

\pm 1

are assumed for the ferroelectric films. We determine the ground-state (GS) spin configuration in the magnetic film and study the phase transition in each case. In the simple cubic lattice case, in zero field, the GS is periodically non collinear (helical structure) and in an applied field

H

perpendicular to the layers, it shows the existence of skyrmions at the interface. Using the Green’s function method we study the spin waves (SW) excited in a monolayer and also in a bilayer sandwiched between ferroelectric films, in zero field. We show that the DM interaction strongly affects the long-wave length SW mode. We calculate also the magnetization at low temperatures. We use next Monte Carlo simulations to calculate various physical quantities at finite temperatures such as the critical temperature, the layer magnetization and the layer polarization, as functions of the magneto–electric DM coupling and the applied magnetic field. Phase transition to the disordered phase is studied. In the case of the triangular lattice, we show the formation of skyrmions even in zero field and a skyrmion crystal in an applied field when the interface coupling between the ferroelectric film and the ferromagnetic film is rather strong. The skyrmion crystal is stable in a large region of the external magnetic field. The phase transition is studied. Full article

(This article belongs to the Special Issue Selected Papers from 5th International Electronic Conference on Entropy and Its Applications)

► Show Figures

Figure 1

34 pages, 1431 KiB

Open AccessArticle

Information Theory in Computational Biology: Where We Stand Today

by Pritam Chanda, Eduardo Costa, Jie Hu, Shravan Sukumar, John Van Hemert and Rasna Walia

Entropy 2020, 22(6), 627; https://doi.org/10.3390/e22060627 - 6 Jun 2020

Cited by 34 | Viewed by 11051

Abstract

“A Mathematical Theory of Communication” was published in 1948 by Claude Shannon to address the problems in the field of data compression and communication over (noisy) communication channels. Since then, the concepts and ideas developed in Shannon’s work have formed the basis of information theory, a cornerstone of statistical learning and inference, and has been playing a key role in disciplines such as physics and thermodynamics, probability and statistics, computational sciences and biological sciences. In this article we review the basic information theory based concepts and describe their key applications in multiple major areas of research in computational biology—gene expression and transcriptomics, alignment-free sequence comparison, sequencing and error correction, genome-wide disease-gene association mapping, metabolic networks and metabolomics, and protein sequence, structure and interaction analysis. Full article

(This article belongs to the Special Issue Selected Papers from 5th International Electronic Conference on Entropy and Its Applications)

► Show Figures

Figure 1

Figure 1
Schematic showing the Gene-regulatory Networks (GRN) reconstruction problem where undirected edges are inferred using information theoretic methods. Full article ">Figure 2
Schematic showing an overview of alignment-free sequence comparison. Full article ">Figure 3
Illustration of an information theoretic communication model inspired representation for error correction in genomic sequencing based on the work of Chen et al. [<a href="#B65-entropy-22-00627" class="html-bibr">65</a>]. Full article ">Figure 4
Overview of the genome-disease association problem and some example information theoretic metrics calculated for identifying GxG and GxE, a binary phenotype and environmental variable is shown for simplicity. Full article ">Figure 5
Simplified illustration of how mutual information (MI) can be used to capture links between two proteins from their Multiple sequence Alignments. High MI between 2 columns of the alignments are associated with interactions in their structures. Full article ">Figure 6
An example of metabolic networks. Nodes represent metabolites and are transformed into each other through chemical reactions catalyzed by metabolic enzymes (red). Metabolic pathways are formed by a linked series of chemical reactions that collectively perform a biological function. Reconstruction of metabolic networks is typically done by reverse engineering of metabolome data, where information theoretic methods ARACNE and CLR have been applied. Reaction fluxes depicted by the width of the reaction arrows can be predicted using FBA. Also shown are examples of downstream analysis of a metabolic network using information theory for metabolic diversity characterization, structure-dynamic relationship analysis, single-cell level simulation of metabolic networks with FBA and nutrient information sensing. Full article ">Figure 7
Biology presents many optimization problems. Shown here is a hypothetical search space that could represent anything from an organism’s traits to experiment designs to visualization parameters. In these cases, the vertical axis could be fitness/MEP, experiment value, and network edge crossovers, respectively. Full article ">Figure 8
Independent Components Analysis (ICA) can compute latent factors in data like Principle Components Analysis (PCA). ICA is not limited to orthogonal mixtures like PCA, as shown in this simulated dataset. The ICA mixing vectors align to the data better than the PCA rotation vectors. Full article ">

23 pages, 2083 KiB

Open AccessArticle

Renormalization Analysis of Topic Models

by Sergei Koltcov and Vera Ignatenko

Entropy 2020, 22(5), 556; https://doi.org/10.3390/e22050556 - 16 May 2020

Cited by 6 | Viewed by 3171

Abstract

In practice, to build a machine learning model of big data, one needs to tune model parameters. The process of parameter tuning involves extremely time-consuming and computationally expensive grid search. However, the theory of statistical physics provides techniques allowing us to optimize this process. The paper shows that a function of the output of topic modeling demonstrates self-similar behavior under variation of the number of clusters. Such behavior allows using a renormalization technique. A combination of renormalization procedure with the Renyi entropy approach allows for quick searching of the optimal number of topics. In this paper, the renormalization procedure is developed for the probabilistic Latent Semantic Analysis (pLSA), and the Latent Dirichlet Allocation model with variational Expectation–Maximization algorithm (VLDA) and the Latent Dirichlet Allocation model with granulated Gibbs sampling procedure (GLDA). The experiments were conducted on two test datasets with a known number of topics in two different languages and on one unlabeled test dataset with an unknown number of topics. The paper shows that the renormalization procedure allows for finding an approximation of the optimal number of topics at least 30 times faster than the grid search without significant loss of quality. Full article

(This article belongs to the Special Issue Selected Papers from 5th International Electronic Conference on Entropy and Its Applications)

► Show Figures

Figure 1

17 pages, 4256 KiB

Open AccessArticle

A Novel Counterfeit Feature Extraction Technique for Exposing Face-Swap Images Based on Deep Learning and Error Level Analysis

by Weiguo Zhang, Chenggang Zhao and Yuxing Li

Entropy 2020, 22(2), 249; https://doi.org/10.3390/e22020249 - 21 Feb 2020

Cited by 40 | Viewed by 6813

Abstract

The quality and efficiency of generating face-swap images have been markedly strengthened by deep learning. For instance, the face-swap manipulations by DeepFake are so real that it is tricky to distinguish authenticity through automatic or manual detection. To augment the efficiency of distinguishing face-swap images generated by DeepFake from real facial ones, a novel counterfeit feature extraction technique was developed based on deep learning and error level analysis (ELA). It is related to entropy and information theory such as cross-entropy loss function in the final softmax layer. The DeepFake algorithm is only able to generate limited resolutions. Therefore, this algorithm results in two different image compression ratios between the fake face area as the foreground and the original area as the background, which would leave distinctive counterfeit traces. Through the ELA method, we can detect whether there are different image compression ratios. Convolution neural network (CNN), one of the representative technologies of deep learning, can extract the counterfeit feature and detect whether images are fake. Experiments show that the training efficiency of the CNN model can be significantly improved by the ELA method. In addition, the proposed technique can accurately extract the counterfeit feature, and therefore achieves outperformance in simplicity and efficiency compared with direct detection methods. Specifically, without loss of accuracy, the amount of computation can be significantly reduced (where the required floating-point computing power is reduced by more than 90%). Full article

(This article belongs to the Special Issue Selected Papers from 5th International Electronic Conference on Entropy and Its Applications)

► Show Figures

Figure 1

12 pages, 3955 KiB

Open AccessArticle

Quantifying Total Influence between Variables with Information Theoretic and Machine Learning Techniques

by Andrea Murari, Riccardo Rossi, Michele Lungaroni, Pasquale Gaudio and Michela Gelfusa

Entropy 2020, 22(2), 141; https://doi.org/10.3390/e22020141 - 24 Jan 2020

Cited by 5 | Viewed by 2598

Abstract

The increasingly sophisticated investigations of complex systems require more robust estimates of the correlations between the measured quantities. The traditional Pearson correlation coefficient is easy to calculate but sensitive only to linear correlations. The total influence between quantities is, therefore, often expressed in terms of the mutual information, which also takes into account the nonlinear effects but is not normalized. To compare data from different experiments, the information quality ratio is, therefore, in many cases, of easier interpretation. On the other hand, both mutual information and information quality ratio are always positive and, therefore, cannot provide information about the sign of the influence between quantities. Moreover, they require an accurate determination of the probability distribution functions of the variables involved. As the quality and amount of data available are not always sufficient to grant an accurate estimation of the probability distribution functions, it has been investigated whether neural computational tools can help and complement the aforementioned indicators. Specific encoders and autoencoders have been developed for the task of determining the total correlation between quantities related by a functional dependence, including information about the sign of their mutual influence. Both their accuracy and computational efficiencies have been addressed in detail, with extensive numerical tests using synthetic data. A careful analysis of the robustness against noise has also been performed. The neural computational tools typically outperform the traditional indicators in practically every respect. Full article

(This article belongs to the Special Issue Selected Papers from 5th International Electronic Conference on Entropy and Its Applications)

► Show Figures

Figure 1

17 pages, 9175 KiB

Open AccessArticle

A Novel Improved Feature Extraction Technique for Ship-Radiated Noise Based on IITD and MDE

by Zhaoxi Li, Yaan Li, Kai Zhang and Jianli Guo

Entropy 2019, 21(12), 1215; https://doi.org/10.3390/e21121215 - 12 Dec 2019

Cited by 25 | Viewed by 3100

Abstract

Ship-radiated noise signal has a lot of nonlinear, non-Gaussian, and nonstationary information characteristics, which can reflect the important signs of ship performance. This paper proposes a novel feature extraction technique for ship-radiated noise based on improved intrinsic time-scale decomposition (IITD) and multiscale dispersion entropy (MDE). The proposed feature extraction technique is named IITD-MDE. First, IITD is applied to decompose the ship-radiated noise signal into a series of intrinsic scale components (ISCs). Then, we select the ISC with the main information through the correlation analysis, and calculate the MDE value as feature vectors. Finally, the feature vectors are input into the support vector machine (SVM) for ship classification. The experimental results indicate that the recognition rate of the proposed technique reaches 86% accuracy. Therefore, compared with the other feature extraction methods, the proposed method provides a new solution for classifying different types of ships effectively. Full article

(This article belongs to the Special Issue Selected Papers from 5th International Electronic Conference on Entropy and Its Applications)

► Show Figures

Figure 1

Show export options Show export options

Select all

Export citation of selected articles as:

Displaying articles 1-6

Journal Menu

Journal Browser

Selected Papers from 5th International Electronic Conference on Entropy and Its Applications

Share This Special Issue

Special Issue Editor

Special Issue Information

Benefits of Publishing in a Special Issue

Published Papers (6 papers)

Research

Further Information

Guidelines

MDPI Initiatives

Follow MDPI