Information Entropy

Image analysis is playing a very essential role in numerous research areas in the fields of science and technology, ranging from medical imaging to the computer science of automatic vision. Being involved in several applications, which are mainly based on a constant innovation of technologies, image analysis always requires different approaches and new algorithms, including continual upgrades and improvements of existing methods. Accordingly, the range of the analyses in which it is engaged can be considered as wide as the prospective future technologies. A challenge of image analysis is obtaining meaningful information by extracting specific features from images contained in large databases or during real-time acquisition. Among the problems requiring feature extraction are, to name a few, face detection and recognition, character recognition, and parametric determinations for augmented reality and other technologies. Another challenge is the secure encryption and decryption of multimedia data. These tasks demand highly sophisticated numerical and analytical methods. The contributions to this Special Issue provide a good overview of the most important demands and solutions concerning the abovementioned extraction, encryption, and decryption of data. In all the contributions, entropy plays a pivotal role. In the following, the reader can find subjects and problems according to the order of their publication.

In now a day we have many mobiles with various sensors like Bluetooth, Acidometers, GPS system and Wi-Fi sensors. All these are used very widely in this world. Some organisations are depends on this system. It is much important to ensure privacy for the information which flows through this system. With privacy preserving all individuals and many communities are getting benefits. In the system, we may have the collection of the information like location details and trajectory information. All these are sensitive data. To ensure privacy for this information we have many existing systems in this world. All these systems are mainly concentrates on location base privacy preserving methods. But its not much better to use that method. And some existing systems are focused on trajectory privacy. Initially we made a survey about information threats in privacy preserving networks. This results that information will be lost in the trajectory path only. And finally our team decided to develop a framework for preserving privacy in the trajectory path also. This leads to our proposed system. We analysed this with different background knowledge and made some notes. We calculated the effectiveness of this developed system on the basis of information entropy. Finally we made good comparison among the existing systems with the new developed system. This tells that our system is much efficient in privacy preserving among the trajectory path with lower cost and high speeds.

Data stored in databases keep growing as a result of businesses requirements for more information. A big portion of the cost of keeping large amounts of data is in the cost of disk systems, and the resources utilized in managing that data. This paper introduces various compression techniques for data stored in row oriented as well as column-oriented databases. Keeping

Il s’agit de décrire de façon stochastique (c'est-à-dire à partir de matrices utilisées en chaîne de Markov) les lois qui régissent la physique quantique. On veut prouver que de manière théorique, un système quantique peut se stabiliser (en utilisant la propriété de la convergence vue ci-dessus) comme dans un système thermodynamique.

This is a preprint of article forthcoming in the Annual Review of Linguistics.

The Voynich Manuscript is a 15th Century illustrated cipher manuscript. In this overview of recent approaches to the Voynich manuscript, we summarize and evaluate current work on the language that underlies this document. We provide arguments for treating the document as natural language (rather than a medieval hoax) and show how we can make statistical arguments about the phonology, morphology, and structure of the document, even though the contents remain undecipherable.

Este é um curso introdutório sobre a Teoria da Informação (Shannon theory) destinado aos estudantes de graduação em Estatística, ministrado no Centro de Ciências Exatas e da Natureza (CCEN) da Universidade Federal de Pernambuco, Recife. Grosso modo, trata-se de uma tentativa de fornecer uma janela panorâmica focada em algumas das técnicas clássicas do assunto, apresentar resultados e as linhas gerais sobre algumas das aplicações desta potente teoria, através de uma seleção particular de tópicos. O conteúdo está longe de ser razoavelmente integralizado: mesmo alguns assuntos como criptografia ou teoria da distorção da taxa sequer foram tratados. O ponto mais relevante a destacar nesta apresentação, a fim de não causar expectativas frustradas ou má interpretação, é que a abordagem não é bem sintonizada com aquela corriqueira na Estatística (correlata com o rigor exigido na Matemática). Com uma formação de Engenharia, a visão adotada permite omitir muitas das provas, e não haver uma preocupação maior com o rigor. Cursos e livros de Teoria da Informação por Matemáticos e/ou Estatísticos costumam ser "um pouco áridos", densos e rigorosos, perdendo-se no formalismo-com ênfase menor no significado, ou em interpretações. O objetivo é um compêndio exordial apresentando a área aos principiantes. Há um espaço particular para tal enfoque: espera-se que os usuários possam aproveitar ou até mesmo apreciar. Bom uso, !

Luciano Floridi reinterprets and re-ontologizes our world
informationally. That part of his theory may (or may
not) work, but what matters for this paper’s topic is that
when it comes to defining what the value of Being is, his
informational-ontological interpretation is based on order,
organization, and structure. Therefore, there is a common
ground between his interpretation and the way modern
thermodynamics formalizes the concept of order. Floridi
proposes to think of Good as qualitative order and Evil as
its absence, or entropy. However, the kind of entities that are
of importance to us for our judgments and interventions as
agents are ordered and thus valuable because they exist far
from equilibrium. In this paper I shall attempt to establish
that far-from-equilibrium systems attain ever increasing
degrees of order at the cost of faster entropy production. Yet,
inversely, by promoting an increase in entropy production,
more complex and ordered forms emerge on Earth. Entropy
production and order are thus complementary; they imply
each other reciprocally. By promoting Evil in Floridi’s sense,
Good happens lawfully because order is nature’s favorite
way of producing entropy. In short, moving against entropy
only creates more entropy

ABSTRACT: The free-energy principle states that all systems that minimize their free energy resist a tendency to physical disintegration. Originally proposed to account for perception , learning, and action, the free-energy principle has been applied to the evolution, development, morphology, anatomy and function of the brain, and has been called a postulate, an unfalsifiable principle, a natural law, and an imperative. While it might afford a theoretical foundation for understanding the relationship between environment , life, and mind, its epistemic status is unclear. Also unclear is how the free-energy principle relates to prominent theoretical approaches to life science phenomena, such as organicism and mechanism. This paper clarifies both issues, and identifies limits and prospects for the free-energy principle as a first principle in the life sciences.

In this paper, we will examine the Von-Neumann's argument related to a quantum gas undergoing a reversible process, and we will show how there is a flaw when information entropy of the observer is neglected, this process can be modified by considering the observer as a separate system and the process in which quantum gas in undergoing reversible operation as another system , both of these systems are subsystem of a system, We will consider here the physical significance of 'entanglement entropy' as information entropy. We show how inclusion of observer as system affects the information entropy and thus the overall process which leads to irreversibility in the system which was undergoing reversible operation before.

I consider the effect of a finite sample size on the entropy of a sample of independent events. I propose formula for entropy which satisfies Shannon’s axioms, and which reduces to Shannon’s entropy when sample size is infinite. I discuss the physical meaning of the difference between two formulas, including some practical implications, such as maximum achievable channel utilization, and minimum achievable communication protocol overhead, for a given message size.

Dai, Guangquan, & Tan, Jianping. The Spatial-Temporal Distribution of Integrated Impact Index for the Canton Fair: A Study Based on Content Analysis Method (CAM) & the Information Entropy of Chinese Complete Newspaper Database (CCND). ACTA GEOGRAPHICA SINICA, 2012, 67(8): 1109-1124. 2012-08-15 (in Chinese)

Abstract: This paper studies spatial-temporal features of its integrated impact index (III) by using the Content Analysis Method (CAM), the concept of the information entropy measurement (Hartley) and statistical analysis through SPSS. The fundamental data are searched from the Chinese Complete Newspaper Database (CCND) by the theme words "Canton Fair" (CF, 广交会), referring to the records of its news reports in newspapers between May 5, 2000 and May 30, 2011. The number of records in total is 4333.
The findings are as follows. (1) Temporal distribution: The number (N) of the news increased year by year at first and reached the peak in 2006, and then began to decrease. The news reports concentrated in April and October every year. During the fair, the number of news reports of every CF's session decreased from the first phase to the third one. And the inter-annual change shows an annual periodic duplication by the number of news reports during the three phases. (2) Spatial distribution: The number (N) of news reports about CF and its Hartley of a given region/city are introduced into the CF's III on this region/city. The results show that the newspaper publishing companies are mainly located in Beijing, Shanghai and Guangzhou, and that the local/regional ones are concentrated in the east coastal provinces: Guangdong, Zhejiang, Jiangsu and Fujian. The city's III decreases from east to west. This result is similar to the exhibitors' spatial distribution of the 109th Canton Fair. (3) There are some relationships between economic development and distance with the III's spatial distribution reflected by correlation analysis. But Beijing and Shanghai do not obey the distance decay rule. For these two cities, distance is not an important factor affecting the spatial distribution of their IIIs. It is also found that the distance decay rule does not work at a short range within its host province, whilst it works very well beyond certain distance within all the cities except Beijing and Shanghai.
This study employs the perspective of media, as the media management is by all means a critical consideration of the event organizers. But nowadays with the acceleration of the information transition the media management may be unable to control the spatial distribution of impacts. This viewpoint needs more researches in the future. In addition, the intrinsic factors, such as operation, and extrinsic factors, such as economic structure and information technology development, have significant influence on the impacts of the events. The relationship between these factors is worthy of further study.

The demand for Cyber Social Networks has increasingly become the main source of information propagation due to the rapid growth of micro-blogging activity between socially connected people. The process of detecting disaster events, in huge volumes, on fast-streaming platform is quite challenging. In this paper, an information entropy based event detection framework is proposed to identify the event and its location by clustering relatively high-density ratio of tweets using Twitter data. The Shannon entropy of target users, location, time intervals and hashtags are estimated to quantify the dissemination of events as "how-far about" in real-world using entropy maximization inference model. The geo-tagged (spatial) tweets are extracted for a specified time period (temporal) to identify the location of an event as "where-when about"; and visualizes the event in geo-maps. The evaluation parameters of Entropy, Cluster Score, Event Detection Hit and False Panic Rate during four major disaster events are identified to illustrate the effectiveness of the proposed framework. The retweeting activity of the Twitter user is classified as human signatures and bots. The experimental outcome determines the scope and significant dissemination direction of finding events from a new perspective which demonstrates 96% of improved event detection accuracy. 5 6 7 8 9 10 11 12 13 14 15 16

Edge detection and feature extraction are widely used in image processing and computer vision applications. Most of the traditional methods for edge detection are based on the first and second order derivatives of gray levels of the pixels of the original image utilizing 2D spatial convolution masks to approximate the derivative. In this paper we present an algorithm for edge detection in gray level images.....

Entropy is a key concept in the characterization of uncertainty for any given signal, and its extensions such as Spectral Entropy and Permutation Entropy. They have been used to measure the complexity of time series. However, these measures are subject to the discretization employed to study the states of the system, and identifying the relationship between complexity measures and the expected performance of the four selected forecasting methods that participate in the M4 Competition. This relationship allows the decision, in advance, of which algorithm is adequate. Therefore, in this paper, we found the relationships between entropy-based complexity framework and the forecasting error of four selected methods (Smyl, Theta, ARIMA, and ETS). Moreover, we present a framework extension based on the Emergence, Self-Organization, and Complexity paradigm. The experimentation with both synthetic and M4 Competition time series show that the feature space induced by complexities, visually constrains the forecasting method performance to specific regions; where the logarithm of its metric error is poorer, the Complexity based on the emergence and self-organization is maximal.

We apply a certain unifying physical description of the results of Information Theory. Assuming that heat entropy is a thermodynamic realization of information entropy, we construct a cyclical, thermodynamic, average-value model of an information transfer chain as a general heat engine, in particular a Carnot engine, reversible or
irreversible. A working medium of the cycle (a thermodynamic
system transforming input heat energy) can be considered as a
thermodynamic, average-value model or, as such, as a realization
of an information transfer channel. We show that for a model
realized in this way the extended II. Principle of
Thermodynamics is valid and we formulate its \textit{information
form.
In addition we solve the problem of a proof of II. Principle
of Thermodynamics. We state the relation between the term of
information entropy, introduced by C. Shannon (1948), and
thermodynamic entropy, introduced by R. Clausius (1850) and,
further, explain the Gibbs paradox. Our way to deal with the given
topic is a connection of both the mathematical definitions of
information
entropies and their mutual relations within a system of stochastic quantities, especially with thermodynamic entropies
defined on an isolated system in which a realization of our
(repeatable) observation is performed [it is a (cyclic)
transformation of heat energy of an observed, measure}  system].
We use the information description to analyze the Gibbs paradox, reasoning it as a property of such observation, measuring an  (equilibrium) thermodynamic system.
We state a  logical proof of the II.~P.T. as a derivation of relations among
the entropies of a system of stochastic variables, realized
physically, and, the Equivalence Principle of the I., II. and
III. Principle of Thermodynamics is formulated.

An introduction of entanglement (non-locality). The discovery of a data based informa-tional wave pattern that infuses entanglement into the system. This discovery of how to add entanglement into the model is the missing key, that has opened the door to understanding the universe. It is found that the inclusion of entanglement at the start of the system is extremely simple and in fact it is so simple that it has simply been overlooked. Entanglement is the must fundamental aspect of our universe when we include it, we find a hidden math system called Wave Pattern Entangled Math. A data system created by entanglement. Creating an unbreakable pattern of information, including entangled energy entropy, entangled spin, entangled universal expansion and compression, entangled velocity of light C 2 .

Heal or die ?!  That is the question?  ... I'm thinking that negative or positive entropy, that is, health or disease, life or death, must be the key to everything: almost until yesterday and after a lifetime I still didn't understand that it is the immune system that flounders against the fungus a cause arthritis that slowly but surely kills you in the end exactly as the doctor Castoldi tells me that low immunoglobulins are not a problem but the opposite and that they should be high ... not that he too confuses the cause with the effect for lack of conscience ?!

You understand well that it is always the same Neanderthal problem that is at the basis of all the wrong analyzes of InCoScienziati who have always been “stopped” in time….  And the airport and all the other legal problems from condominiums to politics are still faced in reverse just like with the virus for not wanting to look at things consciously. It takes the patience of Job and the conscience of Leonardo and Einstein ... and then maybe even when you understand you don't come out the same ... and who makes the Neanderthals do it to get a move on instead of abandoning themselves by fooling around with their persistent illusions?!  You think ?!

Meanwhile, I get almost the 100th mention of a scholar of “Aquinas”: Thomas Aquinas was an Italian Dominican friar, philosopher, Catholic priest, and Doctor of the Church.  An immensely influential philosopher, theologian, and jurist in the tradition of scholasticism, he is also known within the latter as the Doctor Angelicus, the Doctor Communis, and the Doctor Universalis.  Wikipedia
Thomas Aquinas, that is the father of Catholic theology, not a small thing …

Guarire o morire?!  Questa è la domanda?  …

Penso che l'entropia negativa o positiva, cioè salute o malattia, la vita o la morte, debba essere la chiave di tutto: quasi fino a ieri e dopo una vita ancora non capivo che è il sistema immunitario che si dibatte contro il fungo  una causa artrite che lentamente ma inesorabilmente alla fine ti uccide esattamente come mi dice il dottor Castoldi che le immunoglobuline basse non sono un problema ma il contrario e che dovrebbero essere alte...non che anche lui confonda la causa con l'effetto per mancanza di coscienza?!

Capisci bene che è sempre lo stesso problema di Neanderthal che sta alla base di tutte le analisi sbagliate di InCoScienziati che sono sempre state “fermate” nel tempo….  E l'aeroporto e tutti gli altri problemi legali dai condomini alla politica si affrontano ancora al contrario proprio come con il virus per non voler guardare le cose consapevolmente.  Ci vuole la pazienza di Giobbe e la coscienza di Leonardo ed Einstein....e poi magari anche quando capisci non ne esci lo stesso... e chi lo fa fare ai Neanderthal per darsi una mossa invece di abbandonarsi a scherzare con le loro persistenti illusioni?!  Tu pensi ?!

Nel frattempo, ricevo quasi la centesima menzione di uno studioso di "Aquino": Tommaso d'Aquino era un frate domenicano italiano, filosofo, sacerdote cattolico e dottore della Chiesa.  Filosofo, teologo e giurista immensamente influente nella tradizione della scolastica, è anche conosciuto all'interno di quest'ultima come Doctor Angelicus, Doctor Communis e Doctor Universalis.  Wikipedia

Tommaso d'Aquino, cioè il padre della teologia Cattolica, cosa non da poco...

Presented Here, An introduction of entanglement (non-locality). The discovery of a data-based informational wave pattern that infuses entanglement into the system. Creating an unbreakable pattern of information, including entangled energy entropy, entangled spin, entangled universal expansion, entangled velocity of light C2.

This discovery of how to add entanglement into the model is the missing key, that has opened the door to understanding the universe.

Demonstrating that the reason Relativity did not reach the final explanation is due to the inability to incorporate entanglement into the system. With the inclusion of entanglement into the system we find in complete detail exactly how Causality, (Relativity)is replaced by Complementary.

Showing that Complementary, (entanglement), is indeed more fundamental than relativity. More fundamental than the four basic forces in nature, and thus no longer hemmed in by the relativistic limitations such as the speed of light.

It is shown that entanglement is of greater importance than relativity. Arriving at new universal rules of a Complementarity entangled universe, explaining most of the remaining questions in fundamental physics with no need for an inflationary phenomenon.

Allowing for simple calculation of all fundamental forces and elements in the universe. This simple pattern provides us with the universal matrix and turns the universal matrix, into a spectacular visual representation of wave-particle duality, allowing us to witness for the first time how waves form particles.

In this paper, a method based on the Information Entropy (IE) is developed to evaluate the equilibrium stability of a given dynamic system. While for analytical/semi-analytical approaches the definition of stability is formally rigorous (e.g., thanks to the tools provided by the linear analysis), the process of identifying stable and unstable behaviours can be subject to a certain degree of arbitrariness in case of experimental and/or numerical transients. Generally speaking, the classification is based on the time dependent behaviour of the signals recorded during a transient of the system. These signals can be char-acterised by oscillations with non-decreasing amplitude or can converge to a steady-state value. In the first case, the system experiences an unstable operating condition, in the latter one, the operating condition is stable. For this reason, the key issue is the determination of a well-defined threshold in order to separate converging and oscillating signals. To this purpose, the proposed method evaluates the convergence of a transient by computing the IE associated with a selected signal, and adopts as convergence threshold the IE related to a constant amplitude sinusoid, which represents the condition for the onset of the instability. In this work, the developed methodology, which can be applied in general to any kind of signal, is assessed against the data obtained from the L2 single-phase Natural Circulation Loop (NCL) (University of Genoa, DIME-Tec Labs), for which the IE is also adopted to evaluate the system stability map. Satisfactory results are achieved not only for the identification of stable and unstable transients, but also for the stability map, which is in agreement with the predictions achievable with other methodologies (e.g., semi-analytical linear analysis) developed by the authors (Pini et al., 2016; Cammi et al., 2016a; Luzzi et al., 2017).

Swarming behavior is common in biology, from cell colonies to insect swarms and bird flocks. However, the conditions leading to the emergence of such behavior are still subject to research. Since Reynolds' boids, many artificial models have reproduced swarming behavior, focusing on details ranging from obstacle avoidance to the introduction of fixed leaders. This paper presents a model of evolved artificial agents, able to develop swarming using only their ability to listen to each other's signals. The model simulates a population of agents looking for a vital resource they cannot directly detect, in a 3D environment. Instead of a centralized algorithm, each agent is controlled by an artificial neural network, whose weights are encoded in a genotype and adapted by an original asynchronous genetic algorithm. The results demonstrate that agents progressively evolve the ability to use the information exchanged between each other via signaling to establish temporary leader-follo...

IC (Interconnections) "LOOMS, FABRICS AND IMPLEMENTATION TO WEAVE TEXTILE SURFACES WITH ASTRONOMICAL DATA", 2022
The I_C project was initiated by Maria Jose River and supported by ALMA (The Atacama Large Millimeter/submillimeter Array), an observatory in Chile located in the Andes Mountains. It is a collaborative project including Maria Jose River, Rigardo Vega from Chile, Shih Wei Chieh from Taiwan and Francesca Piñol from Barcelona. This project aims create a link for the contemporary and traditional sky from the perspective of combining contemporary astronomy and cultural cosmology to represent the Incan dark constellation with contemporary data visualization in textile format. Further more, we hope this exhibition can be the beginning of the action “the patchwork of our sky”,as the first stop of the I_C project in Taiwan.
The branch of this exhibition is about Shih Wei Chieh’s action in another high ground, a greenhouse project in Tibet in 2018. This community aim to provide a sustainable vegetable for a local charity school. A installation is made with the symbiosis of solar technology and plants, as the document for the trip.