ALBERT

Description: The paradigm shift from an exclusive allocation of frequency bands, one for each system, to a shared use of frequencies comes along with the need of new concepts since interference will be an ubiquitous phenomenon. In this paper, we use the concept of arbitrarily varying channels to model the impact of unknown interference caused by coexisting wireless systems which operate on the same frequencies. Within this framework, capacity can be zero if pre-specified encoders and decoders are used. This necessitates the use of more sophisticated coordination schemes where the choice of encoders and decoders is additionally coordinated based on common randomness. As an application we study the arbitrarily varying bidirectional broadcast channel and derive the capacity regions for different coordination strategies. This problem is motivated by decode-and-forward bidirectional or two-way relaying, where a relay establishes a bidirectional communication between two other nodes while sharing the resources with other coexisting wireless networks.

Description: Bearing fault diagnosis has attracted significant attention over the past few decades. It consists of two major parts: vibration signal feature extraction and condition classification for the extracted features. In this paper, multiscale permutation entropy (MPE) was introduced for feature extraction from faulty bearing vibration signals. After extracting feature vectors by MPE, the support vector machine (SVM) was applied to automate the fault diagnosis procedure. Simulation results demonstrated that the proposed method is a very powerful algorithm for bearing fault diagnosis and has much better performance than the methods based on single scale permutation entropy (PE) and multiscale entropy (MSE).

Description: In reviewing the literature pertaining to interfacial water, colloidal stability, and cell membrane function, we are led to propose that a cascade of events that begins with acute exogenous surfactant-induced interfacial water stress can explain the etiology of sudden death syndrome (SDS), as well as many other diseases associated with modern times. A systemic lowering of serum zeta potential mediated by exogenous cationic surfactant administration is the common underlying pathophysiology. The cascade leads to subsequent inflammation, serum sickness, thrombohemorrhagic phenomena, colloidal instability, and ultimately even death. We propose that a sufficient precondition for sudden death is lowered bioavailability of certain endogenous sterol sulfates, sulfated glycolipids, and sulfated glycosaminoglycans, which are essential in maintaining biological equipose, energy metabolism, membrane function, and thermodynamic stability in living organisms. Our literature review provides the basis for the presentation of a novel hypothesis as to the origin of endogenous bio-sulfates which involves energy transduction from sunlight. Our hypothesis is amply supported by a growing body of data showing that parenteral administration of substances that lower serum zeta potential results in kosmotropic cationic and/or chaotropic anionic interfacial water stress, and the resulting cascade.

Description: We derive a two-parameter family of generalized entropies, Spq, and means mpq. To this end, assume that we want to calculate an entropy and a mean for n non-negative real numbers {x1,…,xn}. For comparison, we consider {m1,…,mk} where mi = m for all i = 1,…,k and where m and k are chosen such that the lp and lq norms of {x1,…,xn} and {m1,…,mk} coincide. We formally allow k to be real. Then, we define k, log k, and m to be a generalized cardinality kpq, a generalized entropy Spq, and a generalized mean mpq respectively. We show that this family of entropies includes the Shannon and Rényi entropies and that the family of generalized means includes the power means (such as arithmetic, harmonic, geometric, root-mean-square, maximum, and minimum) as well as novel means of Shannon-like and Rényi-like forms. A thermodynamic interpretation arises from the fact that the lp norm is closely related to the partition function at inverse temperature β = p. Namely, two systems possess the same generalized entropy and generalized mean energy if and only if their partition functions agree at two temperatures, which is also equivalent to the condition that their Helmholtz free energies agree at these two temperatures.

Description: Energy storage systems are increasingly gaining importance with regard to their role in achieving load levelling, especially for matching intermittent sources of renewable energy with customer demand, as well as for storing excess nuclear or thermal power during the daily cycle. Compressed air energy storage (CAES), with its high reliability, economic feasibility, and low environmental impact, is a promising method for large-scale energy storage. Although there are only two large-scale CAES plants in existence, recently, a number of CAES projects have been initiated around the world, and some innovative concepts of CAES have been proposed. Existing CAES plants have some disadvantages such as energy loss due to dissipation of heat of compression, use of fossil fuels, and dependence on geological formations. This paper reviews the main drawbacks of the existing CAES systems and presents some innovative concepts of CAES, such as adiabatic CAES, isothermal CAES, micro-CAES combined with air-cycle heating and cooling, and constant-pressure CAES combined with pumped hydro storage that can address such problems and widen the scope of CAES applications, by energy and exergy analyses. These analyses greatly help us to understand the characteristics of each CAES system and compare different CAES systems.

Description: In the background of Friedmann–Robertson–Walker Universe, there exists Hawking radiation which comes from the cosmic apparent horizon due to quantum effect. Although the Hawking radiation on the late time evolution of the universe could be safely neglected, it plays an important role in the very early stage of the universe. In view of this point, we identify the temperature in the scalar field potential with the Hawking temperature of cosmic apparent horizon. Then we find a nonsingular universe sourced by the temperature-dependent scalar field. We find that the universe could be created from a de Sitter phase which has the Planck energy density. Thus the Big-Bang singularity is avoided.

Description: The socio-thermodynamics of a population of two competing species exhibits strong analogies with the thermodynamics of solutions and alloys of two constituents. In particular we may construct strategy diagrams akin to the phase diagrams of chemical thermodynamics, complete with regions of homogeneous mixing and miscibility gaps.

Description: Several quantum dynamical entropies have been proposed that extend the classical Kolmogorov–Sinai (dynamical) entropy. The same scenario appears in relation to the extension of algorithmic complexity theory to the quantum realm. A theorem of Brudno establishes that the complexity per unit time step along typical trajectories of a classical ergodic system equals the KS-entropy. In the following, we establish a similar relation between the Connes–Narnhofer–Thirring quantum dynamical entropy for the shift on quantum spin chains and the Gács algorithmic entropy. We further provide, for the same system, a weaker linkage between the latter algorithmic complexity and a different quantum dynamical entropy proposed by Alicki and Fannes.

Description: An original multivariate multi-scale methodology for assessing the complexity of physiological signals is proposed. The technique is able to incorporate the simultaneous analysis of multi-channel data as a unique block within a multi-scale framework. The basic complexity measure is done by using Permutation Entropy, a methodology for time series processing based on ordinal analysis. Permutation Entropy is conceptually simple, structurally robust to noise and artifacts, computationally very fast, which is relevant for designing portable diagnostics. Since time series derived from biological systems show structures on multiple spatial-temporal scales, the proposed technique can be useful for other types of biomedical signal analysis. In this work, the possibility of distinguish among the brain states related to Alzheimer’s disease patients and Mild Cognitive Impaired subjects from normal healthy elderly is checked on a real, although quite limited, experimental database.

Description: Graduation of data is of great importance in survival analysis. Smoothness and goodness of fit are two fundamental requirements in graduation. Based on the instinctive defining expression for entropy in terms of a probability distribution, two optimization models based on the Maximum Entropy Principle (MaxEnt) and Minimum Cross Entropy Principle (MinCEnt) to estimate mortality probability distributions are presented. The results demonstrate that the two approaches achieve the two basic requirements of data graduating, smoothness and goodness of fit respectively. Then, in order to achieve a compromise between these requirements, a new entropy optimization model is proposed by defining a hybrid objective function combining both principles of MaxEnt and MinCEnt models linked by a given adjustment factor which reflects the preference of smoothness and goodness of fit in the data graduation. The proposed approach is feasible and more reasonable in data graduation when both smoothness and goodness of fit are concerned.

Description: The   general   quasi-linear  autonomous  fourth   order   diffusion   equation ut = −[G(u)uxxx + h(u, ux, uxx)]x with positive variable diffusivity G(u) and lower-order flux component h is considered on the real line.  A direct algorithm produces a general class of equations for which the Shannon entropy density obeys a reaction-diffusion equation with a positive irreducible source term.  Such equations may have any positive twice-differentiable diffusivity function G(u). The forms of such equations are the indicators of more general conservation equations whose entropy equation may be expressed in an alternative reaction-diffusion form whose source term, although reducible, is positive.

Description: Information theoretic estimators for the first-order spatial autoregressive model are introduced, small sample properties are investigated, and the estimator is applied empirically. Monte Carlo experiments are used to compare finite sample performance of more traditional spatial estimators to three different information theoretic estimators, including maximum empirical likelihood, maximum empirical exponential likelihood, and maximum log Euclidean likelihood. Information theoretic estimators are found to be robust to selected specifications of spatial autocorrelation and may dominate traditional estimators in the finite sample situations analyzed, except for the quasi-maximum likelihood estimator which competes reasonably well. The information theoretic estimators are illustrated via an application to hedonic housing pricing.

Description: The grading entropy concept can be adapted to the field of geotechnics, to establish criteria for phenomena such as particle packing, particle migration and filtering, through a quantified expression of the order/disorder in the grain size distribution, in terms of two entropy-based parameters. In this paper, the grading entropy theory is applied in some geotechnical case studies, which serve as benchmark examples to illustrate its application to the characterisation of piping, softening and dispersive soils, and to filtering problems in the context of a leachate collection system for a landfill site. Further, since unstable cohesive (dispersive) soils are generally improved by lime, the effect of lime addition is also considered, on the basis of some measurements and a further application of the grading entropy concept, which allows evolutions in the entropy of a soil to be considered as its grading is modified. The examples described support the hypothesis that the potential for soil erosion and particle migration can be reliably identified using grading entropy parameters derived from grading curve data, and applied through an established soil structure stability criteria and a filtering rule. It is shown that lime modification is not necessarily helpful in stabilizing against particle migration.

Description: From the perspective of the statistical fluctuation theory, we explore the role of the thermodynamic geometries and vacuum (in)stability properties for the topological Einstein–Yang–Mills black holes. In this paper, from the perspective of the state-space surface and chemical Weinhold surface of higher dimensional gravity, we provide the criteria for the local and global statistical stability of an ensemble of topological Einstein–Yang–Mills black holes in arbitrary spacetime dimensions D ≥ 5. Finally, as per the formulations of the thermodynamic geometry, we offer a parametric account of the statistical consequences in both the local and global fluctuation regimes of the topological extremal Einstein–Yang–Mills black holes.

Description: In this paper, we investigate the combined effects of buoyancy force and Navier slip on the entropy generation rate in a vertical porous channel with wall suction/injection. The nonlinear model problem is tackled numerically using Runge–Kutta–Fehlberg method with shooting technique. Both the velocity and temperature profiles are obtained and utilized to compute the entropy generation number. The effects of slip parameter, Brinkmann number, the Peclet number and suction/injection Reynolds number on the fluid velocity, temperature profile, Nusselt number, entropy generation rate and Bejan number are depicted graphically and discussed quantitatively.

Description: We review the exact solutions in modified gravity. It is one of the main problems of mathematical physics for the gravity theory. One can obtain an exact solution if the field equations reduce to a system of ordinary differential equations. In this paper we consider a number of exact solutions obtained by the method of separation of variables. Some applications to Cosmology and BH entropy are briefly mentioned.

Description: We explore the consequences of a deterministic microscopic thermostat-reservoir contact mechanism for hard disks where the collision rule at the boundary is modified. Numerical evidence and theoretical argument is given that suggests that an energy balance is achieved for a system of hard disks in contact with two reservoirs at equal temperatures. This system however produces entropy near the the system-reservoir boundaries and this entropy flows into the two reservoirs. Thus rather than producing an equilibrium state, the system is at a steady state with a steady entropy flow without any associated energy flux. The microscopic mechanisms associated with energy and entropy fluxes for this system are examined in detail.

Description: Cellular automata (CA) are a remarkably  efficient tool for exploring general properties of complex systems and spatiotemporal patterns arising from local rules. Totalistic cellular automata,  where the update  rules depend  only on the density of neighboring states, are at the same time a versatile  tool for exploring  dynamical  processes on graphs. Here we briefly review our previous results on cellular automata on graphs, emphasizing some systematic relationships between network architecture and dynamics identified in this way. We then extend the investigation  towards graphs obtained in a simulated-evolution procedure, starting from Erdő s–Rényi (ER) graphs and selecting for low entropies of the CA dynamics. Our key result is a strong association of low Shannon entropies with a broadening of the graph’s degree distribution.

Description: In this paper we examine an Information-Theoretic method for solving noisy linear inverse estimation problems which encompasses under a single framework a whole class of estimation methods. Under this framework, the prior information about the unknown parameters (when such information exists), and constraints on the parameters can be incorporated in the statement of the problem. The method builds on the basics of the maximum entropy principle and consists of transforming the original problem into an estimation of a probability density on an appropriate space naturally associated with the statement of the problem. This estimation method is generic in the sense that it provides a framework for analyzing non-normal models, it is easy to implement and is suitable for all types of inverse problems such as small and or ill-conditioned, noisy data. First order approximation, large sample properties and convergence in distribution are developed as well. Analytical examples, statistics for model comparisons and evaluations, that are inherent to this method, are discussed and complemented with explicit examples.

Description: Recently, a novel method has been introduced to estimate the statistical significance of clustering in the direction distribution of objects. The method involves a multiscale procedure, based on the Kullback–Leibler divergence and the Gumbel statistics of extreme values, providing high discrimination power, even in presence of strong background isotropic contamination. It is shown that the method is: (i) semi-analytical, drastically reducing computation time; (ii) very sensitive to small, medium and large scale clustering; (iii) not biased against the null hypothesis. Applications to the physics of ultra-high energy cosmic rays, as a cosmological probe, are presented and discussed.

Description: The application of the Maximum Entropy (ME) principle leads to a minimum of the Mutual Information (MI), I(X,Y), between random variables X,Y, which is compatible with prescribed joint expectations and given ME marginal distributions. A sequence of sets of joint constraints leads to a hierarchy of lower MI bounds increasingly approaching the true MI. In particular, using standard bivariate Gaussian marginal distributions, it allows for the MI decomposition into two positive terms: the Gaussian MI (Ig), depending upon the Gaussian correlation or the correlation between ‘Gaussianized variables’, and a non‑Gaussian MI (Ing), coinciding with joint negentropy and depending upon nonlinear correlations. Joint moments of a prescribed total order p are bounded within a compact set defined by Schwarz-like inequalities, where Ing grows from zero at the ‘Gaussian manifold’ where moments are those of Gaussian distributions, towards infinity at the set’s boundary where a deterministic relationship holds. Sources of joint non-Gaussianity have been systematized by estimating Ing between the input and output from a nonlinear synthetic channel contaminated by multiplicative and non-Gaussian additive noises for a full range of signal-to-noise ratio (snr) variances. We have studied the effect of varying snr on Ig and Ing under several signal/noise scenarios.

Description: The minimum error entropy (MEE) criterion has been receiving increasing attention due to its promising perspectives for applications in signal processing and machine learning. In the context of Bayesian estimation, the MEE criterion is concerned with the estimation of a certain random variable based on another random variable, so that the error’s entropy is minimized. Several theoretical results on this topic have been reported. In this work, we present some further results on the MEE estimation. The contributions are twofold: (1) we extend a recent result on the minimum entropy of a mixture of unimodal and symmetric distributions to a more general case, and prove that if the conditional distributions are generalized uniformly dominated (GUD), the dominant alignment will be the MEE estimator; (2) we show by examples that the MEE estimator (not limited to singular cases) may be non-unique even if the error distribution is restricted to zero-mean (unbiased).

Description: In this paper we utilize the Tsallis relative entropy, a generalization of the Kullback–Leibler entropy in the frame work of non-extensive thermodynamics to analyze the properties of anomalous diffusion processes. Anomalous (super-) diffusive behavior can be described by fractional diffusion equations, where the second order space derivative is extended to fractional order α ∈ (1, 2). They represent a bridging regime, where for α = 2 one obtains the diffusion equation and for α = 1 the (half) wave equation is given. These fractional diffusion equations are solved by so-called stable distributions, which exhibit heavy tails and skewness. In contrast to the Shannon or Tsallis entropy of these distributions, the Kullback and Tsallis relative entropy, relative to the pure diffusion case, induce a natural ordering of the stable distributions consistent with the ordering implied by the pure diffusion and wave limits.

Description: An experimental test of the “special state” theory of quantum measurement is proposed. It should be feasible with present-day laboratory equipment and involves a slightly elaborated Stern–Gerlach setup. The “special state” theory is conservative with respect to quantum mechanics, but radical with respect to statistical mechanics, in particular regarding the arrow of time. In this article background material is given on both quantum measurement and statistical mechanics aspects. For example, it is shown that future boundary conditions would not contradict experience, indicating that the fundamental equal-a-priori-probability assumption at the foundations of statistical mechanics is far too strong (since future conditioning reduces the class of allowed states). The test is based on a feature of this theory that was found necessary in order to recover standard (Born) probabilities in quantum measurements. Specifically, certain systems should have “noise” whose amplitude follows the long-tailed Cauchy distribution. This distribution is marked by the occasional occurrence of extremely large signals as well as a non-self-averaging property. The proposed test is a variant of the Stern–Gerlach experiment in which protocols are devised, some of which will require the presence of this noise, some of which will not. The likely observational schemes would involve the distinction between detection and non-detection of that “noise”. The signal to be detected (or not) would be either single photons or electric fields (and related excitations) in the neighborhood of the ends of the magnets.

Description: Diffraction methods are used to detect atomic order in solids. While uniquely ergodic systems with pure point diffraction have zero entropy, the relation between diffraction and entropy is not as straightforward in general. In particular, there exist families of homometric systems, which are systems sharing the same diffraction, with varying entropy. We summarise the present state of understanding by several characteristic examples.

Description: Entropy as an estimate of complexity of the electroencephalogram is an effective parameter for monitoring the depth of anesthesia (DOA) during surgery. Multiscale entropy (MSE) is useful to evaluate the complexity of signals over different time scales. However, the limitation of the length of processed signal is a problem due to observing the variation of sample entropy (SE) on different scales. In this study, the adaptive resampling procedure is employed to replace the process of coarse-graining in MSE. According to the analysis of various signals and practical EEG signals, it is feasible to calculate the SE from the adaptive resampled signals, and it has the highly similar results with the original MSE at small scales. The distribution of the MSE of EEG during the whole surgery based on adaptive resampling process is able to show the detailed variation of SE in small scales and complexity of EEG, which could help anesthesiologists evaluate the status of patients.

Description: The presence of dark energy in the Universe challenges the Einstein’s theory of gravity at cosmic scales. It motivates the inclusion of rotational degrees of freedom in the Einstein–Cartan gravity, representing the minimal and the most natural extension of the General Relativity. One can, consequently, expect the violation of the cosmic isotropy by the rotating Universe. We study chirality of the vorticity of the Universe within the Einstein–Cartan cosmology. The role of the spin of fermion species during the evolution of the Universe is studied by averaged spin densities and Einstein–Cartan equations. It is shown that spin density of the light Majorana neutrinos acts as a seed for vorticity at early stages of the evolution of the Universe. Its chirality can be evaluated in the vicinity of the spacelike infinity. It turns out that vorticity of the Universe has right-handed chirality.

Description: The purpose of this study is the dimensioning of the cylindrical mixing chamber of a compressible fluid ejector used in particular in sugar refineries for degraded vapor re‑compression at the calandria exit, during the evaporation phase. The method used, known as the “integral” or “thermodynamic model”, is based on the model of the one‑dimensional isentropic flow of perfect gases with the addition of a model of losses. Characteristic curves and envelope curves are plotted. The latter are an interesting tool from which the characteristic dimensions of the ejector can be rapidly obtained for preliminary dimensioning (for an initial contact with a customer for example). These ejectors, which were specifically designed for the process rather than selected from a catalog of standard devices, will promote energy saving.

Description: In recent decades, the approach known as Finite-Time Thermodynamics has provided a fruitful theoretical framework for the optimization of heat engines operating between a heat source (at temperature ) and a heat sink (at temperature ). The aim of this paper is to propose a more complete approach based on the association of Finite-Time Thermodynamics and the Bond-Graph approach for modeling endoreversible heat engines. This approach makes it possible for example to find in a simple way the characteristics of the optimal operating point at which the maximum mechanical power of the endoreversible heat engine is obtained with entropy flow rate as control variable. Furthermore it provides the analytical expressions of the optimal operating point of an irreversible heat engine where the energy conversion is accompanied by irreversibilities related to internal heat transfer and heat dissipation phenomena. This original approach, applied to an analysis of the performance of a thermoelectric generator, will be the object of a future publication.

Description: Information Bottleneck-based methods use mutual information as a distortion function in order to extract relevant details about the structure of a complex system by compression. One of the approaches used to generate optimal compressed representations is by annealing a parameter. In this manuscript we present a common framework for the study of annealing in information distortion problems. We identify features that should be common to any annealing optimization problem. The main mathematical tools that we use come from the analysis of dynamical systems in the presence of symmetry (equivariant bifurcation theory). Through the compression problem, we make connections to the world of combinatorial optimization and pattern recognition. The two approaches use very different vocabularies and consider different problems to be “interesting”. We provide an initial link, through the Normalized Cut Problem, where the two disciplines can exchange tools and ideas.

Description: This paper presents a taxonomy and overview of approaches to the measurement of graph and network complexity. The taxonomy distinguishes between deterministic (e.g., Kolmogorov complexity) and probabilistic approaches with a view to placing entropy-based probabilistic measurement in context. Entropy-based measurement is the main focus of the paper. Relationships between the different entropy functions used to measure complexity are examined; and intrinsic (e.g., classical measures) and extrinsic (e.g., Körner entropy) variants of entropy-based models are discussed in some detail.

Description: The subcritical Organic Rankine Cycle (ORC) with 28 working fluids for waste heat recovery is discussed in this paper. The effects of the temperature of the waste heat, the critical temperature of working fluids and the pinch temperature difference in the evaporator on the optimal evaporation temperature (OET) of the ORC have been investigated. The second law efficiency of the system is regarded as the objective function and the evaporation temperature is optimized by using the quadratic approximations method. The results show that the OET will appear for the temperature ranges investigated when the critical temperatures of working fluids are lower than the waste heat temperatures by 18 ± 5 K under the pinch temperature difference of 5 K in the evaporator. Additionally, the ORC always exhibits the OET when the pinch temperature difference in the evaporator is raised under the fixed waste heat temperature. The maximum second law efficiency will decrease with the increase of pinch temperature difference in the evaporator.

Description: Recent advances in spectroscopic methods allow the identification of minute fluctuations in a protein structure. These dynamic properties have been identified as keys to some biological processes. The consequences of this structural flexibility can be far‑reaching and they add a new dimension to the structure-function relationship of biomolecules. Nuclear Magnetic Resonance (NMR) spectroscopy allows the study of structure as well as dynamics of biomolecules in a very broad range of timescales at atomic level. A number of new NMR methods have been developed recently to allow the measurements of time scales and spatial fluctuations, which in turn provide the thermodynamics associated with the biological processes. Since NMR parameters reflect ensemble measurements, structural ensemble approaches in analyzing NMR data have also been developed. These new methods in some instances can even highlight previously hidden conformational features of the biomolecules. In this review we describe several solution NMR methods to study protein dynamics and discuss their impact on important biological processes.

Description: This article proposes a quantitative risk assessment for security systems which have multiple protected assets and a risk-based benefit-cost analysis for decision makers. The proposed methodology consists of five phases: identification of assets, security unit and intrusion path, security unit effectiveness estimation, intrusion path effectiveness estimation, security system risk assessment and benefit-cost estimation. Key innovations in this methodology include its use of effectiveness entropy to measure the degree of uncertainty of a security system to complete a protection task, and the fact it measures risk like information theory measures the amount of information. A notional example is provided to demonstrate an application of the proposed methodology.

Description: Molecular dynamics simulations were used to characterize the structure and dynamics for several peptides and the effect of conjugating them to a gold nanoparticle. Peptide structure and dynamics were compared for two cases: unbound peptides in water, and peptides bound to the gold nanoparticle surface in water. The results show that conjugating the peptides to the gold nanoparticle usually decreases conformational entropy, but sometimes increases entropy. Conjugating the peptides can also result in more extended structures or more compact structures depending on the amino acid sequence of the peptide. The results also suggest that if one wishes to use peptide-nanoparticle conjugates for drug delivery it is important that the peptides contain secondary structure in solution because in our simulations the peptides with little to no secondary structure adsorbed to the nanoparticle surface.

Description: In this paper, fault detection of networked control systems with random delays, packet dropout and noises is studied. The filter is designed using a minimum error entropy criterion. The residual generated by the filter is then evaluated to detect faults in networked control systems. An illustrative networked control system is used to verify the effectiveness of the proposed approach.

Description: In a curved surface design, the overall shape features that emerge from combinations of shape elements are important. However, controlling the features of the overall shape in curved profiles is difficult using conventional microscopic shape information such as dimension. Herein two types of macroscopic shape information, curvature entropy and quadrature curvature entropy, quantitatively represent the features of the overall shape. The curvature entropy is calculated by the curvature distribution, and represents the complexity of a shape (one of the overall shape features). The quadrature curvature entropy is an improvement of the curvature entropy by introducing a Markov process to evaluate the continuity of a curvature and to approximate human cognition of the shape. Additionally, a shape generation method using a genetic algorithm as a calculator and the entropy as a shape generation index is presented. Finally, the applicability of the proposed method is demonstrated using the side view of an automobile as a design example.

Description: This study constructed a parameter analysis for improving the energy performance of air-cooled water chillers by altering the angle configuration of the condenser coils. The mathematical models for energy and exergy analyses of the individual components and overall system of air-cooled water chillers are presented. This study investigated the potential enhancement of performance efficiency in air-cooled chillers and the energy conversion efficiency of each component, in order to determine how the angle configuration of condenser coils influences chiller performance. This study found that the overall performance of an air-cooled chiller could be improved by approximately 3.4%, and the total irreversibility could be reduced by approximately 2.7%. With each 1% increase in average wind speed over the condenser coils, the overall performance of an air‑cooled chiller was found to be enhanced by approximately 0.43%, and its total irreversibility was reduced by approximately 0.35%. The results of this study can be effectively applied to air-cooled condenser units, and can provide an important basis of reference for developing and enhancing the energy efficiency of air-cooled chillers.

Description: A numerical model of subcritical and trans-critical power cycles using a fixed-flowrate low-temperature heat source has been validated and used to calculate the combinations of the maximum cycle pressure (Pev) and the difference between the source temperature and the maximum working fluid temperature (DT) which maximize the thermal efficiency (ηth) or minimize the non-dimensional exergy losses (β), the total thermal conductance of the heat exchangers (UAt) and the turbine size (SP). Optimum combinations of Pev and DT were calculated for each one of these four objective functions for two working fluids (R134a, R141b), three source temperatures and three values of the non-dimensional power output. The ratio of UAt over the net power output (which is a first approximation of the initial cost per kW) shows that R141b is the better working fluid for the conditions under study.

Description: I defend the idea that the fact that no system is entirely isolated (“Interventionism”) can be used to explain the successful use of the microcanonical distribution in statistical mechanics. The argument turns on claims about what is needed for an adequate explanation of this fact: I argue in particular that various competing explanations do not meet reasonable conditions of adequacy, and that the most striking lacuna in Interventionism—its failure to explain the “arrow of time”—is no real defect.

Description: In his recent book, From Eternity to Here, and in other more technical papers, Sean Carroll (partly in collaboration with Jennifer Chen) has put forward an intriguing new way to think about the origin of the Universe. His approach, in a nutshell, is to raise certain worries about a standard Boltzmannian picture of statistical mechanics, and to present certain commitments that he thinks we ought to hold—commitments that the standard picture doesn’t share. He then proposes a cosmological model—one that purports to give us insight into what sort of process brought about the “initial state” of the universe—that can uniquely accommodate those commitments. The conclusion of Carroll’s argument is that statistical mechanical reasoning provides grounds for provisionally accepting that cosmological model. My goal in this paper is to reconstruct and critically assess this proposal. I argue that “statistical cosmology” requires a careful balance of philosophical intuitions and commitments against technical, scientific considerations; how much stock we ought to place in these intuitions and commitments should depend on where they lead us—those that lead us astray scientifically might well be in need of philosophical re‑examination.

Description: The Shannon interval entropy function as a useful dynamic measure of uncertainty for two sided truncated random variables has been proposed in the literature of reliability. In this paper, we show that interval entropy can uniquely determine the distribution function. Furthermore, we propose a measure of discrepancy between two lifetime distributions at the interval of time in base of Kullback-Leibler discrimination information. We study various properties of this measure, including its connection with residual and past measures of discrepancy and interval entropy, and we obtain its upper and lower bounds.

Description: In this paper, we combine the two universalisms of thermodynamics and dynamical systems theory to develop a dynamical system formalism for classical thermodynamics. Specifically, using a compartmental dynamical system energy flow model we develop a state-space dynamical system model that captures the key aspects of thermodynamics, including its fundamental laws. In addition, we establish the existence of a unique, continuously differentiable global entropy function for our dynamical system model, and using Lyapunov stability theory we show that the proposed thermodynamic model has finite-time convergent trajectories to Lyapunov stable equilibria determined by the system initial energies. Finally, using the system entropy, we establish the absence of Poincaré recurrence for our thermodynamic model and develop clear and rigorous connections between irreversibility, the second law of thermodynamics, and the entropic arrow of time.

Description: This paper presents a supervised variable selection method applied to regression problems. This method selects the variables applying a hierarchical clustering strategy based on information measures. The proposed technique can be applied to single-output regression datasets, and it is extendable to multi-output datasets. For single-output datasets, the method is compared against three other variable selection methods for regression on four datasets. In the multi-output case, it is compared against other state-of-the-art method and tested using two regression datasets. Two different figures of merit are used (for the single and multi-output cases) in order to analyze and compare the performance of the proposed method.

Description: In many life-testing and reliability studies, the experimenter might not always obtain complete information on failure times for all experimental units. Multiply Type-II censored sampling arises in a life-testing experiment whenever the experimenter does not observe the failure times of some units placed on a life-test. In this paper, we obtain estimators for the entropy function of a double exponential distribution under multiply Type-II censored samples using the maximum likelihood estimation and the approximate maximum likelihood estimation procedures. We compare the proposed estimators in the sense of the mean squared errors by using Monte Carlo simulation.

Description: The Rate-Controlled Constrained-Equilibrium (RCCE) method for the description of the time-dependent behavior of dynamical systems in non-equilibrium states is a general, effective, physically based method for model order reduction that was originally developed in the framework of thermodynamics and chemical kinetics. A generalized mathematical formulation is presented here that allows including nonlinear constraints in non-local equilibrium systems characterized by the existence of a non-increasing Lyapunov functional under the system’s internal dynamics. The generalized formulation of RCCE enables to clarify the essentials of the method and the built-in general feature of thermodynamic consistency in the chemical kinetics context. In this paper, we work out the details of the method in a generalized mathematical-physics framework, but for definiteness we detail its well-known implementation in the traditional chemical kinetics framework. We detail proofs and spell out explicit functional dependences so as to bring out and clarify each underlying assumption of the method. In the standard context of chemical kinetics of ideal gas mixtures, we discuss the relations between the validity of the detailed balance condition off-equilibrium and the thermodynamic consistency of the method. We also discuss two examples of RCCE gas-phase combustion calculations to emphasize the constraint-dependent performance of the RCCE method.

Description: A thermodynamic model of an open combined regenerative Brayton and inverse Brayton cycles with regeneration before the inverse cycle is established in this paper by using thermodynamic optimization theory. The flow processes of the working fluid with the pressure drops and the size constraint of the real power plant are modeled. There are 13 flow resistances encountered by the working fluid stream for the cycle model. Four of these, the friction through the blades and vanes of the compressors and the turbines, are related to the isentropic efficiencies. The remaining nine flow resistances are always present because of the changes in flow cross-section at the compressor inlet of the top cycle, regenerator inlet and outlet, combustion chamber inlet and outlet, turbine outlet of the top cycle, turbine outlet of the bottom cycle, heat exchanger inlet, and compressor inlet of the bottom cycle. These resistances associated with the flow through various cross-sectional areas are derived as functions of the compressor inlet relative pressure drop of the top cycle, and control the air flow rate, the net power output and the thermal efficiency. The analytical formulae about the power output, efficiency and other coefficients are derived with 13 pressure drop losses. It is found that the combined cycle with regenerator can reach higher thermal efficiency but smaller power output than those of the base combined cycle at small compressor inlet relative pressure drop of the top cycle.

Description: This study aims to disentangle complexity from randomness and chaos, and to present a definition of complexity that emphasizes its epistemically distinct qualities. I will review existing attempts at defining complexity and argue that these suffer from two major faults: a tendency to neglect the underlying dynamics and to focus exclusively on the phenomenology of complex systems; and linguistic imprecisions in describing these phenomenologies. I will argue that the tendency to discuss phenomenology removed from the underlying dynamics is the main root of the difficulties in distinguishing complex from chaotic or random systems. In my own definition, I will explicitly try to avoid these pitfalls. The theoretical contemplations in this paper will be tested on a sample of five models: the random Kac ring, the chaotic CA30, the regular CA90, the complex CA110 and the complex Bak-Sneppen model. Although these modelling studies are restricted in scope and can only be seen as preliminary, they still constitute on of the first attempts to investigate complex systems comparatively.

Description: Life is considered something different from non-living things, but no single driving force can account for all the different aspects of life, which consists of different levels of hierarchy, such as metabolism, cell physiology, multi-cellular development and organization, population dynamics, ecosystem, and evolution. Although free energy is evidently the driving force in biochemical reactions, there is no established relationship between metabolic energy and spatiotemporal organization of living organisms, or between metabolic energy and genetic information. Since Schrödinger pointed out the importance of exporting entropy in maintaining life, misunderstandings of entropy notion have been obstacles in constructing a unified view on the driving forces of life. Here I present a simplified conceptual framework for unifying driving forces of life at various different levels of hierarchy. The key concept is “entropy deficit”, or simply, ‘inhomogeneity’, which is defined as the difference of maximal possible entropy and actual entropy. This is equivalent to information content in genetic information and protein structure, and is also defined similarly for non-homogeneous structures in ecosystems and evolution. Entropy deficit or inhomogeneoity is a unified measure of all driving forces of life, which could be considered a scientific equivalent to ‘élan vital’ of Bergson.

Description: This paper presents a new design of open parallel microchannels embedded within a permeable continuous moving surface due to reduction of exergy losses in magnetohydrodynamic (MHD) flow at a prescribed surface temperature (PST). The entropy generation number is formulated by an integral of the local rate of entropy generation along the width of the surface based on an equal number of microchannels and no-slip gaps interspersed between those microchannels. The velocity, the temperature, the velocity gradient and the temperature gradient adjacent to the wall are substituted into this equation resulting from the momentum and energy equations obtained numerically by an explicit Runge-Kutta (4, 5) formula, the Dormand-Prince pair and shooting method. The entropy generation number, as well as the Bejan number, for various values of the involved parameters of the problem are also presented and discussed in detail.

Description: This article presents the computation of a set of control parameters for the deterministic prediction of laminar boundary-layer instabilities induced by an imposed unsteady shock interaction. The objective of the study is exploratory in nature by computing a supersonic flight environment for flow over a blunt body and the deterministic prediction of the spectral entropy rates for the boundary layer subjected to an unsteady pressure disturbance. The deterministic values for the spectral entropy rate within the instabilities are determined for each control parameter. Computational results imply that the instabilities are of a span-wise vortex form, that the maximum vertical velocity wave vector components are produced in the region nearest the wall and that extended transient coherent structures are produced in the boundary layer at a vertical location slightly below the mid-point of the boundary layer.

Description: The scope of this paper is twofold. First, we use the Kolmogorov-Sinai Entropy to estimate lower bounds for dominant eigenvalues of nonnegative matrices. The lower bound is better than the Rayleigh quotient. Second, we use this estimate to give a nontrivial lower bound for the gaps of dominant eigenvalues of A and A + V.

Description: The recent development of the theory of fluctuation relations has led to new insights into the ever-lasting question of how irreversible behavior emerges from time-reversal symmetric microscopic dynamics. We provide an introduction to fluctuation relations, examine their relation to dissipation and discuss their impact on the arrow of time question.

Description: Thermosolutal convection in a square cavity filled with a binary perfect gas mixture and submitted to an oriented magnetic field taking into account the effect of radiation heat transfer is numerically investigated. The cavity is heated and cooled along the active walls whereas the two other walls are adiabatic and insulated. Entropy generation due to heat and mass transfer, fluid friction and magnetic effect has been determined for laminar flow by solving numerically: The continuity, momentum energy and mass balance equations, using a Control Volume Finite-Element Method. The structure of the studied flows depends on five dimensionless parameters which are: The Grashof number, the buoyancy ratio, the Hartman number, the inclination angle of the magnetic field and the radiation parameter.

Description: The free energy of an RNA fold is a combination of favorable base pairing and stacking interactions competing with entropic costs of forming loops. Here we show how loop entropy, surprisingly, can promote tertiary order. A general formula for the free energy of forming multibranch and other RNA loops is derived with a polymer-physics based theory. We also derive a formula for the free energy of coaxial stacking in the context of a loop. Simulations support the analytic formulas. The effects of stacking of unpaired bases are also studied with simulations.

Description: In this paper, a stochastic frontier model accounting for spatial dependency is developed using generalized maximum entropy estimation. An application is made for measuring total factor productivity in European agriculture. The empirical results show that agricultural productivity growth in Europe is driven by upward movements of technology over time through technological developments. Results are then compared for a situation in which spatial dependency in the technical inefficiency effects is not accounted.

Description: It is well known that non-enzymatic template directed molecular replicators X + nO -〉 2X exhibit parabolic growth d[X]/dt -〉 k[X]1/2. Here, we analyze the dependence of the effective replication rate constant k on hybridization energies, temperature, strand length, and sequence composition. First we derive analytical criteria for the replication rate k based on simple thermodynamic arguments. Second we present a Brownian dynamics model for oligonucleotides that allows us to simulate their diffusion and hybridization behavior. The simulation is used to generate and analyze the effect of strand length, temperature, and to some extent sequence composition, on the hybridization rates and the resulting optimal overall rate constant k. Combining the two approaches allows us to semi-analytically depict a replication rate landscape for template directed replicators. The results indicate a clear replication advantage for longer strands at lower temperatures in the regime where the ligation rate is rate limiting. Further the results indicate the existence of an optimal replication rate at the boundary between the two regimes where the ligation rate and the dehybridization rates are rate limiting.

Description: Increasing global demand for fresh water is driving the development and implementation of a wide variety of seawater desalination technologies. Entropy generation analysis, and specifically, Second Law efficiency, is an important tool for illustrating the influence of irreversibilities within a system on the required energy input. When defining Second Law efficiency, the useful exergy output of the system must be properly defined. For desalination systems, this is the minimum least work of separation required to extract a unit of water from a feed stream of a given salinity. In order to evaluate the Second Law efficiency, entropy generation mechanisms present in a wide range of desalination processes are analyzed. In particular, entropy generated in the run down to equilibrium of discharge streams must be considered. Physical models are applied to estimate the magnitude of entropy generation by component and individual processes. These formulations are applied to calculate the total entropy generation in several desalination systems including multiple effect distillation, multistage flash, membrane distillation, mechanical vapor compression, reverse osmosis, and humidification-dehumidification. Within each technology, the relative importance of each source of entropy generation is discussed in order to determine which should be the target of entropy generation minimization. As given here, the correct application of Second Law efficiency shows which systems operate closest to the reversible limit and helps to indicate which systems have the greatest potential for improvement.

Description: The nonadditive entropy Sq has been introduced in 1988 focusing on a generalization of Boltzmann–Gibbs (BG) statistical mechanics. The aim was to cover a (possibly wide) class of systems among those very many which violate hypothesis such as ergodicity, under which the BG theory is expected to be valid. It is now known that Sq has a large applicability; more specifically speaking, even outside Hamiltonian systems and their thermodynamical approach. In the present paper we review and comment some relevant aspects of this entropy, namely (i) Additivity versus extensivity; (ii) Probability distributions that constitute attractors in the sense of Central Limit Theorems; (iii) The analysis of paradigmatic low-dimensional nonlinear dynamical systems near the edge of chaos; and (iv) The analysis of paradigmatic long-range-interacting many-body classical Hamiltonian systems. Finally, we exhibit recent as well as typical predictions, verifications and applications of these concepts in natural, artificial, and social systems, as shown through theoretical, experimental, observational and computational results.

Description: This paper proposes a new approach to the seismic blind deconvolution problem in the case of band-limited seismic data characterized by low dominant frequency and short data records, based on Csiszár’s f-divergence. In order to model the probability density function of the deconvolved data, and obtain the closed form formula of Csiszár’s f-divergence, mixture Jones’ family of distributions (MJ) is introduced, by which a new criterion for blind deconvolution is constructed. By applying Neidell’s wavelet model to the inverse filter, we then make the optimization program for multivariate reduce to univariate case. Examples are provided showing the good performance of the method, even in low SNR situations.

Description: Due to the influence of unpredictable random events, the processing time of each operation should be treated as random variables if we aim at a robust production schedule. However, compared with the extensive research on the deterministic model, the stochastic job shop scheduling problem (SJSSP) has not received sufficient attention. In this paper, we propose an artificial bee colony (ABC) algorithm for SJSSP with the objective of minimizing the maximum lateness (which is an index of service quality). First, we propose a performance estimate for preliminary screening of the candidate solutions. Then, the K-armed bandit model is utilized for reducing the computational burden in the exact evaluation (through Monte Carlo simulation) process. Finally, the computational results on different-scale test problems validate the effectiveness and efficiency of the proposed approach.

Description: Mutual information is one of the mostly used measures for evaluating image similarity. In this paper, we investigate the application of three different Tsallis-based generalizations of mutual information to analyze the similarity between scanned documents. These three generalizations derive from the Kullback–Leibler distance, the difference between entropy and conditional entropy, and the Jensen–Tsallis divergence, respectively. In addition, the ratio between these measures and the Tsallis joint entropy is analyzed. The performance of all these measures is studied for different entropic indexes in the context of document classification and registration.

Description: : This article first introduces the concept of wavelet q-Fisher information  and then derives a closed-form  expression of this quantifier for scaling signals of parameter α.  It is shown that this information measure appropriately describes the complexities  of scaling signals and provides further analysis flexibility with the parameter q. In the limit of q → 1, wavelet q-Fisher information  reduces to the standard wavelet Fisher information  and for q  〉 2 it reverses its behavior. Experimental results on synthesized fGn signals validates the level-shift  detection capabilities of wavelet q-Fisher information. A comparative study also shows that wavelet q-Fisher information  locates structural changes in correlated and anti-correlated fGn signals in a way comparable with standard breakpoint location techniques but at a fraction of the time. Finally, the application of this quantifier to H.263 encoded video signals is presented.

Description: Recently the identity of de Bruijn type between the relative entropy and the relative Fisher information with the reference moving has been unveiled by Verdú via MMSE in estimation theory. In this paper, we shall give another proof of this identity in more direct way that the derivative is calculated by applying integrations by part with the heat equation. We shall also derive an integral representation of the relative entropy, as one of the applications of which the logarithmic Sobolev inequality for centered Gaussian measures will be given.

Description: Detection of abrupt change is a key issue for understanding the facts and trends of climate change, but it is also a difficult task in practice. The Mann-Kendall (MK) test is commonly used for treating the issue, while the results are usually affected by the correlation and seasonal characters and sample size of series. This paper proposes a discrete wavelet entropy-aided approach for abrupt change detection, with the temperature analyses in the Haihe River Basin (HRB) as an example. The results show some obviously abrupt temperature changes in the study area in the 1960s–1990s. The MK test results do not reflect those abrupt temperature changes after the 1980s. Comparatively, the proposed approach can detect all main abrupt temperature changes in HRB, so it is more effective than the MK test. Differing from the MK test which only considers series’ value order or the conventional entropy which mainly considers series’ statistical random characters, the proposed approach is to describe the complexity and disorderliness of series using wavelet entropy theories, and it can fairly consider series’ composition and characteristics under different scales, so the results can more accurately reflect not only the abrupt changes, but also the complexity variation of a series over time. However, since it is based on the entropy theories, the series analyzed must have big sample size enough and the sampling rates being smaller than the concerned scale for the accurate computation of entropy values.

Description: Discovering the mechanism that controls the three-dimensional structures of proteins, which are closely related to their biological functions, remains a challenge in modern biological science, even for small proteins. From a thermodynamic viewpoint, the native structure of a protein can be understood as the global minimum of the free energy landscape of the protein-water system. However, it is still difficult to describe the energetics of protein stability in an effective manner. Recently, our group developed a free energy function with an all-atomic description for a protein that focuses on hydration thermodynamics. The validity of the function was examined using structural decoy sets that provide numerous misfolded “non-native” structures. For all targeted sets, the function was able to identify the experimentally determined native structure as the best structure. The energy function can also be used to calculate the binding free energy of a protein with ligands. I review the physicochemical theories employed in the development of the free energy function and recent studies evaluating protein structure stability and protein-ligand binding affinities that use this function.

Description: In recent decades, the approach known as Finite-Dimension Thermodynamics has provided a fruitful theoretical framework for the optimization of heat engines operating between a heat source (at temperature Ths) and a heat sink (at temperature Tcs). We will show in this paper that the approach detailed in a previous paper [1] can be used to analytically model irreversible heat engines (with an additional assumption on the linearity of the heat transfer laws). By defining two dimensionless parameters, the intensity of internal dissipation and heat leakage within a heat engine were quantified. We then established the analogy between an endoreversible heat engine and an irreversible heat engine by using the apparent temperatures (Tcs → Tλ,φ cs, Ths → Tλ,φ hs) and apparent conductances (Kh → Kλ h, Kc → Kλ c). We thus found the analytical expression of the maximum power of an irreversible heat engine. However, these apparent temperatures should not be used to calculate the conversion efficiency at the optimal operating point by analogy with the case of an endoreversible heat engine.

Description: Introducing a new potential, we deduce a general Lagrangian for Dirac–Born– Infeld (DBI) inflation, in which the determinant of the induced metric naturally includes the kinetic energy and the potential energy. In particular, the potential energy and kinetic energy can convert into each other at any same order, which is in agreement with the limit of classical physics. We also present a general sound speed in the evolutions of the universe, and the exact expressions of energy-momentum tensor, pressure and density. Furthermore, from the results we obtain the new equation of states. The analytic form of the action that is consistent with data turns out to be surprisingly simple and easy to categorize. Finally, we examine properties of the dark energy and introduce a novel mechanism for realizing either quintessence or phantom dark energy dominated phases within a string theoretical context.

Description: We address the problem of non-parametric estimation of the recently proposed measures of statistical dispersion of positive continuous random variables. The measures are based on the concepts of differential entropy and Fisher information and describe the “spread” or “variability” of the random variable from a different point of view than the ubiquitously used concept of standard deviation. The maximum penalized likelihood estimation of the probability density function proposed by Good and Gaskins is applied and a complete methodology of how to estimate the dispersion measures with a single algorithm is presented. We illustrate the approach on three standard statistical models describing neuronal activity.

Description: Based on information theory, the single neuron adaptive control problem for stochastic systems with non-Gaussian noises is investigated in this paper. Here, the statistic information of the output within a receding window rather than the output value is used for the tracking problem. Firstly, the single neuron controller structure, which has the ability of self-learning and self-adaptation, is established. Then, an improved performance criterion is given to train the weights of the single neuron. Furthermore, the mean-square convergent condition of the proposed control algorithm is formulated. Finally, comparative simulation results are presented to show that the proposed algorithm is superior to the PID controller. The contributions of this work are twofold: (1) the optimal control algorithm is formulated in the data-driven framework, which needn’t the precise system model that is usually difficult to obtain; (2) the control problem of non-Gaussian systems can be effectively dealt with by the simple single neuron controller under improved minimum entropy criterion.

Description: Feedback or closed-loop control allows dynamical systems to increase their performance up to a limit imposed by the second law of thermodynamics. It is expected that within this limit, the system performance increases as the controller uses more information about the system. However, despite the relevant progresses made recently, a general and complete formal development to justify this statement using information theory is still lacking. We present here the state-of-the-art and the main open problems that include aspects of the redundancy of correlated operations of feedback control and the continuous operation of feedback control. Complete answers to these questions are required to firmly establish the thermodynamics of feedback controlled systems. Other relevant open questions concern the implications of the theoretical results for the limitations in the performance of feedback controlled flashing ratchets, and for the operation and performance of nanotechnology devices and biological systems.

Description: A new statistical dynamical closure theory for general inhomogeneous turbulent flows and subgrid modeling is presented. This Self-Energy (SE) closure represents all eddy interactions through nonlinear dissipation or forcing ‘self-energy’ terms in the mean-field, covariance and response function equations. This makes the renormalization of the bare dissipation and forcing, and the subgrid modeling problem, transparent. The SE closure generalizes the quasi-diagonal direct interaction closure to allow for more complex interactions. The SE closure is applicable to flows in different geometries, is exact near maximum entropy states corresponding to canonical equilibrium, and provides a framework for deriving simpler realizable closures.

Description: It has been suggested heuristically by Unruh and Wald, and independently by Page, that at given energy and volume, thermal radiation has the largest entropy. The suggestion leads to the corresponding universal bound on entropy of physical systems. Using a gedanken experiment we show that the bound follows from the Second Law of Thermodynamics if the CPT symmetry is assumed and a general condition on matter holds. The experiment suggests that a wide class of Lorentz invariant local quantum field theories obeys a bound on the density of states.

Description: Consideration is given to macrosystems called paramacrosystems with states of finite capacity and distinguishable and undistinguishable elements with stochastic behavior. The paramacrosystems fill a gap between Fermi and Einstein macrosystems. Using the method of the generating functions, we have obtained expressions for probabilistic characteristics (distribution of the macrostate probabilities, physical and information entropies) of the paramacrosystems. The cases with equal and unequal prior probabilities for elements to occupy the states with finite capacities are considered. The unequal prior probabilities influence the morphological properties of the entropy functions and the functions of the macrostate probabilities, transforming them in the multimodal functions. The examples of the paramacrosystems with two-modal functions of the entropy and distribution of the macrostate probabilities are presented. The variation principle does not work for such cases.

Description: Constitutive laws for multi-component fluids (MCF) is one of the thorniest problems in science. Two questions explored here are: how to ensure that these relations reduce to accepted forms when all but one of the constituents vanishes; and what constraints does the Second Law impose on the dynamics of viscous fluids at different temperatures? The analysis suggests an alternative to the metaphysical principles for MCF proposed by Truesdell [1].

Description: In modified theories of gravity including a critical acceleration scale a0, a critical length scale rM = (GM/a0)1/2 will naturally arise with the transition from the Newtonian to the dark matter mimicking regime occurring for systems larger than rM. This adds a second critical scale to gravity, in addition to the one introduced by the criterion v 〈 c of the Schwarzschild radius, rS = 2GM/c2. The distinct dependencies of the two above length scales give rise to non-trivial phenomenology in the (mass, length) plane for astrophysical structures, which we explore here. Surprisingly, extrapolation to atomic scales suggests gravity should be at the dark matter mimicking regime there.

Description: Many natural and man-made lineaments form networks that can be analysed through entropy and energy considerations. Here we report the results of a detailed study of the variations in trends and lengths of 1554 named streets and 6004 street segments, forming a part of the evolving street network of the city of Dundee in East Scotland. Based on changes in the scaling exponents (ranging from 0.24 to 3.89), the streets can be divided into 21 populations. For comparison, we analysed 221 active crustal fractures in Iceland that (a) are of similar lengths as the streets of Dundee; (b) are composed of segments; and (c) form evolving networks. The streets and fractures follow power-law size distributions (validated through various statistical tests) that can be partly explained in terms of the energies needed for their formation. The entropies of the 21 street populations and 9 fracture populations show strong linear correlations with (1) the scaling exponents (R2 = 0.845–0.947 for streets, R2 = 0.859 for fractures) and with (2) the length ranges, that is, the differences between the longest and shortest streets/fractures, (R2 = 0.845–0.906 for streets, R2 = 0.927 for fractures).

Description: We derive an algorithm to recursively determine the lap number (minimal number of monotonicity segments) of the iterates of twice differentiable l-modal map, enabling to numerically calculate the topological entropy of these maps. The algorithm is obtained by the min-max sequences—symbolic sequences that encode qualitative information about all the local extrema of iterated maps.

Description: The entropy calculation for radiation fluxes is reviewed and applied to simple radiation-surface interactions. A plate interacting with radiation from a hot object in the zenith of the hemisphere surrounded by a colder atmosphere is analyzed in detail. The entropy generation rate upon absorption and reflection of the incoming radiation is calculated and discussed. The plate is adiabatic in a first version (thermal equilibrium), then its temperature is fixed by allowing a heat flux to or from the plate. This analysis prepares the way towards an entropy generation minimization analysis of more complex radiation settings.

Description: We investigate the relationship between the motions of the same peptide loop segment incorporated within a protein structure and motions of free or end-constrained peptides. As a reference point we also compare against alanine chains having the same length as the loop. Both the analysis of atomic molecular dynamics trajectories and structure-based elastic network models, reveal no general dependence on loop length or on the number of solvent exposed residues. Rather, the whole structure affects the motions in complex ways that depend strongly and specifically on the tertiary structure of the whole protein. Both the Elastic Network Models and Molecular Dynamics confirm the differences in loop dynamics between the free and structured contexts; there is strong agreement between the behaviors observed from molecular dynamics and the elastic network models. There is no apparent simple relationship between loop mobility and its size, exposure, or position within a loop. Free peptides do not behave the same as the loops in the proteins. Surface loops do not behave as if they were random coils, and the tertiary structure has a critical influence upon the apparent motions. This strongly implies that entropy evaluation of protein loops requires knowledge of the motions of the entire protein structure.

Description: This paper presents a novel framework for the complexity analysis of rainfall, runoff, and runoff coefficient (RC) time series using multiscale entropy (MSE). The MSE analysis of RC time series was used to investigate changes in the complexity of rainfall-runoff processes due to human activities. Firstly, a coarse graining process was applied to a time series. The sample entropy was then computed for each coarse-grained time series, and plotted as a function of the scale factor. The proposed method was tested in a case study of daily rainfall and runoff data for the upstream Wu–Tu watershed. Results show that the entropy measures of rainfall time series are higher than those of runoff time series at all scale factors. The entropy measures of the RC time series are between the entropy measures of the rainfall and runoff time series at various scale factors. Results also show that the entropy values of rainfall, runoff, and RC time series increase as scale factors increase. The changes in the complexity of RC time series indicate the changes of rainfall-runoff relations due to human activities and provide a reference for the selection of rainfall-runoff models that are capable of dealing with great complexity and take into account of obvious self-similarity can be suggested to the modeling of rainfall-runoff processes. Moreover, the robustness of the MSE results were tested to confirm that MSE analysis is consistent and the same results when removing 25% data, making this approach suitable for the complexity analysis of rainfall, runoff, and RC time series.

Description: The rotated quasi-orthogonal space-time block code (RQSTBC) for asynchronous cooperative diversity is proposed in this paper. The source selects half of the symbols from a signal constellation set and the other half of them from that constellation rotated with the optimum angle. Meanwhile, it constructs orthogonal frequency division multiplexing (OFDM) frames to counterbalance time delays of the signals. Then, relays create the frequency domain quasi-orthogonal space-time block transmitted signals matrix in such a way that its items are staggered to take on the Jafarkhani code structure or time-reversion of it. These three stages let the received signals at the destination take on RQSTBC structure with diversity order 4, which results in the fast symbol-pair-wise maximum likelihood (ML) decoder. Simulation results have shown that the proposed scheme outperforms the other asynchronous cooperative diversity schemes considered in this paper.

Description: Quantum gravity, the initial low entropy state of the Universe, and the problem of time are interlocking puzzles. In this article, we address the origin of the arrow of time from a cosmological perspective motivated by a novel approach to quantum gravitation. Our proposal is based on a quantum counterpart of the equivalence principle, a general covariance of the dynamical phase space. We discuss how the nonlinear dynamics of such a system provides a natural description for cosmological evolution in the early Universe. We also underscore connections between the proposed non-perturbative quantum gravity model and fundamental questions in non-equilibrium statistical physics.

Description: One of the crucial properties of the Boltzmann-Gibbs entropy in the context of classical thermodynamics is extensivity, namely proportionality with the number of elements of the system. The Boltzmann-Gibbs entropy satisfies this prescription if the subsystems are statistically (quasi-) independent, or typically if the correlations within the system are essentially local. In such cases the energy of the system is typically extensive and the entropy is additive. In general, however, the situation is not of this type and correlations may be far from negligible at all scales. Tsallis in 1988 introduced an entropic expression characterized by an index q which leads to a non-extensive statistics. Tsallis entropy, Sq, is the basis of the so called non-extensive statistical mechanics, which generalizes the Boltzmann-Gibbs theory. Tsallis statistics have found applications in a wide range of phenomena in diverse disciplines such as physics, chemistry, biology, medicine, economics, geophysics, etc. The focus of this special issue of Entropy was to solicit contributions that apply Tsallis entropy in various scientific fields. [...]

Description: We consider non-equilibrium open statistical systems, subject to potentials and to external “heat baths” (hb) at thermal equilibrium at temperature T (either with ab initio dissipation or without it). Boltzmann’s classical equilibrium distributions generate, as Gaussian weight functions in momenta, orthogonal polynomials in momenta (the position-independent Hermite polynomialsHn’s). The moments of non-equilibrium classical distributions, implied by the Hn’s, fulfill a hierarchy: for long times, the lowest moment dominates the evolution towards thermal equilibrium, either with dissipation or without it (but under certain approximation). We revisit that hierarchy, whose solution depends on operator continued fractions. We review our generalization of that moment method to classical closed many-particle interacting systems with neither a hb nor ab initio dissipation: with initial states describing thermal equilibrium at T at large distances but non-equilibrium at finite distances, the moment method yields, approximately, irreversible thermalization of the whole system at T, for long times. Generalizations to non-equilibrium quantum interacting systems meet additional difficulties. Three of them are: (i) equilibrium distributions (represented through Wigner functions) are neither Gaussian in momenta nor known in closed form; (ii) they may depend on dissipation; and (iii) the orthogonal polynomials in momenta generated by them depend also on positions. We generalize the moment method, dealing with (i), (ii) and (iii), to some non-equilibrium one-particle quantum interacting systems. Open problems are discussed briefly.

Description: Several measures of volatility have been developed in order to quantify the degree of uncertainty of an energy price series, which include historical volatility and price velocities, among others. This paper suggests using the permutation entropy, topological entropy and the modified permutation entropy as alternatives to measure volatility in energy markets. Simulated data show that these measures are more appropriate to quantify the uncertainty associated to a time series than those based on the standard deviation or other measures of dispersion. Finally, the proposed method is applied to some typical electricity markets: Nord Pool, Ontario, Omel and four Australian markets.

Description: In this paper we describe the potential of employing the concept of thermodynamic entropy generation to assess degradation in processes involving metal fatigue. It is shown that empirical fatigue models such as Miner’s rule, Coffin-Manson equation, and Paris law can be deduced from thermodynamic consideration.

Description: We address the question of thermodynamics of regular cosmological spherically symmetric black holes with the de Sitter center. Space-time is asymptotically de Sitter as r → 0 and as r → ∞. A source term in the Einstein equations connects smoothly two de Sitter vacua with different values of cosmological constant: 8πGTμν = Λδμν as r → 0, 8πGTμν = λδμν as r → ∞ with λ 〈 Λ. It represents an anisotropic vacuum dark fluid defined by symmetry of its stress-energy tensor which is invariant under the radial boosts. In the range of the mass parameter Mcr1 ≤ M ≤ Mcr2 it describes a regular cosmological black hole. Space-time in this case has three horizons: a cosmological horizon rc, a black hole horizon rb 〈 rc, and an internal horizon ra 〈 rb, which is the cosmological horizon for an observer in the internal R-region asymptotically de Sitter as r → 0. We present the basicfeatures of space-time geometry and the detailed analysis of thermodynamics of horizons using the Padmanabhan approach relevant for a multi-horizon space-time with a non-zero pressure. We find that in a certain range of parameters M and q =√Λ/λ there exist a global temperature for an observer in the R-region between the black hole horizon rb and cosmological horizon rc. We show that a second-order phase transition occurs in the course of evaporation, where a specific heat is broken and a temperature achieves its maximal value. Thermodynamical preference for a final point of evaporation is thermodynamically stable double-horizon (ra = rb) remnant with the positive specific heat and zero temperature.

Description: There are numerous characterizations of Shannon entropy and Tsallis entropy as measures of information obeying certain properties. Using work by Faddeev and Furuichi, we derive a very simple characterization. Instead of focusing on the entropy of a probability measure on a finite set, this characterization focuses on the “information loss”, or change in entropy, associated with a measure-preserving function. Information loss is a special case of conditional entropy: namely, it is the entropy of a random variable conditioned on some function of that variable. We show that Shannon entropy gives the only concept of information loss that is functorial, convex-linear and continuous. This characterization naturally generalizes to Tsallis entropy as well.

Description: Within the thermodynamic framework with internal variables, the classical Hamilton’s principle for elastic bodies is extended to inelastic bodies composed of materials whose free energy densities are point functions of internal variables, or the so‑termed Green-inelastic bodies, subject to finite deformation and non-conservative external forces. Yet this general result holds true even without the Green-inelasticity presumption under a more general interpretation of the infinitesimal internal rearrangement. Three special cases are discussed following the generalized form: (a) the Green-elastic bodies whose free energy can be identified with the strain energy; (b) the Green-inelastic bodies composed of materials compliant with the additive decomposition of strain; and (c) the Green-inelastic bodies undergoing isothermal relaxation processes where the thermodynamic forces conjugate to internal variables, or the so-termed internal forces prove to be potential forces. This paper can be viewed as an extension of Yang et al. [1].

Description: Over the last couple of decades nonextensive Tsallis entropy has shown remarkable applicability to describe nonequilibrium physical systems with large variability and multifractal structure. Herein, we review recent results from the application of Tsallis statistical mechanics to the detection of dynamical changes related with the occurrence of magnetic storms. We extend our review to describe attempts to approach the dynamics of magnetic storms and solar flares by means of universality through Tsallis statistics. We also include a discussion of possible implications on space weather forecasting efforts arising from the verification of Tsallis entropy in the complex system of the magnetosphere.

Description: This paper presents a study and a comparison of the use of different information-theoretic measures for polygonal mesh simplification. Generalized measures from Information Theory such as Havrda–Charvát–Tsallis entropy and mutual information have been applied. These measures have been used in the error metric of a surfaces implification algorithm. We demonstrate that these measures are useful for simplifying three-dimensional polygonal meshes. We have also compared these metrics with the error metrics used in a geometry-based method and in an image-driven method. Quantitative results are presented in the comparison using the root-mean-square error (RMSE).

Description: We discuss a one-parameter family of generalized cross entropy between two distributions with the power index, called the projective power entropy. The cross entropy is essentially reduced to the Tsallis entropy if two distributions are taken to be equal. Statistical and probabilistic properties associated with the projective power entropy are extensively investigated including a characterization problem of which conditions uniquely determine the projective power entropy up to the power index. A close relation of the entropy with the Lebesgue space Lp and the dual Lq is explored, in which the escort distribution associates with an interesting property. When we consider maximum Tsallis entropy distributions under the constraints of the mean vector and variance matrix, the model becomes a multivariate q-Gaussian model with elliptical contours, including a Gaussian and t-distribution model. We discuss the statistical estimation by minimization of the empirical loss associated with the projective power entropy. It is shown that the minimum loss estimator for the mean vector and variance matrix under the maximum entropy model are the sample mean vector and the sample variance matrix. The escort distribution of the maximum entropy distribution plays the key role for the derivation.

Description: Statistical dynamical closures for inhomogeneous turbulence described by multi‑field equations are derived based on renormalized perturbation theory. Generalizations of the computationally tractable quasi-diagonal direct interaction approximation for inhomogeneous barotropic turbulent flows over topography are developed. Statistical closures are also formulated for large eddy simulations including subgrid models that ensure the same large scale statistical behavior as higher resolution closures. The focus is on baroclinic quasigeostrophic and three-dimensional inhomogeneous turbulence although the framework is generally applicable to classical field theories with quadratic nonlinearity.

Description: Unlike the secondary structure elements that connect in protein structures, loop fragments in protein chains are often highly mobile even in generally stable proteins. The structural variability of loops is often at the center of a protein’s stability, folding, and even biological function. Loops are found to mediate important biological processes, such as signaling, protein-ligand binding, and protein-protein interactions. Modeling conformations of a loop under physiological conditions remains an open problem in computational biology. This article reviews computational research in loop modeling, highlighting progress and challenges. Important insight is obtained on potential directions for future research.

Description: A number of measures have been used in the structural biology literature to compare the shapes or conformations of biological macromolecules. However, the issue of how to compare two ensembles of conformations has received far less attention. Herein, the problem of how to quantitatively compare two such ensembles is addressed in several different ways using concepts from probability and information theory. Ultimately, such metrics could be used in the evaluation of structure-prediction algorithms and the analysis of how conformational mobility is inhibited by bound ligands.

Description: Based on a covariant theory of equilibrium Thermodynamics, a Statistical Relativistic Mechanics is developed for the non-interacting case. Relativistic Thermodynamics and Jüttner Relativistic Distribution Function in a moving frame are obtained by using this covariant theory. A proposal for a Relativistic Statistical Mechanics is exposed for the interacting case.

Description: Several previous results valid for one-dimensional nonlinear Fokker-Planck equations are generalized to N-dimensions. A general nonlinear N-dimensional Fokker-Planck equation is derived directly from a master equation, by considering nonlinearitiesin the transition rates. Using nonlinear Fokker-Planck equations, the H-theorem is proved;for that, an important relation involving these equations and general entropic forms is introduced. It is shown that due to this relation, classes of nonlinear N-dimensional Fokker-Planck equations are connected to a single entropic form. A particular emphasis is given to the class of equations associated to Tsallis entropy, in both cases of the standard, and generalized definitions for the internal energy.

Description: In this communication we show that Fisher’s information measure emerges as a direct consequence of the scale-invariance of Schröedinger’s equation. Interesting, well-known additional results are re-obtained as well, for whose derivation only (and this is the novelty) the scale invariance property is needed, without further ado.

Description: We perform an asymptotic analysis of the NSB estimator of entropy of a discrete random variable. The analysis illuminates the dependence of the estimates on the number of coincidences in the sample and shows that the estimator has a well defined limit for a large cardinality of the studied variable. This allows estimation of entropy with no a priori assumptions about the cardinality. Software implementation of the algorithm is available.