ALBERT

Description: The elementary particles of relativistic quantum field theory are not simple field quanta, as has long been assumed. Rather, they supplement quantum fields, on which they depend on but to which they are not reducible, as shown here with particles defined instead as a unified collection of properties that appear in both physical symmetry group representations and field propagators. This notion of particle provides consistency between the practice of particle physics and its basis in quantum field theory.

Description: There has been a recent surge of interest in theory and methods for calculating the entropy of landscape patterns, but relatively little is known about the thermodynamic consistency of these approaches. I posit that for any of these methods to be fully thermodynamically consistent, they must meet three conditions. First, the computed entropies must lie along the theoretical distribution of entropies as a function of total edge length, which Cushman showed was a parabolic function following from the fact that there is a normal distribution of permuted edge lengths, the entropy is the logarithm of the number of microstates in a macrostate, and the logarithm of a normal distribution is a parabolic function. Second, the entropy must increase over time through the period of the random mixing simulation, following the expectation that entropy increases in a closed system. Third, at full mixing, the entropy will fluctuate randomly around the maximum theoretical value, associated with a perfectly random arrangement of the lattice. I evaluated these criteria in a test condition involving a binary, two-class landscape using the Cushman method of directly applying the Boltzmann relation (s = klogW) to permuted landscape configurations and measuring the distribution of total edge length. The results show that the Cushman method directly applying the classical Boltzmann relation is fully consistent with these criteria and therefore fully thermodynamically consistent. I suggest that this method, which is a direct application of the classical and iconic formulation of Boltzmann, has advantages given its direct interpretability, theoretical elegance, and thermodynamic consistency.

Description: We present a finite-order system of recurrence relations for the permanent of circulant matrices containing a band of k any-value diagonals on top of a uniform matrix (for k=1,2 and 3) and the method for deriving such recurrence relations, which is based on the permanents of the matrices with defects. The proposed system of linear recurrence equations with variable coefficients provides a powerful tool for the analysis of the circulant permanents, their fast, linear-time computing; and finding their asymptotics in a large-matrix-size limit. The latter problem is an open fundamental problem. Its solution would be tremendously important for a unified analysis of a wide range of the nature’s ♯P-hard problems, including problems in the physics of many-body systems, critical phenomena, quantum computing, quantum field theory, theory of chaos, fractals, theory of graphs, number theory, combinatorics, cryptography, etc.

Description: Affect plays a major role in the individual’s daily life, driving the sensemaking of experience, psychopathological conditions, social representations of phenomena, and ways of coping with others. The characteristics of affect have been traditionally investigated through physiological, self-report, and behavioral measures. The present article proposes a text-based measure to detect affect intensity: the Affective Saturation Index (ASI). The ASI rationale and the conceptualization of affect are overviewed, and an initial validation study on the ASI’s convergent and concurrent validity is presented. Forty individuals completed a non-clinical semi-structured interview. For each interview transcript, the ASI was esteemed and compared to the individual’s physiological index of propensity to affective arousal (measured by heart rate variability (HRV)); transcript semantic complexity (measured through the Semantic Entropy Index (SEI)); and lexical syntactic complexity (measured through the Flesch–Vacca Index (FVI)). ANOVAs and bi-variate correlations estimated the size of the relationships between indexes and sample characteristics (age, gender), then a set of multiple linear regressions tested the ASI’s association with HRV, the SEI, and the FVI. Results support the ASI construct and criteria validity. The ASI proved able to detect affective saturation in interview transcripts (SEI and FVI, adjusted R2 = 0.428 and adjusted R2 = 0.241, respectively) and the way the text’s affective saturation reflected the intensity of the individual’s affective state (HRV, adjusted R2 = 0.428). In conclusion, although the specificity of the sample (psychology students) limits the findings’ generalizability, the ASI provides the chance to use written texts to measure affect in accordance with a dynamic approach, independent of the spatio-temporal setting in which they were produced. In doing so, the ASI provides a way to empower the empirical analysis of fields such as psychotherapy and social group dynamics.

Description: Should the internal structure of a system matter when it comes to autonomy? While there is still no consensus on a rigorous, quantifiable definition of autonomy, multiple candidate measures and related quantities have been proposed across various disciplines, including graph-theory, information-theory, and complex system science. Here, I review and compare a range of measures related to autonomy and intelligent behavior. To that end, I analyzed the structural, information-theoretical, causal, and dynamical properties of simple artificial agents evolved to solve a spatial navigation task, with or without a need for associative memory. By contrast to standard artificial neural networks with fixed architectures and node functions, here, independent evolution simulations produced successful agents with diverse neural architectures and functions. This makes it possible to distinguish quantities that characterize task demands and input-output behavior, from those that capture intrinsic differences between substrates, which may help to determine more stringent requisites for autonomous behavior and the means to measure it.

Description: In the last few decades, text mining has been used to extract knowledge from free texts. Applying neural networks and deep learning to natural language processing (NLP) tasks has led to many accomplishments for real-world language problems over the years. The developments of the last five years have resulted in techniques that have allowed for the practical application of transfer learning in NLP. The advances in the field have been substantial, and the milestone of outperforming human baseline performance based on the general language understanding evaluation has been achieved. This paper implements a targeted literature review to outline, describe, explain, and put into context the crucial techniques that helped achieve this milestone. The research presented here is a targeted review of neural language models that present vital steps towards a general language representation model.

Description: Modern computational models in supervised machine learning are often highly parameterized universal approximators. As such, the value of the parameters is unimportant, and only the out of sample performance is considered. On the other hand much of the literature on model estimation assumes that the parameters themselves have intrinsic value, and thus is concerned with bias and variance of parameter estimates, which may not have any simple relationship to out of sample model performance. Therefore, within supervised machine learning, heavy use is made of ridge regression (i.e., L2 regularization), which requires the the estimation of hyperparameters and can be rendered ineffective by certain model parameterizations. We introduce an objective function which we refer to as Information-Corrected Estimation (ICE) that reduces KL divergence based generalization error for supervised machine learning. ICE attempts to directly maximize a corrected likelihood function as an estimator of the KL divergence. Such an approach is proven, theoretically, to be effective for a wide class of models, with only mild regularity restrictions. Under finite sample sizes, this corrected estimation procedure is shown experimentally to lead to significant reduction in generalization error compared to maximum likelihood estimation and L2 regularization.

Description: The concept of Heider balance, usually applied to interpersonal relations, is generalized here to opinions gathered in surveys. At first, we compare four algorithms, which drive a matrix dataset to a balanced state. The criterion is that the final state obtained with an algorithm should be as close as possible to the initial state. The result is that deterministic differential equations work better than their Monte Carlo counterparts. Next, we apply the winning algorithms to the matrix of correlations between opinions gathered in American states between 1974 and 1998. The results are interpreted in terms of the classic comfort hypothesis (E. Babbie, 2007).

Description: The Jeffreys divergence is a renown arithmetic symmetrization of the oriented Kullback–Leibler divergence broadly used in information sciences. Since the Jeffreys divergence between Gaussian mixture models is not available in closed-form, various techniques with advantages and disadvantages have been proposed in the literature to either estimate, approximate, or lower and upper bound this divergence. In this paper, we propose a simple yet fast heuristic to approximate the Jeffreys divergence between two univariate Gaussian mixtures with arbitrary number of components. Our heuristic relies on converting the mixtures into pairs of dually parameterized probability densities belonging to an exponential-polynomial family. To measure with a closed-form formula the goodness of fit between a Gaussian mixture and an exponential-polynomial density approximating it, we generalize the Hyvärinen divergence to α-Hyvärinen divergences. In particular, the 2-Hyvärinen divergence allows us to perform model selection by choosing the order of the exponential-polynomial densities used to approximate the mixtures. We experimentally demonstrate that our heuristic to approximate the Jeffreys divergence between mixtures improves over the computational time of stochastic Monte Carlo estimations by several orders of magnitude while approximating the Jeffreys divergence reasonably well, especially when the mixtures have a very small number of modes.

Description: This paper presents a multivariate textual analysis of more than 1300 papers on entropy in ecology. There are six main insights that emerged. First, there is a large body of literature that has addressed some aspect of entropy in ecology, most of which has been published in the last 5–10 years. Second, the vast majority of these papers focus on species distribution, species richness, relative abundance or trophic structure and not landscape-scale patterns or processes, pe se. Third, there have been few papers addressing landscape-level questions related to entropy. Fourth, the quantitative analysis with hierarchical clustering identified a strongly nested structure among papers that addressed entropy in ecology. Fifth, there is clear differentiation of papers focused on landscape-level applications of entropy from other papers, with landscape focused papers clustered together at each level of the hierarchy in a relatively small and closely associated group. Sixth, this group of landscape-focused papers was substructured between papers that explicitly adopted entropy measures to quantify the spatial pattern of landscape mosaics, often using variations on Boltzmann entropy, versus those that utilize Shannon entropy measures from information theory, which are not generally explicit in their assessment of spatial configuration. This review provides a comprehensive, quantitative assessment of the scope, trends and relationships among a large body of literature related to entropy in ecology and for the first time puts landscape ecological research on entropy into that context.