American Journal of Computational and Applied Mathematics
p-ISSN: 2165-8935 e-ISSN: 2165-8943
2017; 7(1): 11-24
doi:10.5923/j.ajcam.20170701.02

Boris Menin
Mechanical & Refrigeration Consultant Expert, Beer-Sheba, Israel
Correspondence to: Boris Menin, Mechanical & Refrigeration Consultant Expert, Beer-Sheba, Israel.
| Email: | ![]() |
Copyright © 2017 Scientific & Academic Publishing. All Rights Reserved.
This work is licensed under the Creative Commons Attribution International License (CC BY).
http://creativecommons.org/licenses/by/4.0/

In this paper, we aim to establish the specific foundations in modeling the physical phenomena. For this purpose, we discuss a representation of information theory for the optimal design of the model. We introduce a metric called comparative uncertainty by which a priori discrepancy between the chosen model and the observed material object is verified. Moreover, we show that the information quantity inherent in the model can be calculated and how it proscribes the required number of variables which should be taken into account. It is thus concluded that in most physically relevant cases (micro- and macro-physics), the comparative uncertainty can be realized by field tests or computer simulations within the prearranged variation of the main recorded variable. The fundamentally novel concept of the introduced uncertainty can be widely used and is universally valid. We introduce examples of the proposed approach as applied to Heisenberg's uncertainty relation, heat and mass transfer equations, and measurements of the fine structure constant.
Keywords: Information theory, Similarity theory, Mathematical modeling, Heisenberg uncertainty relation, Heat and mass transfer, Fine structure constant
Cite this paper: Boris Menin, Information Measure Approach for Calculating Model Uncertainty of Physical Phenomena, American Journal of Computational and Applied Mathematics , Vol. 7 No. 1, 2017, pp. 11-24. doi: 10.5923/j.ajcam.20170701.02.
![]() | (1) |
![]() | (2) |
![]() | (3) |
is the reduced Planck constant, and c is the speed of light. The results are purely theoretical in nature, although it is possible, judging by the numerous references to this article, that one may find applications of the proposed formula in medicine or biology. A study of quantum gates has been developed [13]. The author considered these gates as physical devices which are characterized by the existence of random uncertainty. Reliability of quantum gates was investigated from the perspective of information complexity. In turn, the complexity of the gate’s operation was determined by the difference between the entropies of the variables characterizing the initial and final states. The study has stated that the gate operation may be associated with unlimited entropy, implying the impossibility of realization of the quantum gates function under certain conditions. The relevance of this study comes from its conceptual approach of use of variables, as a specific metric for calculation of information quantity changing between input and output of the apparatus model.The information theory-based principles have been investigated in relation to uncertainty of mathematical models of water-based systems [14]. In this research, the mismatch between physically-based models and observations has been minimized by the use of intelligent data-driven models and methods of information theory. The real successes were achieved in developing forecast models for the Rhine and Meuse rivers in the Netherlands. In addition to the possibility of forecasting the uncertainties and accuracy of model predictions, the application of information theory principles indicates that, alongside appropriate analysis techniques, patterns in model uncertainties can be used as indicators to make further improvements to physically-based computational models. At the same time, there have been no attempts to apply these methodologies to results to other physical or engineering tasks. The design information entropy was introduced as a state that reflects both complexity and refinement [15]. The author argued that it can be useful as some measure of design efficacy and design quality. The method has been applied to the conceptual design of an unmanned aircraft, going through concept generation, concept selection, and parameter optimization. For the purposes of this study it is important to note that introducing the design information entropy as a state can be used as a quantitative description for various aspects in the design process, both with regards to structural information of architecture and connectivity, as well as for parameter values, both discrete and continuous.In [16] there has been conducted a systematic review of major physical applications of information theory to physical systems, its methods in various subfields of physics, and examples of how specific disciplines adapt this tool. In the context of the proposed approach for practical purposes in experimental and theoretical physics and engineering, the physics of computation, acoustics, climate physics, and chemistry have been mentioned. However, no surveys, reviews, research studies were found with respect to apply information theory for calculating an uncertainty of models of the phenomenon or technological process. The approach that uses the tools of estimation theory to fuse together information from multi-fidelity analysis, resulting in a Bayesian-based approach to mitigating risk in complex design has been proposed [6]. Maximum entropy characterizations of model discrepancies have been used to represent epistemic uncertainties due to modeling limitations and model assumptions. The revolutionary methodology has been applied to multidisciplinary design optimization and demonstrated on a wing-sizing problem for a high altitude, long endurance aircraft. Uncertainties have been examined that have been explicitly maintained and propagated through the design and synthesis process, resulting in quantified uncertainties on the output estimates of quantities of interest. However, the proposed approach focuses on the optimization of the predefined and computer-ready simulation model.For these reasons there are only a handful of different methods and techniques used to identify matching of physical-mathematical models and studied physical phenomena or technological processes by the uncertainty formulated with usage of the concepts of "information quantity" and “entropy”. All the above-mentioned methodologies are focused on identifying a posterior uncertainty caused by the ineradicable gap between model and a physical system. At the same time, according to our data, in the modern literature there does not exist any physical or mathematical relationship which could formulate the interaction between the level of detailed descriptions of the material object (the number of recorded variables) and the lowest achievable total experimental uncertainty of the main parameter.Thus, it is advisable to choose the appropriate/acceptable level of detail of the object (a finite number of registered variables) and formulate the requirements for the accuracy of input data and the uncertainty of specific target function (similarity criteria), which describes the "livelihood" and characterizes the behavior of the observed object.
, such that
; d. The relation between the different types of variables obeys the laws of associativity and commutativity: Associativity:
, Commutativity: A · B = (B · A); e. For all A ≠ (1) and m ∈ N; m ≠ 0, the expression
is the case; f. The complete set consisting of an infinite number of types of variable has a finite generating system. This means that there are a finite number of elements C1, C2… CH, through which any type of variable q can be represented as![]() | (4) |
– means "corresponds to dimension";
– integer coefficients,
where λ is the set of integers.The uniqueness of such a representation is not expected in advance. Axioms “a-f” form a complete system of axioms of an Abelian group. By taking into account the basic equations of the theory of electricity, magnetism, gravity and thermodynamics, they remain unchanged.Now we use the theorem that holds for an Abelian group: among H elements of the generating system C1, C2… CH there is a subset
of elements B1, B2… Bh, with the property that each element can be uniquely represented in the form![]() | (5) |
elements
are called the basis of the group, and
are the basic types of variables.
is the product of the dimensions of the main types of variables
.For the above-stated conditions the following statement holds: the group, which satisfies axioms a-f, has, at least, one basis
. In the case h > 2, there are infinitely many valid bases. How to determine the number of elements of a basis? In order to answer this question, let’s apply the approach introduced for the SI units. In this case, you need to pay attention to the following irrefutable situation. We should be aware that the condition (4) is a very strong constraint. It is well known that not every physical system can be represented as an Abelian group. Presentation of experimental results as a formula, in which the main parameter is represented in the form of the correlation function of the one-parameter selected functions, has many limitations [18]. However, in this study, the condition (4) can be successfully applied to the dummy system, in terms of lack in nature, which is SI. In this system, the secondary variables are always presented as the product of the primary variables in different powers.The entire information above can be represented as follows: 1. There are ξ = 7 primary variables: L – length, M – mass, Т – time, I– electric current, Θ– thermodynamic temperature, J– force of light, F– the number of substances [20];2. The dimension of any secondary variable q can only be expressed as a unique combination of dimensions of the main primary variables to different powers [17]: ![]() | (6) |
![]() | (7) |
![]() | (8) |

![]() | (9) |
includes both required, and inverse variables (for example, L¹ – length, L-1 – running length). The object can be judged knowing only one of its symmetrical parts, while others structurally duplicating this part may be regarded as information empty. Therefore, the number of options of dimensions may be reduced by ω = 2 times. This means that the total number of dimension options of physical variables without inverse variables equals
. 7. For further discussion we use the methods of the theory of similarity, which is expedient for several reasons. In the study of the phenomena occurring in the world around us, it is advisable to consider not individual variables but their combination or complexes which have a definite physical meaning. Methods of the theory of similarity based on the analysis of integral-differential equations and boundary conditions, allow for the identification of these complexes. In addition, the transition from DL physical quantities to dimensionless (DS) variables reduces the number of variables taken into account. The predetermined value of DS complex can be obtained by various combinations of DL variables included in the complex. This means that when considering the challenges of new variables we take into account not an isolated case, but a series of different events, united by some common properties. It is important to note that the universality of similarity transformations is defined by the invariant relationships that characterize the structure of all the laws of nature, including for the laws of relativistic nuclear physics. Moreover, dimensional analysis from the point of view of the mathematical apparatus has a group structure, and conversion factors (the similarity complexes) are invariants of the groups. The concept of the group is a mathematical representation of the concept of symmetry, which is one of the most fundamental concepts of modern physics [21].According to π-theorem [22], the number
of possible DS complexes (criteria) with ξ = 7 main DL variables for SI will be![]() | (10) |
can only increase with the deepening of knowledge about the material world. It should be mentioned that the set of DS variables
is a fictitious system, since it does not exist in physical reality. However, this observation is true for proper SI too. At the same time, the object which exists in actuality may be expressed by this set. The relationships (6)–(9) are obtained on the basis of the principles of the theory of groups as set forth in [17]. The present results provide a possible use of information theory to different physical and engineering areas with a view to formulating precise mathematical relationships to assess the minimum comparative uncertainty (see section 3.2) of the model that describes the studied physical phenomenon or process.![]() | (11) |
![]() | (12) |
![]() | (13) |
![]() | (14) |
![]() | (15) |
![]() | (16) |
![]() | (17) |
![]() | (18) |
![]() | (19) |
![]() | (20) |
![]() | (21) |
![]() | (22) |
![]() | (23) |
![]() | (24) |
![]() | (25) |
![]() | (26) |
![]() | (27) |
![]() | (28) |
![]() | (29) |
![]() | (30) |
![]() | (31) |
![]() | (32) |
![]() | (33) |
![]() | (34) |
![]() | (35) |
![]() | (36) |
![]() | (37) |
![]() | (38) |
![]() | (39) |
![]() | (40) |
was selected, where 
are the DL temperatures of the freezing point of a material, outer surface of a material layer and evaporation point of the refrigerant, respectively.
are the DL uncertainties of measurement of these temperatures. Their declared values were: 



The declared achieved discrepancy between the experimental and computational data in the range of admissible values of the similarity criteria and dimensionless conversion factors did not exceed 8%.Taken into account was the fact that the direct measurement uncertainties are much smaller than the measured values, accounting for a few percent or less of them. The uncertainty can be considered formally as small increments of a measured variable. In practice, finite differences are used, rather than the differentials. So, in order to find the value of an absolute DS uncertainty
, the mathematical apparatus of differential calculus was applied [34]:![]() | (41) |
denotes the partial derivatives of the function
with respect to one of the several variables
that affect
; and
denotes the uncertainty of the variable
.For the present example, according to equation (40), one can find an absolute total DS uncertainty of the indirect measurement
, reached in the experiment: ![]() | (42) |
(9), z'-β' (38), and (z''-β'') (39), one obtains a DS uncertainty value
of the chosen model: ![]() | (43) |
is the DS given range of changes of the DS final temperature allowed by the chosen model [33]. From (42) and (43) we get
, i.e., an actual uncertainty in the experiment is 1.7 times (0.066/0.038) larger than the possible minimum. It means, at the recorded number of DS criteria the existing accuracy of the DL variable’s measurement is insufficient. In addition, the number of the chosen DS variables z*-β* = 13 is less than the recommended ≈ 19 (39) that corresponds to the lowest comparative uncertainty at COPSI ≡ LMTΘ. That is why, for further experimental work it is required to use devices of a higher class of accuracy sufficient to confirm/clarify a new model designed with many DS variables.In this example we introduce a full explanation of the required steps for analyzing experimental data and compare it with results obtained from a field test or computer simulation of model.
= 137.03599945(62) with a relative uncertainty r₁ of
. In this case the absolute uncertainty was
. The declared range S₁ of
variations was
. Research is organized into the frame of COPSI ≡ LMТ. One can calculate the achieved comparative uncertainty as![]() | (44) |
![]() | (45) |
![]() | (46) |
![]() | (47) |
= 137.035999037(91) with a relative uncertainty of
[35]. In this case the absolute uncertainty was
. The description of the experimental unit and methods corresponded to COPSI ≡ LMТ. According to equation (47), the lowest comparative uncertainty is equal to 0.0048. The range of variation S₂ of
is
. In this case, the comparative uncertainty of the experimental method is ![]() | (48) |
![]() | (49) |
|
![]() | Figure 1. A graph summarizing the partial history of the fine structure constant measurement displaying the decrease of the comparative uncertainty |
(47),
(49). Then the lowest possible absolute uncertainty for COPSI ≡LMТ is equal to![]() | (50) |
![]() | (51) |