Click or drag to resize

Precision Fields

The Precision type exposes the following members.

Fields
 NameDescription
Public fieldStatic memberDoubleDecimalPlaces The number of significant decimal places of double-precision floating numbers (64 bit).
Public fieldStatic memberDoublePrecision Standard epsilon, the maximum relative precision of IEEE 754 double-precision floating numbers (64 bit). According to the definition of Prof. Demmel and used in LAPACK and Scilab.
Public fieldStatic memberMachineEpsilon Actual double precision machine epsilon, the smallest number that can be subtracted from 1, yielding a results different than 1. This is also known as unit roundoff error. According to the definition of Prof. Demmel. On a standard machine this is equivalent to `DoublePrecision`.
Public fieldStatic memberPositiveDoublePrecision Standard epsilon, the maximum relative precision of IEEE 754 double-precision floating numbers (64 bit). According to the definition of Prof. Higham and used in the ISO C standard and MATLAB.
Public fieldStatic memberPositiveMachineEpsilon Actual double precision machine epsilon, the smallest number that can be added to 1, yielding a results different than 1. This is also known as unit roundoff error. According to the definition of Prof. Higham. On a standard machine this is equivalent to `PositiveDoublePrecision`.
Public fieldStatic memberPositiveSinglePrecision Standard epsilon, the maximum relative precision of IEEE 754 single-precision floating numbers (32 bit). According to the definition of Prof. Higham and used in the ISO C standard and MATLAB.
Public fieldStatic memberSingleDecimalPlaces The number of significant decimal places of single-precision floating numbers (32 bit).
Public fieldStatic memberSinglePrecision Standard epsilon, the maximum relative precision of IEEE 754 single-precision floating numbers (32 bit). According to the definition of Prof. Demmel and used in LAPACK and Scilab.
Top
See Also