Precision Fields |
The Precision type exposes the following members.
Name | Description | |
---|---|---|
DoubleDecimalPlaces | The number of significant decimal places of double-precision floating numbers (64 bit). | |
DoublePrecision | Standard epsilon, the maximum relative precision of IEEE 754 double-precision floating numbers (64 bit). According to the definition of Prof. Demmel and used in LAPACK and Scilab. | |
MachineEpsilon | Actual double precision machine epsilon, the smallest number that can be subtracted from 1, yielding a results different than 1. This is also known as unit roundoff error. According to the definition of Prof. Demmel. On a standard machine this is equivalent to `DoublePrecision`. | |
PositiveDoublePrecision | Standard epsilon, the maximum relative precision of IEEE 754 double-precision floating numbers (64 bit). According to the definition of Prof. Higham and used in the ISO C standard and MATLAB. | |
PositiveMachineEpsilon | Actual double precision machine epsilon, the smallest number that can be added to 1, yielding a results different than 1. This is also known as unit roundoff error. According to the definition of Prof. Higham. On a standard machine this is equivalent to `PositiveDoublePrecision`. | |
PositiveSinglePrecision | Standard epsilon, the maximum relative precision of IEEE 754 single-precision floating numbers (32 bit). According to the definition of Prof. Higham and used in the ISO C standard and MATLAB. | |
SingleDecimalPlaces | The number of significant decimal places of single-precision floating numbers (32 bit). | |
SinglePrecision | Standard epsilon, the maximum relative precision of IEEE 754 single-precision floating numbers (32 bit). According to the definition of Prof. Demmel and used in LAPACK and Scilab. |