Redirected from Fixed Precision
See also
In computing, a fixed-point number representation is a real data type for a number that has a fixed number of digits after the decimal (or binary or hexadecimal) point. For example, a fixed-point number with 4 digits after the decimal point could be used to store numbers such as 1.3467, 281243.3234 and 0.1000, but would round 1.0301789 to 1.0302 and 0.0000654 to 0.0001. These fixed-point presentations are usually used, if either the executing processor does not have any floating point unit (FPU) or performance outrules exactness.
Search Encyclopedia
|
Featured Article
|