Cray Floating point numbers

The representation of floating point numbers and the “accuracy”, repeatability and reversibility of arithmetic operations has long be a topic of discussion amongst Cray customer and scientific users. The Cray machines up to the C90 range used 64 bit Cray floating point arithmetic. When representing the long smooth curve of real numbers using digital bits […]

Cray Floating point numbers Read More ยป