JHoagland opened this issue on Nov 12, 2005 ยท 9 posts
stewer posted Sun, 13 November 2005 at 11:25 AM
Attached Link: http://babbage.cs.qc.edu/courses/cs341/IEEE-754.html
For your computer's FPU, 65 and 64.999998 **are** the same, it's just the way floating point numbers work. Just try it, go to the web site I linked above, enter 64.999998 in the first input field and press the "rounded" button: It will return 65. Now press the "not rounded" button: It returns as 64.999992.This is how your CPU works. It has a limited amount of precision and the very last digit usually has no significance whatsoever. (Yes I am aware of double precision floats. If you want your scene to take twice as much RAM, sure, then they are an option...)
Message edited on: 11/13/2005 11:26