Forum: Poser - OFFICIAL


Subject: How much is 0.00001 ?

colorcurvature opened this issue on Jul 01, 2010 ยท 6 posts


bagginsbill posted Thu, 01 July 2010 at 9:57 AM

Quote - Yes, that might be possible. But I wonder why the number of points showing a deviation is so small. If it was due to truncation, shouldn't there be a kind of uniform distribution of the deviations of the verts?

I would have guessed that 1/2 or 1/4 were rounded off incorrectly. I don't really know.

Conversions to/from decimal are tricky. The Python library recently introduced a new facility that finally gets it right, and it is very sophisticated. It can write floating point numbers with exactly the smallest number of decimal digits necessary to reproduce the binary representation without any lost precision.

For example, it will write .1 instead of .09999999. It will do other interesting things like (I'm making this one up) .87654321375 as .87654321 because the last three digits come out to 375 anyway due to limited precision, even if they are not written.


Renderosity forum reply notifications are wonky. If I read a follow-up in a thread, but I don't myself reply, then notifications no longer happen AT ALL on that thread. So if I seem to be ignoring a question, that's why. (Updated September 23, 2019)