polyscope icon indicating copy to clipboard operation
polyscope copied to clipboard

Ensure all internal float types use double precision

Open nmwsharp opened this issue 7 years ago • 1 comments

General strategy is to use double types internally everywhere, to avoid subtle situations (like IO) where a loss of precision occurs in user data.

We've been shuffling types internally, so make sure no floats (or glm::vec3) slipped through.

nmwsharp avatar Jun 02 '18 17:06 nmwsharp

Actually, in the current version of Polyscope, we use glm::vec3 everywhere, which means float precision. Perhaps we should switch to double?

nmwsharp avatar Sep 19 '19 14:09 nmwsharp

Resolution: we (mostly) use float everywhere internally, since that is all the renderer understands anyway. This could possibly cause confusion due to truncation in some situations.

nmwsharp avatar Mar 26 '23 22:03 nmwsharp