Is inexact subtraction expected?

7 visualizaciones (últimos 30 días)
Guy
Guy el 18 de Jun. de 2020
Respondida: Image Analyst el 18 de Jun. de 2020
In Matlab R2018a, I just typed "32885.6-32760" and got back 125.599999999999. Is this type of inexact subtraction expected? If I then type "ans - 125" I get 0.599999999998545, so it's not just a bunch of 9's. Removing the leading 3 or the leading 32 does not give this incorrect answer (i.e. it gives the exact decimal value .6)

Iniciar sesión para responder a esta pregunta.

Respuestas (1)

Image Analyst
Image Analyst el 18 de Jun. de 2020

Categorías

Más información sobre Introduction to Installation and Licensing en Help Center y File Exchange.

Etiquetas

Productos

Community Treasure Hunt

Find the treasures in MATLAB Central and discover how the community can help you!

Start Hunting!

Translated by