Improper negative number representation
Mostrar comentarios más antiguos
I have encountered a very strange issue. I was having trouble with an if statement that was comparing two numbers. Although the numbers were apparently identical, the equality was seen as false. I dug a little deeper and I found this extremely simple minimal working example. Why is this happening? This doesn't make any sense!
>> format long
>> A = -6*1e-9
A =
-6.000000000000001e-09
2 comentarios
Vittorio Picco
el 11 de Nov. de 2020
David Hill
el 11 de Nov. de 2020
Floating point numbers! There is lots of matlab documentation on floating point numbers, you just need to search for it.
Respuesta aceptada
Más respuestas (0)
Categorías
Más información sobre Physics en Centro de ayuda y File Exchange.
Productos
Community Treasure Hunt
Find the treasures in MATLAB Central and discover how the community can help you!
Start Hunting!