Changes between Version 1 and Version 16 of Ticket #10952
 Timestamp:
 05/16/11 19:38:54 (11 years ago)
Legend:
 Unmodified
 Added
 Removed
 Modified

Ticket #10952
 Property Cc kcrisman added

Property
Authors
changed from
to
Robert Bradshaw

Property
Reviewers
changed from
to
Jason Grout

Ticket #10952 – Description
v1 v16 1 If a line contains ``tol`` or ``tolerance, numerical results are only 2 verified to the given tolerance. This may be prefixed by ``abs[olute`` 3 or ``rel[ative]`` to specify whether to measure absolute or relative 4 error; defaults to relative error except when the expected value is 5 exactly zero: 6 1 7 {{{ 2 sage: print "The answers are", 1.5, 2, 1e12 # tol 1e3 3 The answers are 1.499999 2.0001 0 8 sage: RDF(pi) # abs tol 1e5 9 3.14159 10 sage: [10^n for n in [0.0 .. 4]] # rel tol 2e4 11 [0.9999, 10.001, 100.01, 999.9, 10001] 4 12 }}} 13 14 This can be useful when the exact output is subject to rounding error 15 and/or processor floating point arithmetic variation.