Changes between Initial Version and Version 1 of Ticket #23832, comment 22


Ignore:
Timestamp:
09/26/17 16:07:54 (4 years ago)
Author:
mderickx
Comment:

Legend:

Unmodified
Added
Removed
Modified
  • Ticket #23832, comment 22

    initial v1  
    11p.s. Jeroen what do you think about the priority of reproducible but random failing doctests? Say it fails about once in `x` times where `x` is some number.
    22
    3 I have the feeling that failing (but not silently producing incorrect answers) one out of three tests should definitely still be blocker priority, and failing (but not silently) once in every 10^6 times does not deserve to be a blocker anymore. What would be a reasonable guideline for a cutoff? Once in a hundred?
     3I have the feeling that failing (but not silently producing incorrect answers) one out of three tests should definitely still be blocker priority, and failing (but not silently) once in every 10^6^ times does not deserve to be a blocker anymore. What would be a reasonable guideline for a cutoff? Once in a hundred?
    44
    55Of course creating a stopgap for something that silently produces the wrong answer deserves to be a blocker no matter how rare.