Opened 12 years ago

Last modified 6 years ago

#9461 new defect

Doctest failures with --randorder X

Reported by: mpatel Owned by: mvngu
Priority: major Milestone: sage-7.3
Component: doctest coverage Keywords:
Cc: jmantysalo Merged in:
Authors: Reviewers:
Report Upstream: N/A Work issues:
Branch: Commit:
Dependencies: Stopgaps:

Status badges

Description (last modified by jdemeyer)

tart with a build of Sage for which all long doctests pass. Run, e.g., 

$ ./sage -t -a --long --randorder 12345

Many tests fail.

See ​https://groups.google.com/forum/#!topic/sage-devel/2LsEMzIDvfw

See also the much older discussion ​http://groups.google.com/group/sage-devel/browse_thread/thread/80d6e8b9f976019b/d861632ec04f3562#d861632ec04f3562

Change History (10)

comment:1 Changed 12 years ago by mpatel

​Here are raw test logs from parallel testing on sage.math. I made these with, e.g., 

$ nohup nice -n 19 ./sage -tp 22 -long -sagenb -randorder=X devel/sage  > ptestlong_randorderX.log &

comment:2 Changed 12 years ago by mpatel

  • Description modified (diff)

comment:3 Changed 9 years ago by jdemeyer

  • Milestone changed from sage-5.11 to sage-5.12

comment:4 Changed 8 years ago by vbraun_spam

  • Milestone changed from sage-6.1 to sage-6.2

comment:5 Changed 8 years ago by vbraun_spam

  • Milestone changed from sage-6.2 to sage-6.3

comment:6 Changed 8 years ago by vbraun_spam

  • Milestone changed from sage-6.3 to sage-6.4

comment:7 Changed 6 years ago by jdemeyer

  • Cc jmantysalo added
  • Description modified (diff)
  • Milestone changed from sage-6.4 to sage-7.3

comment:8 Changed 6 years ago by jdemeyer

  • Summary changed from Doctest failures with sage -t -randorder=X to Doctest failures with --randorder X

comment:9 Changed 6 years ago by jmantysalo

I suggest that for a while we use keyword "random_test_failure" for these.

Volker suggested adding # seed0 tag to tests that should not be run when --randorder is not zero (i.e. the default). I guess that it is a good idea, but maybe we should see some examples first. #21054 is clearly an error; #21080 fails in a line with comment "needed until #19269 is fixed"; src/sage/graphs/base/graph_backends.pyx gives a deprecation warning.

comment:10 Changed 6 years ago by jdemeyer

  • Description modified (diff)
Note: See TracTickets for help on using tickets.