tox.ini: Add environment local-conda

[mkoeppe]

This environment creates an isolated conda installation within the tox environment directory, similar to local-homebrew.

To run:

   MAKE="make -j8" tox -e local-conda-forge-standard
   MAKE="make -j8" tox -e local-conda-forge-minimal

[mkoeppe]

Last 10 new commits:

​65834f0	Reorder systems so debian-sid comes after other debians
​d95a688	tox.ini [ubuntu-focal]: Use IGNORE_MISSING_SYSTEM_PACKAGES=yes because of libpython3.7-dev
​3896794	Merge tag '9.1.beta8' into t/29354/tox_ini__add_slackware_environments
​bda9ebd	Add slackware package info
​fbb7393	Fixup packages
​cfcd8f2	build/bin/sage-guess-package-system, build/bin/sage-print-system-package-command: Handle slackware too
​136feeb	build/bin/sage-spkg: Show equivalent system packages for ALL distros
​9939051	Merge branch 't/29354/tox_ini__add_slackware_environments' into t/29087/CI-gh-actions-tox-configure-build
​818796e	tox.ini: Add local-conda environments
​36e1c9a	tox.yml: Add local-conda-forge

[git]

Branch pushed to git repo; I updated commit sha1. New commits:

​a71ec3f

Use conda-install --yes --quiet

[git]

Branch pushed to git repo; I updated commit sha1. This was a forced push. New commits:

​cbcd657	Merge tag '9.1.beta9' into t/29415/tox_ini__add_environment_local_conda
​b864487	tox.ini: Add local-conda environments
​dae3c93	tox.yml: Add local-conda-forge
​354cf90	Use conda-install --yes --quiet

[mkoeppe]

Rebased on 9.1.beta9+#29087

[mkoeppe]

Needs testing, in particular on Linux

[dimpase]

I end up with a C++ error in Singular

libtool: compile:  /home/dimpase/sage/.tox/local-conda-forge-standard/conda/bin/x86_64-conda_cos6-linux-gnu-c++ -DHAVE_CONFIG_H -I. -I.
./../.. -I. -I../../.. -I../../.. -I../../../libpolys -I../../../libpolys -I/home/dimpase/sage/.tox/local-conda-forge-standard/local/var/tmp/sage/build/singular-4.1.1p2.p0/src -I/home/dimpase/sage/.tox/local-conda-forge-standard/local/var/tmp/sage/build/singular-4.1.1p2.p0/src/factory/include -I/home/dimpase/sage/.tox/local-conda-forge-standard/local/var/tmp/sage/build/singular-4.1.1p2.p0/src -I/home/dimpase/sage/.tox/local-conda-forge-standard/local/var/tmp/sage/build/singular-4.1.1p2.p0/src -pthread -DDYNAMIC_VERSION -DGMPRATIONAL -DNDEBUG -D_FORTIFY_SOURCE=2 -O2 -isystem /home/dimpase/sage/.tox/local-conda-forge-standard/conda/include -O2 -g -fvisibility-inlines-hidden -std=c++17 -fmessage-length=0 -march=nocona -mtune=haswell -ftree-vectorize -fPIC -fstack-protector-strong -fno-plt -O2 -ffunction-sections -pipe -isystem /home/dimpase/sage/.tox/local-conda-forge-standard/conda/include -fno-common -g0 -O3 -Wno-unused-function -Wno-trigraphs -Wno-unused-parameter -Wunknown-pragmas -Wno-unused-variable -fomit-frame-pointer -fwrapv -fvisibility=default -finline-functions -fno-exceptions -fno-threadsafe-statics -fno-enforce-eh-specs -fconserve-space -funroll-loops -fno-delete-null-pointer-checks -fno-rtti -fexceptions -frtti -c groebnerCone.cc  -fPIC -DPIC -o .libs/gfanlib_la-groebnerCone.o
groebnerCone.cc:428:58: error: no 'bool groebnerCone::pointsOutwards(gfan::ZVector) const' member function declared in class 'groebnerCone'
 bool groebnerCone::pointsOutwards(const gfan::ZVector w) const
                                                          ^~~~~
groebnerCone.cc: In member function 'groebnerCones groebnerCone::tropicalNeighbours() const':
groebnerCone.cc:449:13: error: 'pointsOutwards' was not declared in this scope
         if (pointsOutwards(ray[j]))
             ^~~~~~~~~~~~~~
make[9]: *** [Makefile:726: gfanlib_la-groebnerCone.lo] Error 1

this is on Debian, and might be due to using gfan from the system.

[isuruf]

This is fixed in singular 4.1.2. ​https://github.com/Singular/Sources/commit/80a9ffc773542e3329935e5377f6906628be16e6

A workaround is to do export CPPFLAGS="$CPPFLAGS -UNDEBUG" in Singular build script.

[dimpase]

should we upgrade Sage's singular?

[mkoeppe]

Replying to dimpase:

should we upgrade Sage's singular?

That's #25993.

[mkoeppe]

I also see a failure (testing with #29417):

• local-conda-forge-macos-standard:

    [dochtml]       from sage.symbolic.all   import *
    [dochtml]     File "/Users/runner/runners/2.165.2/work/sage/sage/.tox/local-conda-forge-macos-standard/local/lib/python3.7/site-packages/sage/symbolic/all.py", line 3, in <module>
    [dochtml]       from sage.libs.pynac.pynac import I
    [dochtml]     File "sage/symbolic/expression.pxd", line 4, in init sage.libs.pynac.pynac (build/cythonized/sage/libs/pynac/pynac.cpp:30411)
     [dochtml]     File "sage/symbolic/expression.pyx", line 160, in init sage.symbolic.expression (build/cythonized/sage/symbolic/expression.cpp:75349)
    [dochtml]   ImportError: dlopen(/Users/runner/runners/2.165.2/work/sage/sage/.tox/local-conda-forge-macos-standard/local/lib/python3.7/site-packages/sage/symbolic/ring.cpython-37m-darwin.so, 2): Symbol not found: __ZN5GiNaC9containerINSt3__16vectorEEC2ERKNS2_INS_2exENS1_9allocatorIS4_EEEEb
    [dochtml]     Referenced from: /Users/runner/runners/2.165.2/work/sage/sage/.tox/local-conda-forge-macos-standard/local/lib/python3.7/site-packages/sage/symbolic/ring.cpython-37m-darwin.so
    [dochtml]     Expected in: flat namespace
    [dochtml]    in /Users/runner/runners/2.165.2/work/sage/sage/.tox/local-conda-forge-macos-standard/local/lib/python3.7/site-packages/sage/symbolic/ring.cpython-37m-darwin.so
  

(this is with #29404 -- should take another look)

[mkoeppe]

In any case, the present ticket is about adding the testing framework for local-conda, which appears to work. Needs review.

[isuruf]

Shameless plug. Use miniforge instead of miniconda?

[mkoeppe]

Replying to isuruf:

Shameless plug. Use miniforge instead of miniconda?

Just tried it and it behaves a bit different from miniconda:

local-macos-conda-forge-standard-python2 run-test-pre: commands[6] | bash -c '/Users/mkoeppe/s/sage/sage-rebasing/worktree-algebraic-2018-spring/.tox/local-macos-conda-forge-standard-python2/conda/bin/conda update -n base --yes conda'
Traceback (most recent call last):
  File "/Users/mkoeppe/s/sage/sage-rebasing/worktree-algebraic-2018-spring/.tox/local-macos-conda-forge-standard-python2/conda/bin/conda", line 12, in <module>
    from conda.cli import main
ModuleNotFoundError: No module named 'conda'

Do I need to activate the environment before using that?

[mkoeppe]

Replying to isuruf:

This is fixed in singular 4.1.2. ​https://github.com/Singular/Sources/commit/80a9ffc773542e3329935e5377f6906628be16e6

A workaround is to do export CPPFLAGS="$CPPFLAGS -UNDEBUG" in Singular build script.

Because the singular upgrade (#25993) will not be ready for 9.1, I have opened #29438 for this

[isuruf]

Replying to mkoeppe:

Do I need to activate the environment before using that?

Yes, but even miniconda needs activation.

[git]

Branch pushed to git repo; I updated commit sha1. New commits:

​3757212	tox.ini: Switch local-conda-forge to miniforge
​a61c48e	tox.ini [local-conda]: Activate conda before calling conda install

[gh-kliem]

I guess it works in the way that it doesn't work.

* package:         openblas-0.3.6.p0
  last build time: Apr 1 10:54
  log file:        /srv/public/kliem/sage/logs/pkgs/openblas-0.3.6.p0.log
  build directory: /srv/public/kliem/sage/.tox/local-conda-forge-standard/local/var/tmp/sage/build/openblas-0.3.6.p0                                                               

* package:         singular-4.1.1p2.p0
  last build time: Apr 1 11:00
  log file:        /srv/public/kliem/sage/logs/pkgs/singular-4.1.1p2.p0.log
  build directory: /srv/public/kliem/sage/.tox/local-conda-forge-standard/local/var/tmp/sage/build/singular-4.1.1p2.p0                                                             

I attached the logs.

[dimpase]

Singular might need the fix proposed by Isuru above

[gh-kliem]

I'm not sure that I understand.

At least this here did not fix the problem.

+++ b/build/pkgs/singular/spkg-install.in
@@ -19,6 +19,7 @@ else
 fi
 
 export CFLAGS CXXFLAGS
+export CPPFLAGS="$CPPFLAGS -UNDEBUG"
 
 
 remove_old_version()

Now openblas, tachyon, m4ri, givaro, ecm, python3, giac, singular fail to install.

[mkoeppe]

Singular fixes - please on #29438, not here

[mkoeppe]

This ticket is about adding the testing environment for conda, not fixing everything that may be broken in the conda build

[mkoeppe]

Thank you.

[mkoeppe]

Replying to mkoeppe:

I also see a failure (testing with #29417):

• local-conda-forge-macos-standard:

    [dochtml]       from sage.symbolic.all   import *
    [dochtml]     File "/Users/runner/runners/2.165.2/work/sage/sage/.tox/local-conda-forge-macos-standard/local/lib/python3.7/site-packages/sage/symbolic/all.py", line 3, in <module>
    [dochtml]       from sage.libs.pynac.pynac import I
    [dochtml]     File "sage/symbolic/expression.pxd", line 4, in init sage.libs.pynac.pynac (build/cythonized/sage/libs/pynac/pynac.cpp:30411)
     [dochtml]     File "sage/symbolic/expression.pyx", line 160, in init sage.symbolic.expression (build/cythonized/sage/symbolic/expression.cpp:75349)
    [dochtml]   ImportError: dlopen(/Users/runner/runners/2.165.2/work/sage/sage/.tox/local-conda-forge-macos-standard/local/lib/python3.7/site-packages/sage/symbolic/ring.cpython-37m-darwin.so, 2): Symbol not found: __ZN5GiNaC9containerINSt3__16vectorEEC2ERKNS2_INS_2exENS1_9allocatorIS4_EEEEb
    [dochtml]     Referenced from: /Users/runner/runners/2.165.2/work/sage/sage/.tox/local-conda-forge-macos-standard/local/lib/python3.7/site-packages/sage/symbolic/ring.cpython-37m-darwin.so
    [dochtml]     Expected in: flat namespace
    [dochtml]    in /Users/runner/runners/2.165.2/work/sage/sage/.tox/local-conda-forge-macos-standard/local/lib/python3.7/site-packages/sage/symbolic/ring.cpython-37m-darwin.so
  

(this is with #29404 -- should take another look)

This is now #29574