Opened 5 months ago

Last modified 5 weeks ago

#32113 needs_review defect

GH Actions: conda-forge tests broken

Reported by: mkoeppe Owned by:
Priority: major Milestone: sage-9.5
Component: porting Keywords:
Cc: isuruf, vdelecroix, dimpase Merged in:
Authors: Isuru Fernando Reviewers:
Report Upstream: N/A Work issues:
Branch: u/mkoeppe/conda (Commits, GitHub, GitLab) Commit: ee6256df89af258d039ee9175b1b7116a52c8128
Dependencies: #32558, #32557, #32424, #32595 Stopgaps:

Status badges

Description

docker-conda-forge-minimal, docker-conda-forge-standard (https://github.com/sagemath/sage/runs/2967006198?check_suite_focus=true)

  [python3-3.9.5]   LD_LIBRARY_PATH=/sage/local/var/tmp/sage/build/python3-3.9.5/src CC='/opt/conda/bin/x86_64-conda-linux-gnu-cc -pthread' LDSHARED='/opt/conda/bin/x86_64-conda-linux-gnu-cc -pthread -shared -Wl,-rpath-link,/sage/local/lib -L/sage/local/lib -Wl,-rpath,/sage/local/lib -Wl,-O2 -Wl,--sort-common -Wl,--as-needed -Wl,-z,relro -Wl,-z,now -Wl,--disable-new-dtags -Wl,--gc-sections -Wl,-rpath,/opt/conda/lib -Wl,-rpath-link,/opt/conda/lib -L/opt/conda/lib -L. -Wl,-rpath-link,/sage/local/lib -L/sage/local/lib -Wl,-rpath,/sage/local/lib -Wl,-O2 -Wl,--sort-common -Wl,--as-needed -Wl,-z,relro -Wl,-z,now -Wl,--disable-new-dtags -Wl,--gc-sections -Wl,-rpath,/opt/conda/lib -Wl,-rpath-link,/opt/conda/lib -L/opt/conda/lib  ' OPT='-DNDEBUG -g -fwrapv -O3 -Wall' 	_TCLTK_INCLUDES='' _TCLTK_LIBS='' 	./python -E ./setup.py  build
  [python3-3.9.5]   Traceback (most recent call last):
  [python3-3.9.5]     File "/sage/local/var/tmp/sage/build/python3-3.9.5/src/./setup.py", line 33, in <module>
  [python3-3.9.5]       from distutils import log
  [python3-3.9.5]     File "/opt/conda/lib/python3.9/site-packages/_distutils_hack/__init__.py", line 80, in create_module
  [python3-3.9.5]       return importlib.import_module('._distutils', 'setuptools')
  [python3-3.9.5]     File "/opt/conda/lib/python3.9/importlib/__init__.py", line 127, in import_module
  [python3-3.9.5]       return _bootstrap._gcd_import(name[level:], package, level)
  [python3-3.9.5]     File "/opt/conda/lib/python3.9/site-packages/setuptools/__init__.py", line 16, in <module>
  [python3-3.9.5]       from setuptools.extern.six import PY3, string_types
  [python3-3.9.5]     File "/opt/conda/lib/python3.9/site-packages/setuptools/extern/__init__.py", line 50, in load_module
  [python3-3.9.5]       raise ImportError(
  [python3-3.9.5]   ImportError: The 'six' package is required; normally this is bundled with this package so if you get this warning, consult the packager of your distribution.
  [python3-3.9.5]   make[3]: *** [Makefile:641: sharedmods] Error 1

conda-forge-ubuntu (https://github.com/sagemath/sage/runs/2967003736?check_suite_focus=true):

local-conda-forge-ubuntu-minimal run-test: commands[5] | bash -c 'if [ ! -x /home/runner/work/sage/sage/.tox/local-conda-forge-ubuntu-minimal/conda/bin/conda ]; then curl -L https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-$(uname | sed s/^Darwin/MacOSX/;)-x86_64.sh -C - -o /home/runner/work/sage/sage/.tox/Caches/Miniforge3-$(uname | sed s/^Darwin/MacOSX/;)-x86_64.sh && bash /home/runner/work/sage/sage/.tox/Caches/Miniforge3-$(uname | sed s/^Darwin/MacOSX/;)-x86_64.sh -b -f -p /home/runner/work/sage/sage/.tox/local-conda-forge-ubuntu-minimal/conda; fi'
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100   160  100   160    0     0    935      0 --:--:-- --:--:-- --:--:--   935

100   634  100   634    0     0   1962      0 --:--:-- --:--:-- --:--:--  1962

 22 69.9M   22 15.6M    0     0  15.6M      0  0:00:04 --:--:--  0:00:04 15.6M
 61 69.9M   61 42.8M    0     0  20.8M      0  0:00:03  0:00:02  0:00:01 25.7M
100 69.9M  100 69.9M    0     0  25.0M      0  0:00:02  0:00:02 --:--:-- 30.2M
PREFIX=/home/runner/work/sage/sage/.tox/local-conda-forge-ubuntu-minimal/conda
Unpacking payload ...
ERROR   Expected environment not found at prefix: /home/runner/work/sage/sage/.tox/local-conda-forge-ubuntu-minimal/conda
ERROR   Aborting.
/home/runner/work/sage/sage/.tox/Caches/Miniforge3-Linux-x86_64.sh: line 365: /home/runner/work/sage/sage/.tox/local-conda-forge-ubuntu-minimal/conda/preconda.tar.bz2: No such file or directory

Likewise on local-conda-forge-macos, https://github.com/sagemath/sage/runs/2967003146?check_suite_focus=true

Change History (17)

comment:1 Changed 5 months ago by isuruf

Can you try removing SETUPTOOLS_USE_DISTUTILS=local for now?

comment:2 Changed 5 months ago by mkoeppe

Sure, we can conditionalize this on CONDA_PREFIX like in build/pkgs/pillow/spkg-install.in

comment:3 Changed 3 months ago by mkoeppe

  • Milestone changed from sage-9.4 to sage-9.5

comment:4 Changed 2 months ago by mkoeppe

  • Dependencies set to #32558, #32557

comment:5 Changed 2 months ago by isuruf

  • Authors set to Isuru Fernando
  • Branch set to u/isuruf/conda
  • Commit set to 330db42a75b978c7737b72266345f9fc56c57974
  • Status changed from new to needs_review

Added a branch. Needs to be tested after merging in the dependencies.

comment:6 Changed 2 months ago by git

  • Commit changed from 330db42a75b978c7737b72266345f9fc56c57974 to ccdd330e2646fbb6de5d256f73dd00d303f4e702

Branch pushed to git repo; I updated commit sha1. New commits:

ec983bdfix for conda python
e193a82Need rpath too when building python and override CONFIGURE_LDFLAGS only
ccdd330allow building with different compilers on debian/ubuntu

comment:7 Changed 2 months ago by git

  • Commit changed from ccdd330e2646fbb6de5d256f73dd00d303f4e702 to b85cfba08b0156f670dfc8dffb9e122dee30a6b0

Branch pushed to git repo; I updated commit sha1. This was a forced push. New commits:

a95daa0Need rpath too when building python and override CONFIGURE_LDFLAGS only
b85cfbaallow building with different compilers on debian/ubuntu

comment:8 Changed 2 months ago by git

  • Commit changed from b85cfba08b0156f670dfc8dffb9e122dee30a6b0 to 2d4421c5b4887f6665b6fa225975a1b2c5044bb6

Branch pushed to git repo; I updated commit sha1. New commits:

2d4421cupdate compiling on debian patch

comment:9 Changed 2 months ago by mkoeppe

  • Cc dimpase added

comment:10 Changed 2 months ago by git

  • Commit changed from 2d4421c5b4887f6665b6fa225975a1b2c5044bb6 to 9a38a29c123aa808fdafeb20d14b4fe39f542443

Branch pushed to git repo; I updated commit sha1. New commits:

9a38a29run 2to3 manually for nose

comment:11 Changed 2 months ago by isuruf

  • Dependencies changed from #32558, #32557 to #32558, #32557, #32424

New commits:

9a38a29run 2to3 manually for nose

comment:12 Changed 2 months ago by dimpase

how about dropping nose? All the packages that used it have swithed to pytests.

Last edited 2 months ago by dimpase (previous) (diff)

comment:13 Changed 2 months ago by isuruf

pytest is optional at the moment. Let's start a vote to drop nose and promote pytest to standard

comment:14 Changed 7 weeks ago by mkoeppe

  • Dependencies changed from #32558, #32557, #32424 to #32558, #32557, #32424, #32595

The latest run, with 9.3.beta5, of local-conda-forge-macos-standard (https://github.com/sagemath/sage/runs/3863933907?check_suite_focus=true) looks better but uses XCode's python3, as #31539 is still unresolved.

comment:15 Changed 6 weeks ago by mkoeppe

  • Branch changed from u/isuruf/conda to u/mkoeppe/conda

comment:16 Changed 6 weeks ago by mkoeppe

  • Commit changed from 9a38a29c123aa808fdafeb20d14b4fe39f542443 to ee6256df89af258d039ee9175b1b7116a52c8128

Not sure if my rebase of the rpath business will work as intended


New commits:

a579725Need rpath too when building python and override CONFIGURE_LDFLAGS only
e458a39allow building with different compilers on debian/ubuntu
ee6256dupdate compiling on debian patch

comment:17 Changed 5 weeks ago by mkoeppe

https://github.com/mkoeppe/sage/runs/3986317613?check_suite_focus=true

local-conda-forge-macos-minimal create: /Users/runner/work/sage/sage/.tox/local-conda-forge-macos-minimal
local-conda-forge-macos-minimal run-test-pre: PYTHONHASHSEED='3748675463'
local-conda-forge-macos-minimal run-test: commands[0] | bash -c 'if [ ! -d /Users/runner/work/sage/sage/.tox/local-conda-forge-macos-minimal/Library/Caches ]; then mkdir -p /Users/runner/work/sage/sage/.tox/Caches && mkdir -p /Users/runner/work/sage/sage/.tox/local-conda-forge-macos-minimal/Library && ln -sf /Users/runner/work/sage/sage/.tox/Caches /Users/runner/work/sage/sage/.tox/local-conda-forge-macos-minimal/Library/; fi'
local-conda-forge-macos-minimal run-test: commands[1] | bash -c 'mkdir -p /Users/runner/work/sage/sage/.tox/Caches/conda_pkgs /Users/runner/work/sage/sage/.tox/local-conda-forge-macos-minimal/conda'
local-conda-forge-macos-minimal run-test: commands[2] | bash -c 'echo >  /Users/runner/work/sage/sage/.tox/local-conda-forge-macos-minimal/conda/.condarc "pkgs_dirs:"'
local-conda-forge-macos-minimal run-test: commands[3] | bash -c 'echo >> /Users/runner/work/sage/sage/.tox/local-conda-forge-macos-minimal/conda/.condarc "  - /Users/runner/work/sage/sage/.tox/Caches/conda_pkgs"'
local-conda-forge-macos-minimal run-test: commands[4] | bash -c 'cat condarc.yml >> /Users/runner/work/sage/sage/.tox/local-conda-forge-macos-minimal/conda/.condarc'
local-conda-forge-macos-minimal run-test: commands[5] | bash -c 'if [ ! -x /Users/runner/work/sage/sage/.tox/local-conda-forge-macos-minimal/conda/bin/conda ]; then mkdir /Users/runner/work/sage/sage/.tox/local-conda-forge-macos-minimal/conda/conda-meta && curl -L https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-$(uname | sed s/^Darwin/MacOSX/;)-x86_64.sh -C - -o /Users/runner/work/sage/sage/.tox/Caches/Miniforge3-$(uname | sed s/^Darwin/MacOSX/;)-x86_64.sh && bash /Users/runner/work/sage/sage/.tox/Caches/Miniforge3-$(uname | sed s/^Darwin/MacOSX/;)-x86_64.sh -b -f -p /Users/runner/work/sage/sage/.tox/local-conda-forge-macos-minimal/conda; fi'
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed

  0     0    0     0    0     0      0      0 --:--:-- --:--:-- --:--:--     0
100   161  100   161    0     0    800      0 --:--:-- --:--:-- --:--:--   805

100   635  100   635    0     0   1819      0 --:--:-- --:--:-- --:--:--  1819

 13 41.5M   13 5778k    0     0  8161k      0  0:00:05 --:--:--  0:00:05 8161k
100 41.5M  100 41.5M    0     0  31.2M      0  0:00:01  0:00:01 --:--:-- 57.9M
PREFIX=/Users/runner/work/sage/sage/.tox/local-conda-forge-macos-minimal/conda
Unpacking payload ...
ERROR   Configuration file specified but does not exist at 'condarc.yml'
ERROR   Aborting.
/Users/runner/work/sage/sage/.tox/Caches/Miniforge3-MacOSX-x86_64.sh: line 364: /Users/runner/work/sage/sage/.tox/local-conda-forge-macos-minimal/conda/preconda.tar.bz2: No such file or directory
ERROR: InvocationError for command /bin/bash -c 'if [ ! -x /Users/runner/work/sage/sage/.tox/local-conda-forge-macos-minimal/conda/bin/conda ]; then mkdir /Users/runner/work/sage/sage/.tox/local-conda-forge-macos-minimal/conda/conda-meta && curl -L https://github.com/conda-forge/miniforge/releases/latest/download/Miniforge3-$(uname | sed s/^Darwin/MacOSX/;)-x86_64.sh -C - -o /Users/runner/work/sage/sage/.tox/Caches/Miniforge3-$(uname | sed s/^Darwin/MacOSX/;)-x86_64.sh && bash /Users/runner/work/sage/sage/.tox/Caches/Miniforge3-$(uname | sed s/^Darwin/MacOSX/;)-x86_64.sh -b -f -p /Users/runner/work/sage/sage/.tox/local-conda-forge-macos-minimal/conda; fi' (exited with code 1)
Note: See TracTickets for help on using tickets.