Meta-ticket: Add external user packages as optional/experimental packages

[Matthias Köppe]

Since Sage 9.2, the spkg section of the Sage reference manual is automatically generated from the information in the SAGE_ROOT/build/pkgs/ directory. Each SPKG is represented by a subdirectory. The structure of these subdirectories is explained in the Developer's Guide.

This meta-ticket tracks the task of adding external packages, in particular those that used to be listed at ​https://wiki.sagemath.org/SageMathExternalPackages, as optional/experimental packages. By including them as optional/experimental packages in build/pkgs:

• They are automatically included in our reference manual (see #29655)
• Information about them can be obtained using the commands
  • Optional packages available: ./sage -optional
  • Experimental packages available: ./sage -experimental
  • Details about an SPKG: ./sage -info <SPKG>
• The GH Actions workflows tox-optional.yml and tox-experimental.yml will run them, providing continuous integration that will allow use to catch unintended breaking changes during the Sage development cycle

Already added as packages, see ​spkg section of the Sage reference manual:

• #31237 ​slabbe: Sébastien Labbé's research code (​blog post, ​2014 blog post, ​GitLab.com repo)
• #31238 ​admcycles: Computation in the tautological ring of the moduli space of curves by Johannes Schmitt et al. (​GitLab.com repo)
• #31239 ​ore_algebra: Ore algebras and Ore polynomials by Manuel Kauers et al. (​GitHub repo)
• #31224 ​surface_dynamics: Dynamics on surfaces (measured foliations, interval exchange transformation, Teichmüller flow, etc.) by Vincent Delecroix and Samuel Lelièvre (​GitHub repo)
• #31240 ​sage_flatsurf: Computation with flat surfaces by Vincent Delecroix and Pat Hooper (​GitHub repo)
• #30540 ​phitigra: Graph editor for SageMath as a Jupyter widget by Jean-Florent Raymond (​GitHub repo)

Tickets for pip-installable packages:

The packages will typically be added as ​pip packages instead of normal packages. These do not come with tarball information and do not have to pin the version, so by default the latest version on PyPI would be installed. Hence there is no additional maintenance burden from updating the packages. Adding the packages is made easy by the new ​sage -package create commands, added ​in Sage 9.3.

• #6371 RiemannTheta: Riemann Theta function numerical evaluation by Nils Bruin, Sohrab Ganjian. Fairly small straightforward package with some cython code. Should probably be integrated into SageMath proper at some point to guarantee it stays up-to-date and functional (​Github repo)

• #31235 ​sage-numerical-interactive-mip: Interactive mixed integer linear programming solver by Peijun Xiao, Zeyi Wang, and Yuan Zhou (​GitHub repo)

• #31235 ​cutgeneratingfunctionology (formerly infinite-group-relaxation-sage-code): Computation and experimentation with cut-generating functions, in particular the Gomory-Johnson model by Matthias Köppe, Yuan Zhou, C. Y. Hong, and Jiawei Wang (​GitHub repo)

• #27526 ​usainboltz: Random generation of tree-like structures by Matthieu Dien and Martin Pépin (​GitLab.com repo)

• #33778 texsurgery

• #31176 Add packages from 3-manifolds / computop (#31180: snappy)

• #31223 ​train_track: Free group automorphisms and train-track representatives by Thierry Coulbois (​GitHub repo)

• #31416 multipolynomial-bases: Multipolynomial bases (Schubert, Grothendieck, Key) by Viviane Pons (​GitHub repo)

No ticket yet:

• ​flagmatic: Tool for researchers in extremal graph theory by Emil R. Vaughan et al. (​orig GitHub repo, ​GitHub repo)

• ​stallings_graphs: experiment with finitely generated subgroups of infinite groups by Pascal Weil (​self-hosted GitLab repo)

• addcombq: Fast Additive Combinatorics functions by Matt Torrence (​GitHub repo)

• arithmat: Implementation of arithmetic matroids and toric arrangements by Roberto Pagaria and Giovanni Paolini (​GitHub repo)

• gcaops: Kontsevich Graph Complex Action on Poisson Structures by Ricardo Buring (​GitHub repo)

• cvolume: Compute completed volumes of strata of quadratic differentials with odd zeros by Eduard Duryev (​GitHub repo)

• ​badic: Beta-adic tools and automata by Paul Mercat (​GitLab.com repo)

• abelfunctions: Computing with Abelian functions, Riemann surfaces, and algebraic curves by Chris Swierczewski (​GitHub repo, ​discussion)

• carlin: Carleman linearization of polynomial differential equations by Marcelo Forets (​GitHub repo)

• ​adeles: Computing with adèles and idèles by Mathé Hertogh (​GitHub repo)

• yacop_sage: Steenrod algebra cohomology by Christian Nassau (​GitHub repo)

• ​FlexRiLog: Flexible and rigid labelings of graphs by Jan Legerský (​GitHub repo)

• sage_cluster_pictures: Cluster pictures, BY-trees, models and local invariants of hyperelliptic curves by Alex J. Best and Raymond van Bommel (​GitHub repo)

• ​dual-pairs: Computing with dual pairs of algebras by Peter Bruin (​GitLab.com repo)

• msinvar: Computation of moduli space invariants by Sergey Mozgovoy (​GitHub repo)

• comb_walks: Walk Models with elliptic kernel function by Frédéric Chyzak, Antonio Jiménez-Pastor, Pierre Lairez (​self-hosted GitLab repo)

• ​kerrgeodesic_gw: Computing geodesics of the Kerr spacetime as well as gravitational waves from bodies orbiting a Kerr black hole by Eric Gourgoulhon, Alexandre Le Tiec, Frédéric H. Vincent and Niels Warburton (​GitHub repo)

• dd_functions: Computation with DD-finite functions by Antonio Jiménez-Pastor (​GitHub repo)

• ​sherali_adams: Sherali-Adams relaxation on a numpy system of the form Ax <= b by Matthew Drescher (​GitHub repo)

• conrey-dirichlet-characters: Working with Dirichlet characters using a numbering scheme described by Brian Conrey by Jonathan Bober (​GitHub repo)

• ​pychebfun: Python Chebyshev Functions by Olivier Verdier, Chris Swierczewski (​GitHub repo, ​orig GitHub repo)

• ​pysemigroup: Automata and semigroups by ​Charles Paperman (​self-hosted GitLab repo)

• ​zetalib: Computing zeta functions of groups, algebras, and modules by Tobias Rossmann, Tomer Bauer (​GitLab.com repo; ​orig website (404))

• ​hypigu: Compute the Igusa local zeta function and flag Hilbert–Poincaré series of hyperplane arrangements by Joshua Maglione (​GitHub repo)

• ​mclf: Computing with Models of Curves over Local Fields by Stefan Wewers, Julian Rüth (​GitHub repo)

• ​hilbert-modular-group: Computing with Hilbert modular groups, including a reduction algorithm by Fredrik Stromberg (​GitHub repo)

Not pip-installable:

In this ticket, only pip-installable packages will be added. This adds an incentive to package authors to bring their packages to this form.

• starproducts: Symbolic calculations with Poisson brackets and Kontsevich's deformation quantization formula by Peter Banks and Brent Pym (​Bitbucket repo)
• hodge-diamond-cutter: Hodge diamonds (and Hochschild homology) of smooth projective varieties by Pieter Belmans (​GitHub repo)
• Torus Knots Counter: computes the motive of the irreducible SL(r,k)-character variety of an (n,m)-torus knot by Ángel González-Prieto and Vicente Muñoz (​GitHub repo with Jupyter notebook)
• #28651: ResSing: Calculating regular models of curves by Suchandan Pal (​zip file with .sage files)
• (Local) Igusa and topological zeta functions for Newton-non-degenerated polynomials by ​Juan Viu-Sos (​GitHub repo)
• ecfactory: Construct elliptic curves with certain properties by ​http://www.scipr-lab.org/ (​GitHub repo)

Maintained/abandoned on a Trac ticket:

• #27228: ​Chow: ''computations in intersection theory'' by Christoph Sorger and Manfred Lehn

Outdated (disappeared or does not work with current Sage):

• ​sage-semigroups: A semigroup (representation) theory library by Nicolas M. Thiéry (​GitHub repo, broken as of 2022-09, Sage 9.7)
• CHA: Combinatorial Hopf algebras by ​Nicolas Borie (​Bitbucket repo - 404)
• cryptosage: Cryptography algorithms by Sara Forouhar (​GitHub repo with .sage files, last updated 2015)
• sage-drg: Checking the feasibility of distance-regular graph parameter sets by Janos Vidali (​GitHub repo, not pip-installable, ​no Python 3 support)
• SchottkyUniformization: SK prime function, Riemann Theta function built from a RS via Schottky uniformization by Jeremy Upsal (​GitHub repo, last updated 2016)
• ss-isogeny-software: Quantum-Resistant Cryptosystems from Supersingular Elliptic Curve Isogenies by Luca De Feo (​GitHub repo, marked as obsolete by the author)
• lecf: Lyapunov exponents for multidimensional continued fractions by Vincent Delecroix and Sébastien Labbé (​GitHub repo - last updated 2014, ​GitHub repo - 404)
• harmonic-modules: Computing the bicharacter of diagonal harmonic polynomials by Nicolas Thiéry (​GitHub repo)

Discussions:

• ​https://groups.google.com/g/sage-devel/c/ZNyLBKmc0EE/m/oUll3liBAwAJ - on version metadata

---

List of external packages

This list used to be maintained at https://wiki.sagemath.org/SageMathExternalPackages

'''Please help by moving packages to one of the sections above!'''

See also https://github.com/slel/external-packages for another collection

Modular Abelian Varieties

by William Stein and Hao Chen

Links:

• https://github.com/williamstein/sage_modabvar
• https://github.com/haochenuw/sage_modabvar

Purple Sage

by William Stein, Fredrik Stromberg, Stephan Ehlen, Martin Raum and others

A Library of Number Theory Code that depends on Sage.

fgb_sage

by Markus Wageringel

Sage interface for computing Gröbner bases with FGb.

guptri_py

by Markus Wageringel

Sage/NumPy interface for solving generalized eigenvalue problems of singular matrix pencils with GUPTRI.

Brocoli

by Jean-Philippe Labbé

Package dealing with LImit ROots of COxeter groups (eternal Beta version)

• home: http://page.mi.fu-berlin.de/labbe/pages/brocoli.html
• docs-html: https://jplab.github.io/brocoli/doc/html
• docs-pdf: http://page.mi.fu-berlin.de/labbe/pdfs/brocoli.pdf
• gallery: http://page.mi.fu-berlin.de/labbe/gallery.html
• repo: https://github.com/jplab/brocoli

sagemath-polytope-tikz

by Jean-Philippe Labbé

SFBpresentation

by Jean-Philippe Labbé

See also

• Packages on PyPI matching 'sagemath'
• Packages on PyPI matching 'sage' and Mathematics
• Packages on PyPI matching 'sage' and Science
• Packages on github matching "Sage code"
• Packages on gitlab matching "sagemath"
• Packages on Google Code Archive with tag "SAGE"
• Packages on Bitbucket matching "sagemath"

[Vincent Delecroix]

Before proceeding, I would like to understand what package developers and package users would gain by declaring Python packages as sage optional packages. For now, I would only consider doing this if

• package versions were not tight to sage versions. In the curent setup a package upgrade needs a ticket review and, when merged, has to wait for a new sage version.
• there is no serious continuous integration for packages (as they have eg for gap)

[Matthias Köppe]

Replying to vdelecroix:

Before proceeding, I would like to understand what package developers and package users would gain by declaring Python packages as sage optional packages. For now, I would only consider doing this if

• package versions were not tight to sage versions. In the curent setup a package upgrade needs a ticket review and, when merged, has to wait for a new sage version.

The solution here is to use pip packages instead of normal packages. ​https://doc.sagemath.org/html/en/developer/packaging.html#package-source-types

These do not come with tarball information and do not have to pin the version, so by default the latest version on PyPI would be installed.

• there is no serious continuous integration for packages (as they have eg for gap)

Well, we do have workflows on GH Actions that at least tries to install all optional and experimental packages!

• ​https://github.com/sagemath/sage/actions/runs/447854806
• ​https://github.com/sagemath/sage/actions/runs/447854801

[Matthias Köppe]

Sage development has entered the release candidate phase for 9.3. Setting a new milestone for this ticket based on a cursory review of ticket status, priority, and last modification date.

[Matthias Köppe]

@jipilab: Links for broccoli need updating