Automatically build binder configuration

[saraedum]

This ticket proposes to add an automatic build for ​binder to the CI infrastructure from #24655.

Even though there is no support for this in trac yet, people could manually link to the generated binder configuration in their trac tickets. This would make it possible to try the proposed changes out without having to checkout and build the ticket.

If you want to try this out, you can go to the (automatically generated) commit in this ​github repository.

From personal experience, I see a number of reasons why this could be useful:

• (At Sage Days, new) contributors could start reviewing easy tickets right away without getting frustrated by having to rebuild Sage all the time because they checked out some old branches.
• Some people use the Sage binaries in their distribution but don't really want to start hacking on Sage on their machines. They still would like to push a certain ticket that is fixing a bug they are experiencing. They are (understandably) reluctant to give things a postitive review without having it tried out themselves.
• When sharing experimental code with others you usually want to keep the hurdles as low as possible. A link to a Jupyter notebook that just works is certainly much more convenient than complicated instructions on how to git checkout and make a ticket.

[saraedum]

screenshot

[git]

Branch pushed to git repo; I updated commit sha1. New commits:

​d0b3d7f	To make this truly a micro-release
​069e722	Allow user to override ARTIFACT_BASE on CircleCI
​1bcb818	Merge branch 'ci' into binder

[embray]

I could definitely add support for this in the Trac plugin as well, easy peasy.

[git]

Branch pushed to git repo; I updated commit sha1. Last 10 new commits:

​be3a0f7	The docbuild crashes happen during an os.fork to spawn tachyon
​7d85dc7	Something related to the sphinxbuild seems to be leaking memory
​50898fe	Try to build-from-scratch on GitLab's underpowered CI machines
​95c6275	Comment on fork logic in docbuilding
​c0574ca	Merge remote-tracking branch 'trac/develop' into u/saraedum/gitlabci
​329fdab	fix tags for build-from-latest
​048e2d8	silence unicode warnings from the patchbot
​f9c772e	Fix filtering logic in sphinx logger
​f043163	Fixed some minor doctest issues
​bcd3692	Merge remote-tracking branch 'trac/u/saraedum/gitlabci' into HEAD

[saraedum]

For this to really make sense we would have to synchronize trac's Git repository to gitlab, say to something like a sage-developers repository and enable CI there.

[saraedum]

Last 10 new commits:

​864843c	fix syntax error in CircleCI configuration
​e1c8536	Run short and new doctests on CircleCI for every branch
​45579a1	Call the right scripts in CircleCI
​11f8a6c	no port exposure needed for jupyter anymore
​1960ba1	add openssl/libssl-dev to the docker images
​14926cf	Revert "add openssl/libssl-dev to the docker images"
​f2c641a	Add debug information on patch size
​83f71e7	Don't pipe "echo" into "rm"
​8d3caeb	Merge branch '24655' into 24854
​f552520	Merge branch '24854' into HEAD

[git]

Branch pushed to git repo; I updated commit sha1. New commits:

​cc3e8c8

Fix name of GitLab stage

[git]

Branch pushed to git repo; I updated commit sha1. Last 10 new commits:

​4f11757	Add --short to options.rst
​324808a	Merge branch '25270' into 24854
​06a0832	Merge remote-tracking branch 'trac/develop' into 24854
​6e267b6	Fix namespacing for GitLab CI
​54cfea3	Merge remote-tracking branch 'trac/develop' into 24655
​b12cd9f	Do not use broken docker version on CircleCI
​220d948	Warn about aufs
​c40bb81	Add reference to known chown bug in docker/aufs
​e501b3f	Merge branch '24655' into 24854
​045784d	Merge branch '24854' into 24842

[git]

Branch pushed to git repo; I updated commit sha1. New commits:

​8b10429	Merge remote-tracking branch 'trac/develop' into 24655
​d313c11	Merge remote-tracking branch 'trac/develop' into 24655
​8e035de	Merge branch '24655' into 24854
​1281cbf	Merge remote-tracking branch 'trac/develop' into 25270
​67f98c6	Merge branch '25270' into 24854
​fec87aa	Honor only_errors option
​93d71c2	Merge branch '25270' into 24854
​b803901	Merge branch '24854' into 24842

[git]

Branch pushed to git repo; I updated commit sha1. New commits:

​d791779	Actually test something in --short runs in CI
​829169e	Merge remote-tracking branch 'trac/develop' into 25270
​b55a1cd	Merge branch '25270' into 24854
​4717a31	Merge branch '24854' into 24842

[git]

Branch pushed to git repo; I updated commit sha1. New commits:

​4152838	Merge remote-tracking branch 'trac/develop' into 24655
​4cebb4b	Merge commit '4152838ef924933eca5ee54447826c803d2dff00' into 24854
​a85023c	Merge remote-tracking branch 'trac/develop' into 24655
​6fa8bc6	Builds fail with 8.4.beta0 but the output is truncated and it is not clear what's the issue.
​3af7c50	Merge remote-tracking branch 'trac/develop' into HEAD
​48365ed	Merge remote-tracking branch 'trac/u/saraedum/24655' into HEAD
​3772312	Merge remote-tracking branch 'trac/develop' into HEAD
​5b3e018	Merge branch '25270' into 24854
​3333954	Merge branch '24854' into 24842

[embray]

For some reason I thought this was already done but apparently not. Are there any remaining challenges to this? Currently it lists #24854 as a dependency, but I don't know if that's strictly needed. The pipelines are already working for building; being able to launch the built containers in binder is immediately useful, because it also will allow us to run specific tests against each build manually.

[embray]

Another idea I had is that if the build was for a merge request on gitlab, we can easily post a comment to the merge request with the link to run the built image on binder.

[embray]

The branch for this currently has some merge conflict artifacts.

[git]

Branch pushed to git repo; I updated commit sha1. Last 10 new commits:

​a8ffbe0	Make doctesting work if the docker daemon does not run locally
​6a928c3	fix permissions of .git directory
​b9c7510	require the setup to pass
​42e6aa3	Merge branch '24854' into 24842
​8586f9e	drop some merge conflict artifacts
​c3ea3ef	Move binder block to the logically correct place
​9b3cc0f	Run doctests in CI
​86c452e	Merge remote-tracking branch 'trac/develop' into 24854
​b8fe26a	Merge remote-tracking branch 'trac/develop' into 24854
​9f84f0a	Merge branch '24854' into 24842

[saraedum]

Last 10 new commits:

​a8ffbe0	Make doctesting work if the docker daemon does not run locally
​6a928c3	fix permissions of .git directory
​b9c7510	require the setup to pass
​42e6aa3	Merge branch '24854' into 24842
​8586f9e	drop some merge conflict artifacts
​c3ea3ef	Move binder block to the logically correct place
​9b3cc0f	Run doctests in CI
​86c452e	Merge remote-tracking branch 'trac/develop' into 24854
​b8fe26a	Merge remote-tracking branch 'trac/develop' into 24854
​9f84f0a	Merge branch '24854' into 24842

[saraedum]

I am trying a simpler approach in #28457.