miscellaneous cleanup/bugfixes for sage.misc.interpreter and sage.misc.sage_extension

[ohanar]

This is just a bit of cleanup+bugfixes that I've done over the past couple weeks. Notable changes:

• remove deprecations from #12719
• fix iload to actually be able to edit the loaded lines (could still be better, but would require more hacking on ipython internals; probably should just be added to upstream ipython instead)
• fix weird random bugs encountered with InterfaceShellTransformer (e.g. in gap, creating an error will cause future valid lines to error out) -- as far as I can tell, the code was just overthought (and had interface specific things that should belong as part of the appropriate interface)
• use the IPython shutdown hook rather than customizing ask_exit
• remove some dead and unused code
• start migrating files out of sage.misc and into sage.repl

[ohanar]

I would also like to move most of this code out of sage.misc to something like sage.app, but I'm not really happy with that package name. Maybe something like sage.terminal? Suggestions would be welcome.

Also, this is just a first step towards cleanup. Certainly more could be done (e.g. stuff surrounding the preparser), but I figured may as well do this gradually rather than as a patchbomb.

[mmezzarobba]

Replying to ohanar:

I would also like to move most of this code out of sage.misc to something like sage.app, but I'm not really happy with that package name. Maybe something like sage.terminal? Suggestions would be welcome.

sage.shell? sage.toplevel? sage.repl?

[ohanar]

Replying to mmezzarobba:

sage.shell? sage.toplevel? sage.repl?

ooh, I like sage.repl :)

[git]

Branch pushed to git repo; I updated commit sha1. New commits:

​64479d9

start migrating stuff over to sage.repl

[git]

Branch pushed to git repo; I updated commit sha1. New commits:

​3f8db78	derp: forgot to add file
​9324deb	Merge 6.2.beta7 into terminal_app_cleanup

[git]

Branch pushed to git repo; I updated commit sha1. New commits:

​dae1e70	fix documentation
​542dcc9	fix a couple bugs from relocation

[git]

Branch pushed to git repo; I updated commit sha1. This was a forced push. New commits:

​bfaf87a	fix documentation
​8618784	fix a couple bugs from relocation

[ohanar]

(Sorry for the force push, didn't properly copy a symlink.)

I'll make further changes in future tickets (I'll of course fix any regressions here, if they are found), so I'm marking this as needs review.

[vbraun]

Conflicts with the already-merged (but not released) #15990.

From looking at the source it seems that this still suffers from the same problem as #16154, the sage prompt transformer ought to run first and not last. Can you fix it here, then I'll close my ticket.

[git]

Branch pushed to git repo; I updated commit sha1. Last 10 new commits:

​eb09160	trac #11726 implement floordiv for laurent polys in one variable
​e27a420	trac #11726 one failing doctest corrected
​ba866ef	Merge branch 'public/ticket/11726' into raise-plus
​86261b1	Improve count_points
​55cdcf3	Refactor point counting code for hyperelliptic curves.
​fc7a569	First bunch of fixes and missing examples.
​63bf717	Rebase on top of #15108.
​8029bc6	Merge remote-tracking branch 'trac/develop' into ticket/15148
​136948a	Merge branch 'u/jpflori/ticket/15148' into raise-plus
​df49c8e	Merge remote-tracking branch 'trac/u/wluebbe/ticket/15990b' into terminal_app_cleanup

[ohanar]

ok, I added your fix for #16154 and merged in #15990.

[vbraun]

Can you also fix the module path in the doctests? ;-)

sage -t --long src/sage/repl/ipython_extension.py
**********************************************************************
File "src/sage/repl/ipython_extension.py", line 78, in sage.repl.ipython_extension.SageMagics.crun
Failed example:
    from sage.misc.interpreter import get_test_shell
Exception raised:
    Traceback (most recent call last):
      File "/home/release/Sage/local/lib/python2.7/site-packages/sage/doctest/forker.py", line 480, in _run
        self.execute(example, compiled, test.globs)
      File "/home/release/Sage/local/lib/python2.7/site-packages/sage/doctest/forker.py", line 839, in execute
        exec compiled in globs
      File "<doctest sage.repl.ipython_extension.SageMagics.crun[0]>", line 1, in <module>
        from sage.misc.interpreter import get_test_shell
    ImportError: cannot import name get_test_shell
**********************************************************************
File "src/sage/repl/ipython_extension.py", line 79, in sage.repl.ipython_extension.SageMagics.crun
Failed example:
    shell = get_test_shell()
Exception raised:
    Traceback (most recent call last):
      File "/home/release/Sage/local/lib/python2.7/site-packages/sage/doctest/forker.py", line 480, in _run
        self.execute(example, compiled, test.globs)
      File "/home/release/Sage/local/lib/python2.7/site-packages/sage/doctest/forker.py", line 839, in execute
        exec compiled in globs
      File "<doctest sage.repl.ipython_extension.SageMagics.crun[1]>", line 1, in <module>
        shell = get_test_shell()
    NameError: name 'get_test_shell' is not defined
**********************************************************************
1 item had failures:

[vbraun]

Fixed

---

New commits:

​12efdd3

fix crun doctest