Ticket #3872 (closed enhancement: fixed)

Opened 4 months ago

Last modified 2 months ago

[with patch, positive review] calculus -- incorporate ginac into Sage

Reported by: was Assigned to: was
Priority: major Milestone: sage-3.2
Component: calculus Keywords:
Cc: burcin, robertwb

Description (Last modified by was)

TO USE:

http://sage.math.washington.edu/home/was/pynac/pynac-0.1.spkg

  • Apply this bundle to sage-3.1.1:

http://sage.math.washington.edu/home/was/pynac/pynac.hg

The goal of this ticket:

  1. Remove all dependency of ginac (http://www.ginac.de/) on CLN, so (a) Ginac builds in 2 minutes, (b) Ginac makes use of libraries like MPFR that are better than cln, and (c) in the future ginac will be able to work directly with *any* Sage objects.
  1. Create a symbolic arithmetic class that works like below in parallel with the existing sage symbolics, but is far from feature complete. 
sage: var("x y",ns=1)
(x, y)
sage: type(x)
<type 'sage.symbolic.expression.Expression'>
sage: expand((x^3*tan(x*y^x) + sin(y) - cos(y))^2)
cos(y)^2-2*cos(y)*sin(y)-2*cos(y)*x^3*tan(y^x*x) + x^6*tan(y^x*x)^2 + sin(y)^2 + 2*x^3*sin(y)*tan(y^x*x)
sage: timeit('expand((x^3*tan(x*y^x) + sin(y) - cos(y))^2)')
625 loops, best of 3: 107 µs per loop


sage: var("x y")
(x, y)
sage: timeit('expand((x^3*tan(x*y^x) + sin(y) - cos(y))^2)')
5 loops, best of 3: 24.5 ms per loop
sage: 24.5/(107*(10^(-3)))
228.971962616822


sage: x = sympy.var('x'); y = sympy.var('y')
sage: timeit("((x^3r * sympy.tan(x*y^x) + sympy.sin(y) - sympy.cos(y))^2r).expand()")
625 loops, best of 3: 691 µs per loop

The above would go in *before* any of this replaces the existing symbolic framework.

Once the above two steps are done and the spkg passes review, this ticket should be closed. Only then should a more refined attack on the problem be carried out.

Attachments

pynac.2.hg (39.2 kB) - added by burcin on 09/19/2008 04:06:21 AM.
pynac_3.1.3.alpha2.hg (39.7 kB) - added by burcin on 10/01/2008 10:29:15 AM.
pynac bundle against 3.1.3.alpha2

Change History

08/15/2008 03:12:00 AM changed by was

  • description changed.

08/15/2008 03:12:31 AM changed by was

  • description changed.

08/15/2008 03:16:38 AM changed by was

  • cc set to burcin.
  • description changed.

08/15/2008 03:20:05 AM changed by was

  • owner changed from gfurnish to was.

08/15/2008 03:42:53 AM changed by was

  • summary changed from calculus -- incorporate ginac into without cln to calculus -- incorporate ginac into Sage.

NOTE: There is something wrong on Itanium Linux since the library has no .so. I did 

  ln -s libginac-1.4.0.0.3 libginac.so

in local/lib, and then it built. Mabshoff says "some autoconf problem".

08/16/2008 03:38:21 PM changed by was

  • description changed.

08/18/2008 11:11:36 PM changed by was

  • description changed.

08/19/2008 01:48:07 PM changed by certik

  • cc changed from burcin to burcin, robertwb.

This is impressive! Great job.

The patches look good to me in general. Just a naive question -- why do you need to call PY_NEW here:

82 cdef Expression new_Expression_from_GEx(GEx juice): 83 cdef Expression nex 84 nex = <Expression>PY_NEW(Expression) 85 GEx_construct_ex(&nex._gobj, juice) 86 nex._parent = ring.NSR 87 return nex

? Is it some defficiency in Cython?

08/19/2008 01:49:49 PM changed by certik

Sorry for the formatting, here: 

 	82	cdef Expression new_Expression_from_GEx(GEx juice): 
 	83	    cdef Expression nex 
 	84	    nex = <Expression>PY_NEW(Expression) 
 	85	    GEx_construct_ex(&nex._gobj, juice) 
 	86	    nex._parent = ring.NSR 
 	87	    return nex

08/19/2008 07:04:08 PM changed by robertwb

PY_NEW is a macro that creates a new object without calling any of the __init__ methods (it calls the tp_new function pointer directly).

08/20/2008 02:55:16 AM changed by was

  • description changed.

08/20/2008 04:06:12 AM changed by certik

Don't know if I am doing something wrong: 

g++ -DHAVE_CONFIG_H -I. -I.. -I/home/ondra/ext/sage/local/include/python2.5/ -g -O2 -MT add.lo -MD -MP -MF .deps/add.Tpo -c add.cpp  -fPIC -DPIC -DPIC -o add.o
In file included from expair.h:27,
                 from expairseq.h:32,
                 from add.h:26,
                 from add.cpp:28:
numeric.h:97: error: extra qualification 'GiNaC::Number_T::' on member 'Number_T'
make[2]: *** [add.lo] Error 1

I am using Sage 3.1.1. Changing this:

Number_T::~Number_T();

to this:

~Number_T();

in numeric.h fixes the problem for me. Using: 

$ g++ --version
g++ (Debian 4.3.1-9) 4.3.1
Copyright (C) 2008 Free Software Foundation, Inc.
This is free software; see the source for copying conditions.  There is NO
warranty; not even for MERCHANTABILITY or FITNESS FOR A PARTICULAR PURPOSE.

Unfortunately then it fails at: 

g++ -DHAVE_CONFIG_H -I. -I.. -I/home/ondra/ext/sage/local/include/python2.5/ -g -O2 -MT numeric.lo -MD -MP -MF .deps/numeric.Tpo -c numeric.cpp  -fPIC -DPIC -DPIC -o numeric.o
numeric.cpp: In function 'std::ostream& GiNaC::operator<<(std::ostream&, const GiNaC::Number_T&)':
numeric.cpp:231: error: jump to case label
numeric.cpp:222: error:   crosses initialization of 'PyObject* o'

I don't have more time to investigate.

08/21/2008 01:48:28 AM changed by was

  • description changed.

08/22/2008 04:27:56 AM changed by was

  • description changed.

08/23/2008 04:34:11 PM changed by was

  • description changed.

08/24/2008 12:46:15 PM changed by was

  • description changed.

08/25/2008 12:41:02 AM changed by was

  • description changed.
  • summary changed from calculus -- incorporate ginac into Sage to [with patch and spkg; needs review] calculus -- incorporate ginac into Sage.

09/19/2008 04:06:21 AM changed by burcin

  • attachment pynac.2.hg added.

09/19/2008 04:17:24 AM changed by burcin

  • summary changed from [with patch and spkg; needs review] calculus -- incorporate ginac into Sage to [with patch and spkg; partial review] calculus -- incorporate ginac into Sage.

attachment:pynac.2.hg (and also pynac.2.2.hg, thanks to trac) has a clean version of William's bundle, plus two changesets (one trivial).

I give a positive review to William's patch, someone should review mine.

There is also a new package file here:

http://www.risc.jku.at/people/berocal/sage/pynac-0.1.spkg

The only difference is a new SPKG.txt and an environment check on top of spkg-install.

As the ticket description states, these should go in after my changes are reviewed. I'll open new tickets for further additions to the pynac interface.

(follow-up: ↓ 20 ) 09/23/2008 04:39:54 PM changed by was

  • summary changed from [with patch and spkg; partial review] calculus -- incorporate ginac into Sage to [with patch and spkg; positive review] calculus -- incorporate ginac into Sage.

Hi,

I read through Burcin's two patches to my patches, which he wrote when refereeing my code, and I'm happy with them.

Mhansen, all mentioned to me that "he's read through all of this".

I also tested building and running all this on the intel atom n270, and it works.

So --- positive review! Let's get this in sage.

(in reply to: ↑ 19 ) 09/23/2008 04:51:56 PM changed by mabshoff

Replying to was:

So --- positive review! Let's get this in sage.

After ghmm I want to do some wider build testing, especially on Linux Itanium, Solaris as well as Cygwin before merging this.

Cheers,

Michael

09/23/2008 04:56:51 PM changed by robertwb

Trying to install the spkg on OS X 10.4 

...
Configuration of GiNaC 1.4.3 done. Now type "make".
cd . && /bin/sh /Users/robert/sage/current/spkg/build/pynac-0.1/src/missing --run autoheader
aclocal.m4:17: error: this file was generated for autoconf 2.61.
You have another version of autoconf.  If you want to use that,
you should regenerate the build system entirely.
aclocal.m4:17: the top level
autom4te: /usr/bin/gm4 failed with exit status: 63
autoheader: /usr/bin/autom4te failed with exit status: 63
make: *** [config.h.in] Error 1
Error building ginac.

real    0m20.315s
user    0m6.509s
sys     0m11.412s

I could have sworn I tried this out a month ago (perhaps that was on sage.math).

09/23/2008 05:07:49 PM changed by mabshoff

Well, the fix here is to run autoconf and friends with the --missing argument so that files that are linked and/or missing are instead copied into the archive. This will prevent the above problem from happening and also makes the spkg work in absence of autohell tools. If there is no script called autogen.sh we should add one so that rerunning those scripts is automated since one does tend to forget to run them all in the right order with the right parameters :)

Cheers,

Michael

09/27/2008 12:22:37 PM changed by mabshoff

  • summary changed from [with patch and spkg; positive review] calculus -- incorporate ginac into Sage to [with patch and spkg; needs work] calculus -- incorporate ginac into Sage.

Since this spkg is known broken at least on OSX 10.4 this needs work.

Cheers,

Michael

09/30/2008 02:49:50 AM changed by mabshoff

A couple remarks:

  • pynac runs autoheader: 
    make  all-recursive
make[1]: Entering directory `/scratch/mabshoff/release-cycle/review/pynac-0.1/src'
Making all in ginac
  • CPPFLAGS and potentially LDFLAGS need to be set so we pick up Sage's Python: 
    /bin/sh ../libtool    --mode=compile g++ -DHAVE_CONFIG_H -I. -I.. 
-I/scratch/mabshoff/release-cycle/sage-3.1.2.rc5/local/include/python2.5/   
-I/scratch/mabshoff/release-cycle/sage-3.1.2.rc5/local/include/python2.5  
-g -O2 -MT ex.lo -MD -MP -MF .deps/ex.Tpo -c -o ex.lo ex.cpp
  • spkg-install needs some cleanup, i.e. delete the PolyBoRi? references, switch to #!/usr/bin/env bash, etc
  • SPKG.txt should explain which patches/changes were made to make Ginac work with Python types/remove the CLN dependency. That patch should be somewhere in a repo since at some point we will rebase on upstream
  • Ginac depends on dlopen, so this is a portability issue that needs to be taken into consideration and should be mentioned in SPKG.txt

Cheers,

Michael

10/01/2008 10:29:15 AM changed by burcin

  • attachment pynac_3.1.3.alpha2.hg added.

pynac bundle against 3.1.3.alpha2

10/01/2008 10:34:18 AM changed by burcin

  • type changed from defect to enhancement.
  • summary changed from [with patch and spkg; needs work] calculus -- incorporate ginac into Sage to [with patch and spkg; needs review] calculus -- incorporate ginac into Sage.

The spkg was split into ticket #4221.

attachment:pynac_3.1.3.alpha2.hg contains a new bundle that applies cleanly against 3.1.3.alpha2. There is a small additional patch over pynac.2.hg, which has minor corrections for the library name and coercion model changes.

10/16/2008 05:51:03 AM changed by mabshoff

  • summary changed from [with patch and spkg; needs review] calculus -- incorporate ginac into Sage to [with patch, positive review] calculus -- incorporate ginac into Sage.

Positive review from me on pynac_3.1.3.alpha2.hg. Let's hope it still cleanly applies :)

Cheers,

Michael

10/17/2008 05:01:20 PM changed by mabshoff

  • status changed from new to closed.
  • resolution set to fixed.

Merged pynac_3.1.3.alpha2.hg in Sage 3.2.alpha0

(follow-up: ↓ 29 ) 10/17/2008 08:54:24 PM changed by jason

Can we release alpha0 as soon as possible so that people can play with pynac and try to find bugs?

(in reply to: ↑ 28 ) 10/18/2008 01:49:09 AM changed by mabshoff

Replying to jason:

Can we release alpha0 as soon as possible so that people can play with pynac and try to find bugs?

Yes, the plan to do so is very soon, i.e. alpha0 today. But we need to have a review for #4243 and #4244 to catch up with the current state of the art here.

Cheers,

Michael