Opened 13 years ago

Closed 13 years ago

Last modified 13 years ago

#7740 closed defect (fixed)

Speed up MixedIntegerLinearProgram

Reported by: Nathann Cohen Owned by: jkantor
Priority: major Milestone: sage-4.3.1
Component: numerical Keywords:
Cc: Robert Miller Merged in: sage-4.3.1.alpha2
Authors: Nathann Cohen Reviewers: Robert Miller
Report Upstream: N/A Work issues:
Branch: Commit:
Dependencies: Stopgaps:

Status badges

Description

From Robert Miller :

sage: from sage.graphs.graph_coloring import vertex_coloring
sage: g = graphs.CirculantGraph(120, [2,3,5,7])
sage: vertex_coloring(g)

It takes longer to set up the constraint than to solve the problem, on my laptop.

Attachments (1)

trac_7740.patch (11.8 KB) - added by Nathann Cohen 13 years ago.

Download all attachments as: .zip

Change History (13)

comment:1 Changed 13 years ago by Nathann Cohen

Summary: Spped up MixedIntegerLinearProgramSpeed up MixedIntegerLinearProgram

comment:2 Changed 13 years ago by Nathann Cohen

Status: newneeds_info

Well, this time is spent as expected on the add_constraint function, which may spend time over considerations coming from symbolic computations, though I did not achieve to know where... When I am profiling your example I see :

25448/21366    0.529    0.000    0.695    0.000 complex_interval_field.py:257(__call__)
     8642    0.427    0.000    1.136    0.000 complex_interval_field.py:330(random_element)
     8642    0.106    0.000    0.117    0.000 complex_interval_field.py:325(gen)

These functions are the ones responsible for the time spent defining the LP, but I could not find which line of add_constraint is calling them... If you have any idea, please tell me and I'll give it a look :-)

comment:3 Changed 13 years ago by Nathann Cohen

Status: needs_infoneeds_review

This patch adds to the file numerical.mip a class LinearFunction? which avoid using the much more general symbolic expressions from Sage ( as we only need to define linear functions ).

Before :

sage: from sage.graphs.graph_coloring import vertex_coloring
sage: g = graphs.CirculantGraph(120, [2,3,5,7])
sage: timeit("vertex_coloring(g)")
5 loops, best of 3: 3.94 s per loop

After :

sage: from sage.graphs.graph_coloring import vertex_coloring
sage: g = graphs.CirculantGraph(120, [2,3,5,7])
sage: timeit("vertex_coloring(g)")
5 loops, best of 3: 2.18 s per loop

The next way to speed up this class would be, methinks, to cythonize it. I tried it this time but got stuck by the fact that the solving functions ( solveCoin, solveGlpk ) are not directly included in Sage and installed by the packages... The best way would really be to move these sources into Sage. It would also solve solve the problem of having to update both packages and numerical.mip t the same time .. :-/

Nathann

comment:4 Changed 13 years ago by Nathann Cohen

Status: needs_reviewneeds_work

comment:5 Changed 13 years ago by Nathann Cohen

Status: needs_workneeds_review

Before :

sage: g = graphs.WorldMap()
sage: %timeit g.edge_connectivity()
10 loops, best of 3: 1.29 s per loop

After :

sage: g = graphs.WorldMap()
sage: %timeit g.edge_connectivity()
10 loops, best of 3: 231 ms per loop

But as mentionned earlier, we will have to find other ways to improve this class ! :-)

Nathann

comment:6 Changed 13 years ago by Robert Miller

Status: needs_reviewneeds_work

Looks good to me! Aside from this typo: "An elementary algebra algebra"

Changed 13 years ago by Nathann Cohen

Attachment: trac_7740.patch added

comment:7 Changed 13 years ago by Nathann Cohen

Status: needs_workneeds_review

Here it is ! :-)

comment:8 Changed 13 years ago by Robert Miller

Authors: Nathann Cohen
Merged in: 4.3.1.alpha2
Resolution: fixed
Reviewers: Robert Miller
Status: needs_reviewclosed

positive review

comment:9 Changed 13 years ago by Nathann Cohen

Thank you again !!! I was longing for this one :-)

Nathann

comment:10 Changed 13 years ago by Minh Van Nguyen

Merged in: 4.3.1.alpha2sage-4.3.1.alpha2

comment:11 Changed 13 years ago by Nicolas M. Thiéry

Hi Nathan,

Sorry to pop up late into the discussion. What was the rationale for not using CombinatorialFreeModule?(whatever_ring, ZZ)?

For the record, I very much hope that FreeModule?(ring, infinity, sparse = True) will be available sometime soon. That will be a faster alternative.

comment:12 Changed 13 years ago by Nathann Cohen

Hello !

At first I used InfinitePolynomialRing?, then plain "vars", then I just wondered why it was still very slow and just wondered what it would give if I were to write the symbolics myself to understand... As it was easy enough, I wrote something to try it on my computer, and ended up writing a patch to send the code.

This way, it stores the informations in a format that is optimal for what I need ( no powers --only linear functions--, sparse from the beginning, ... ). Since, I have also noticed that having my own symbolics would let me define expressions like double inequalities :

0 < a + b < 9

Which I had been missing for a long time.. :-) The main problem I have is that in many cases, the symbolics take most of the time spent on the computation of a matching (or other LP problems), which is quite disturbing ;-)

Nathann

Note: See TracTickets for help on using tickets.