Ticket #10837: trac_10837-numerical-noise-solaris.patch

File trac_10837-numerical-noise-solaris.patch, 920 bytes (added by Rob Beezer, 11 years ago)

  • sage/matrix/matrix_double_dense.pyx 

    # HG changeset patch
# User Rob Beezer <beezer@ups.edu>
# Date 1316400029 25200
# Node ID 9375702618ba2df0b37764f5c641d19a6d64bc82
# Parent  82e076de537c18971dd8edbcccb9d6289721b84f
10837: fix vector norm numerical noise for Solaris

diff --git a/sage/matrix/matrix_double_dense.pyx b/sage/matrix/matrix_double_dense.pyx
    a b  
    706706            sage: A = matrix(CDF, [[1,2,4],[5,3,9],[7,8,6]])
    707707            sage: c = A.norm(2)*A.inverse().norm(2)
    708708            sage: d = A.condition(2)
    709             sage: abs(c-d) < 1.0e-14
     709            sage: abs(c-d) < 1.0e-12
    710710            True
    711711            sage: c = A.norm(1)*A.inverse().norm(1)
    712712            sage: d = A.condition(1)
    713             sage: abs(c-d) < 1.0e-14
     713            sage: abs(c-d) < 1.0e-12
    714714            True
    715715        """
    716716        if not self.is_square() and p != 'sv':