CarpetInterp/waveinterp_2p tests constant in space initial data

Comments (12)

1. 

   Roland Haas reporter

   • changed title to CarpetInterp/waveinterp_2p tests constant in space initial data
   • removed comment

   • 2014-04-29T00:29:58+00:00
2. 

   Erik Schnetter

   • removed comment

   I believe I disabled checking the relative error in this test. The absolute error should be fine, and is independent of the amplitude of a wave that would be added.

   Testing the second time derivative is important, we should not omit it.

   • 2014-04-29T03:44:02+00:00
3. 

   Roland Haas reporter

   • removed comment

   As far as I can tell relative error checks are not disabled in test.ccl. It only specifies the number of processes to use for each test. I can add a

   RELTOL 1e42
   

   to the test to avoid relative differences.

   I agree that testing the 2nd time derivative is important.

   Would a non-zero 2nd time derivative and not-constant in space data test more of the code? Testing an interpolator with constant (or very low order data) seems not like the best idea. The prolongation tests eg use operators that are as high order as possible while still allowing exact recovery of the result (ie 3rd order polynomial test function for the 3rd order prolongation operators).

   • 2014-04-29T09:31:46+00:00
4. 

   Erik Schnetter

   • changed status to resolved
   • removed comment

   I forgot to commit the patch. Done now.

   • 2014-04-30T05:38:27+00:00
5. 

   Roland Haas reporter

   • changed status to open
   • removed comment

   Turns out that setting reltol to 1e42 as proposed is not the correct solution. The comparison inside of RunTestUtils.pl is

   1745 my $vreltol = $filereltol * $valmax[$count];
   1746 my $vtol = $fileabstol > $vreltol ? $fileabstol : $vreltol;
   1747 if ($absdiff[$count] >= $vtol) {
   1748   $rundata->{"$thorn $test $file NFAILSTRONG"}++;
   1749   last;
   1750 }
   

   ie setting reltol to 1e42 sets $vreltol to some very large number and ignores abstol. In order to only use abstol, one has to set reltol to 0. The tests actually had larger absolute error than allowed (eg on bluewaters, though I do seem to get different results than Erik does):

      arrays1d[2].x.asc: substantial differences
         significant differences on 170 (out of 204) lines
         maximum absolute difference in column 13 is 5.94358425587416e-08
         maximum relative difference in column 13 is 63.81875
      arrays1d[2].y.asc: substantial differences
         significant differences on 17 (out of 51) lines
         maximum absolute difference in column 13 is 5.94358425587416e-08
         maximum relative difference in column 13 is 4.17201225740553
   

   So even with an ABSTOL=1e-8 (and RELTOL=0. so that it does not matter) this will fail. Please note that all bluewaters tests pass if I compile with -O3 and -mno-fma -mno-fma4 ie disable non-value safe optimization and fused multiply add instructions (which I'd also claim to be not value safe).

   • 2014-04-30T11:02:46+00:00
6. 

   Ian Hinder

   • removed comment

   Many of the bluewaters failures, e.g. from Exact, look to be fixable by a very slight increase of the tolerance to something larger than 1e-12.

   • 2014-04-30T11:32:19+00:00
7. 

   Erik Schnetter

   • removed comment

   Apparently Cactus compares the error to the larger of the absolute and the relative tolerance. If so, then decreasing (sic!) the relative tolerance should not be necessary, and we only need to increase the absolute tolerance.

   • 2014-04-30T12:29:12+00:00
8. 

   Roland Haas reporter

   • removed comment

   yes to both.

   • 2014-04-30T12:36:47+00:00
9. 

   Roland Haas reporter

   • removed comment

   The tolerances were increase in rev 297, 130, 143 of Exact, IDAxiBrillBH and TwoPunctures.

   • 2014-05-05T19:30:49+00:00
10. 

    Roland Haas reporter

    • removed comment

    It seems to me as if this has been addressed by now.

    • 2017-12-27T15:45:50+00:00
11. 

    anonymous

    • changed status to resolved
    • removed comment

    • 2017-12-27T15:45:56+00:00
12. 

    Roland Haas reporter

    • edited description
    • changed status to closed

    • 2019-02-21T19:51:17+00:00
13. Log in to comment