introduction on wrf-var regression test ruifang li mmm [email protected] phone: 303 4978938
TRANSCRIPT
WRF-Var Regression Test Flow Chart Run Script Script Output Future Work
Flow Chart
WRF-var source code
.Trunk
.user’s tarfileWrfvar.tar
Set up Initial
variablesREG_ROOT = /ptmp/$userCASES = /ptmp/lir/CASEFAIL_MAIL = ( ${user}@ucar.edu )COMPOPTS_VAL = (Serial MPI)Num_Procs = 4GENERATE_BASELINE = FALSECOMPARE_BASELINE = FALSE
. . .
Compile
.Serial
.MPI
Test cases
.Each case is tested by Serial and MPI executable. (da_wrfvar.exe)
Compare case output
Compare cost function of Serial and MPI run,Get the first iteration in which cost function is different
.
error
error
Exit andSend email to user with error message
Regtest_var.output
Run Script Code comes from trunk
Bsub < regtest_var.csh Code comes from user
Make a tar file named wrfvar.tar Put wrfvar.tar in the same directory as
regtest_var.csh Bsub < regtest_var.csh
Regression Test output
WRF-Var source code svn info: Path: WRFDA URL: https://svn-wrf-model.cgd.ucar.edu/trunk Repository Root: https://svn-wrf-model.cgd.ucar.edu Repository UUID: b0b5d27b-6f0f-0410-a2a3-cb1e977edc3d Revision: 3590 Node Kind: directory Schedule: normal Last Changed Author: xinzhang Last Changed Rev: 3589 Last Changed Date: 2009-02-09 22:09:16 -0700 (Mon, 09 Feb 2009)
WRF-Var source code are located at /ptmp/lir/wrfvar_regression.905395 WRF-Var test cases are located at /ptmp/lir/wrf_test/data/CASE
Architecture AIX machine: be1104en.ucar.edu Number of MPI processes to use: 4 Test conducted by Li Ruifang 8938 MMM Test run from directory /ptmp/lir/wrf_test/wrf_var/regression/script
This is a bit-wise (traditional) regression test.
Compiler version info: FORTRAN: xlfrte 11.1.0.5 OS version info: AIX: bos.mp 5.3.8.2
WRF-Var compile successfully for Serial option WRF-Var compile successfully for MPI option
Regression Test ouput cont’ ############################################################################### WRF-Var IS STARTING TO TEST EACH OF CASES IN /ptmp/lir/wrf_test/data/CASE ###############################################################################
CASE cwb ....................................... Serial Run ...... PASS MPI Run ...... PASS
CASE test1 ....................................... FAIL: either be.dat or ob.ascii or fg or namelist.input not exist for CASE test1
############################################################################### COMPARING SERIAL AND MPI OUTPUT FOR EACH OF CASES IN /ptmp/lir/wrf_test/data/CASE ###############################################################################
CASE cwb .............................................................................................
Output starts to differ at iteration Serial vs MPI
21 3.03954669D+04 2.75530512D+01 2.50729942D-0 | 21 3.03954668D+04 2.75530512D+01 2.50729942D-0
Test New Case Make a directory for new case Copy fg, ob.ascii, be.dat, namelist.input
to new case directory
Future Work Archive Serial/MPI run’s output and
compare with next run’s output. Test on Linux and Mac ( now on
bluefire). Put each run’s output on wiki page Test more cases Test update_be, wrf, wps