RACF NuWa-3.0.0 Status

From Daya Bay
Jump to navigation Jump to search

REMINDER: FOR EACH RELEASE, BE SURE TO UPDATE nuwaenv.cfg SeeBNL_RACF_Cluster#NuWa_Releases

20110622-3 Install NuWa-3.0.0-rc01

Fetching external item into 'NuWa-3.0.0/relax'
svn: URL 'http://dayabay.ihep.ac.cn/svn/dybsvn/relax/branches/releases/v1.1r13.2' doesn't exist
    • SimonP made a boo-boo when setting up the release. He fixes it. Try svn update
    • cd NuWa-3.0.0
    • svn update
    • OK
  • set CMTCONFIG
    • export CMTCONFIG="x86_64-slc5-gcc43-opt"
  • dybinsting
    • ./dybinst 3.0.0-rc01 checkout
      • Got this complaint, as seen for previous -rcNN checkouts
svn: '/afs/rhic.bnl.gov/dayabay/software/releases' is not a working copy
svn: Can't open file '/afs/rhic.bnl.gov/dayabay/software/releases/.svn/entries': No such file or directory
SVN checkout /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0-rc01 found, will do update
    • ./dybinst 3.0.0-rc01 projects (start 14:32, end <16:55)
  • opt by default
    • cd NuWa-3.0.0-rc01/setup/default/cmt/
    • echo "macro host-optdbg 'opt' " >> requirements
  • test
    • ./dybinst 3.0.0-rc01 tests
    • 3 failures.
      • fmcp11a: Generate muon hit sim sample ... FAIL.
        • This is because $MuonDataPath is not defined. Doing the usual setup, it is correctly defined. I will assume it is peculiar to dybinst ... tests
      • DbiValidate: test_dbi_tables
      • DbiValidate: test_vld (details below)
======================================================================
ERROR: test suite for <module 'test_dbi_tables' from '/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0/dybgaudi/Database/DbiValidate/tests/test_dbi_tables.py'>
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/nose/0.11.4_python2.7/x86_64-slc5-gcc43-opt/lib/python2.7/site-packages/nose/suite.py", line 208, in run
    self.setUp()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/nose/0.11.4_python2.7/x86_64-slc5-gcc43-opt/lib/python2.7/site-packages/nose/suite.py", line 291, in setUp
    self.setupContext(ancestor)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/nose/0.11.4_python2.7/x86_64-slc5-gcc43-opt/lib/python2.7/site-packages/nose/suite.py", line 314, in setupContext
    try_run(context, names)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/nose/0.11.4_python2.7/x86_64-slc5-gcc43-opt/lib/python2.7/site-packages/nose/util.py", line 491, in try_run
    return func()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0/dybgaudi/Database/DbiValidate/tests/test_dbi_tables.py", line 27, in setup
    db = prep_db()  ## DBCONF sensitive access
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0/dybgaudi/Database/DbiValidate/tests/cnf.py", line 8, in prep_db
    if not DBConf.has_config(dbconf):
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0/dybgaudi/InstallArea/python/DybPython/dbconf.py", line 356, in has_config
    assert name_, "has_config requires an argument if DBCONF envvar is not defined "
AssertionError: has_config requires an argument if DBCONF envvar is not defined 

======================================================================
ERROR: test suite for <module 'test_vld' from '/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0/dybgaudi/Database/DbiValidate/tests/test_vld.py'>
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/nose/0.11.4_python2.7/x86_64-slc5-gcc43-opt/lib/python2.7/site-packages/nose/suite.py", line 208, in run
    self.setUp()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/nose/0.11.4_python2.7/x86_64-slc5-gcc43-opt/lib/python2.7/site-packages/nose/suite.py", line 291, in setUp
    self.setupContext(ancestor)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/nose/0.11.4_python2.7/x86_64-slc5-gcc43-opt/lib/python2.7/site-packages/nose/suite.py", line 314, in setupContext
    try_run(context, names)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/nose/0.11.4_python2.7/x86_64-slc5-gcc43-opt/lib/python2.7/site-packages/nose/util.py", line 491, in try_run
    return func()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0/dybgaudi/Database/DbiValidate/tests/test_vld.py", line 17, in setup
    db = prep_db()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0/dybgaudi/Database/DbiValidate/tests/cnf.py", line 8, in prep_db
    if not DBConf.has_config(dbconf):
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0/dybgaudi/InstallArea/python/DybPython/dbconf.py", line 356, in has_config
    assert name_, "has_config requires an argument if DBCONF envvar is not defined "
AssertionError: has_config requires an argument if DBCONF envvar is not defined
  • more extensive fmcp11a tests (after standard setup), this will run all 42 tests (41 = generation, 1 = mixing of generated inputs)
    • in /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0-rc01/dybgaudi/Production/FMCP11a/
    • nosetests -vs tests/test_fmcp11a.py
      • 1 failure in 42 tests. Muon job failed. Problem is that $MuonDataPath is defined, but the data is not there.
      • ./dybinst 3.0.0-rc01 external data (after getting token again)
    • rerun test that failed
      • nosetests -vs tests/test_fmcp11a.py:test_g4muon
      • OK
    • rerun all tests
    • nosetests -vs tests/test_fmcp11a.py
    • 5 failures in 42 jobs
    • 4 failures apparently due to difference of environments for dybinst .. tests and explicit nosetests as demonstrated by this snippet:
-Loaded 18 gamma decay combinations from file $SITEROOT/dybgaudi/Database/SimData/data/Ni64NeutronCaptureGammas.txt
+Loaded 18 gamma decay combinations from file $SITEROOT-rc01/dybgaudi/Database/SimData/data/Ni64NeutronCaptureGammas.txt
    • 1 failure for test_muonhitsim due to bogus reference file!
    • rerun
      • rm test_muonhitsim.ref
      • nosetests -vs tests/test_fmcp11a.py:test_muonhitsim
    • OK
  • DONE!

20110714 Install NuWa-3.0.0-rc02

svn: '/afs/rhic.bnl.gov/dayabay/software/releases' is not a working copy
svn: Can't open file '/afs/rhic.bnl.gov/dayabay/software/releases/.svn/entries': No such file or directory
SVN checkout /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0-rc02 found, will do update
    • ./dybinst 3.0.0-rc02 projects start 04:56
    • timeout after gaudi built, do over
    • ./dybinst 3.0.0-rc02 projects
    • Done
  • Fresh session, get new token, make opt by default
    • cd NuWa-3.0.0-rc02/setup/default/cmt/
    • echo "macro host-optdbg 'opt' " >> requirements
  • Fresh session
    • cd /afs/rhic.bnl.gov/dayabay/software/releases/
    • cd NuWa-3.0.0-rc02
    • . setup.sh
    • pushd dybgaudi/DybRelease/cmt/
    • . setup.sh
    • popd
    • cd ..
  • Test
    • ./dybinst 3.0.0-rc02 tests
    • DbiValidate failures, not same as 3.0.0-rc01, could it be due to pw change?:
=== do_test : PROCEEDING WITH DBI TEST OF dbivalidate WITH NEEDED DBCONF: offline_db
Command: date
Thu Jul 14 17:25:01 EDT 2011
Command: pushd /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0-rc02
/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0-rc02 /afs/rhic.bnl.gov/dayabay/software/releases
RT_COMMAND=nosetests -v with subversion /usr/bin/svn using RT_PATH /usr/bin:/usr/local/bin:/bin:/usr/bin
pwd ; echo -n ; echo -n
/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0/dybgaudi/Database/DbiValidate
ERROR
ERROR

======================================================================
ERROR: test suite for <module 'test_dbi_tables' from '/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0/dybgaudi/Database/DbiValidate/tests/test_dbi_tables.py'>
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/nose/0.11.4_python2.7/x86_64-slc5-gcc43-opt/lib/python2.7/site-packages/nose/suite.py", line 208, in run
    self.setUp()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/nose/0.11.4_python2.7/x86_64-slc5-gcc43-opt/lib/python2.7/site-packages/nose/suite.py", line 291, in setUp
    self.setupContext(ancestor)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/nose/0.11.4_python2.7/x86_64-slc5-gcc43-opt/lib/python2.7/site-packages/nose/suite.py", line 314, in setupContext
    try_run(context, names)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/nose/0.11.4_python2.7/x86_64-slc5-gcc43-opt/lib/python2.7/site-packages/nose/util.py", line 491, in try_run
    return func()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0/dybgaudi/Database/DbiValidate/tests/test_dbi_tables.py", line 35, in setup
    db = prep_db()  ## DBCONF sensitive access
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0/dybgaudi/Database/DbiValidate/tests/cnf.py", line 14, in prep_db
    db = DB(dbconf)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0/dybgaudi/InstallArea/python/DybPython/db.py", line 292, in __init__
    raise Exception("Error %d: %s " % ( e.args[0], e.args[1] ) )
Exception: Error 1045: Access denied for user 'dayabay'@'130.199.205.51' (using password: YES) 
-------------------- >> begin captured stdout << ---------------------
prep_db proceeding with offline_db 

--------------------- >> end captured stdout << ----------------------

======================================================================
ERROR: test suite for <module 'test_vld' from '/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0/dybgaudi/Database/DbiValidate/tests/test_vld.py'>
----------------------------------------------------------------------
Traceback (most recent call last):
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/nose/0.11.4_python2.7/x86_64-slc5-gcc43-opt/lib/python2.7/site-packages/nose/suite.py", line 208, in run
    self.setUp()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/nose/0.11.4_python2.7/x86_64-slc5-gcc43-opt/lib/python2.7/site-packages/nose/suite.py", line 291, in setUp
    self.setupContext(ancestor)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/nose/0.11.4_python2.7/x86_64-slc5-gcc43-opt/lib/python2.7/site-packages/nose/suite.py", line 314, in setupContext
    try_run(context, names)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/nose/0.11.4_python2.7/x86_64-slc5-gcc43-opt/lib/python2.7/site-packages/nose/util.py", line 491, in try_run
    return func()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0/dybgaudi/Database/DbiValidate/tests/test_vld.py", line 21, in setup
    db = prep_db()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0/dybgaudi/Database/DbiValidate/tests/cnf.py", line 14, in prep_db
    db = DB(dbconf)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0/dybgaudi/InstallArea/python/DybPython/db.py", line 292, in __init__
    raise Exception("Error %d: %s " % ( e.args[0], e.args[1] ) )
Exception: Error 1045: Access denied for user 'dayabay'@'130.199.205.51' (using password: YES) 

----------------------------------------------------------------------
Ran 0 tests in 4.208s

FAILED (errors=2)
    • Failure was due to pw change. Updated .my.cnf, now does not fail as above.
    • ./dybinst 3.0.0-rc02 tests dbivalidate
    • Completes OK
  • DONE!

20110727 Install NuWa-3.0.0-rc03

  • Usual dance
 cd /afs/rhic.bnl.gov/dayabay/software/releases/
 /usr/kerberos/bin/kinit -k -t /dc/krb5.keytab_dayabay dayabay
 /usr/bin/aklog
 cp dybinst dybinst.27july2011
 svn export http://dayabay.ihep.ac.cn/svn/dybsvn/installation/trunk/dybinst/dybinst
A    dybinst
Export complete.
 ln -s NuWa-3.0.0 NuWa-3.0.0-rc03
 cd NuWa-3.0.0
 rm -rf lcgcmt/ ldm/ setup.csh setup.sh setup/ relax/ gaudi/ lhcb/ dybgaudi/ .svn
 cd ..
 svn checkout http://dayabay.ihep.ac.cn/svn/dybsvn/NuWa/releases/NuWa-3.0.0-rc03 NuWa-3.0.0
  export CMTCONFIG="x86_64-slc5-gcc43-opt"
 ./dybinst 3.0.0-rc03 checkout
  • Note complaint
Stage: "checkout"... 

svn: '/afs/rhic.bnl.gov/dayabay/software/releases' is not a working copy
svn: Can't open file '/afs/rhic.bnl.gov/dayabay/software/releases/.svn/entries': No such file or directory
SVN checkout /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.0.0-rc03 found, will do update
  • ./dybinst 3.0.0-rc03 projects start 8:31, done 11:28
  • opt by default
    • cd NuWa-3.0.0-rc03/setup/default/cmt/
    • echo "macro host-optdbg 'opt' " >> requirements
  • Tests
    • ./dybinst 3.0.0-rc03 tests
    • All tests completed OK.
  • DONE!

20110801 Install NuWa-3.0.0

  • Usual dance
 cd /afs/rhic.bnl.gov/dayabay/software/releases/
 /usr/kerberos/bin/kinit -k -t /dc/krb5.keytab_dayabay dayabay
 /usr/bin/aklog
 cp dybinst dybinst.1aug2011
 svn export http://dayabay.ihep.ac.cn/svn/dybsvn/installation/trunk/dybinst/dybinst
A    dybinst
Export complete.
 cd NuWa-3.0.0
 rm -rf lcgcmt/ ldm/ setup.csh setup.sh setup/ relax/ gaudi/ lhcb/ dybgaudi/ .svn
 cd ..
 svn checkout http://dayabay.ihep.ac.cn/svn/dybsvn/NuWa/releases/NuWa-3.0.0 
 export CMTCONFIG="x86_64-slc5-gcc43-opt"
 ./dybinst 3.0.0 checkout
  • ./dybinst 3.0.0 projects start 09:47, done 12:10
  • opt by default
 cd NuWa-3.0.0/setup/default/cmt/
 echo "macro host-optdbg 'opt' " >> requirements
 cd -
  • Test ./dybinst 3.0.0 tests . Done OK.
  • More extensive test, (see OnlineUserManual , for details)
    • NOSE_EVAL_ATTR="minutes < 1000 " ./dybinst 3.0.0 tests fmcp11a
    • dybinst bleats Testing Daya Bay packages, this will take a while. Go get cakes... NOSE_EVAL_ATTR:minutes < 6 SVNLOG_attr: , so is ignoring the setting on the command line. What am I doing wrong? Made ticket
  • Try explicit tests, not using dybinst, have to setup environment correctly:
 pushd NuWa-3.0.0
 . setup.sh
 pushd dybgaudi/DybRelease/cmt/
 . setup.sh
 popd;popd
 cd NuWa-3.0.0/dybgaudi/Production/FMCP11a/
 nosetests -v -A "minutes > 0"
Warning in <TEnvRec::ChangeValue>: duplicate entry <Library.vector<char>=vector.dll> for level 0; ignored
Warning in <TEnvRec::ChangeValue>: duplicate entry <Library.vector<short>=vector.dll> for level 0; ignored
Warning in <TEnvRec::ChangeValue>: duplicate entry <Library.vector<unsigned-int>=vector.dll> for level 0; ignored
test_fmcp11a.test_sample_00 ... ok
test_fmcp11a.test_sample_01 ... ok
test_fmcp11a.test_sample_02 ... ok
test_fmcp11a.test_sample_03 ... ok
test_fmcp11a.test_sample_04 ... ok
test_fmcp11a.test_sample_05 ... ok
test_fmcp11a.test_sample_06 ... ok
test_fmcp11a.test_sample_07 ... ok
test_fmcp11a.test_sample_08 ... ok
test_fmcp11a.test_sample_09 ... ok
test_fmcp11a.test_sample_10 ... ok
test_fmcp11a.test_sample_11 ... ok
test_fmcp11a.test_sample_12 ... ok
test_fmcp11a.test_sample_13 ... ok
test_fmcp11a.test_sample_14 ... ok
test_fmcp11a.test_sample_15 ... ok
test_fmcp11a.test_sample_16 ... ok
test_fmcp11a.test_sample_17 ... ok
test_fmcp11a.test_sample_18 ... ok
test_fmcp11a.test_sample_19 ... ok
test_fmcp11a.test_sample_20 ... ok
test_fmcp11a.test_sample_21 ... ok
test_fmcp11a.test_sample_22 ... ok
test_fmcp11a.test_sample_23 ... ok
test_fmcp11a.test_sample_24 ... ok
test_fmcp11a.test_sample_25 ... ok
test_fmcp11a.test_sample_26 ... ok
test_fmcp11a.test_sample_27 ... ok
test_fmcp11a.test_sample_28 ... ok
test_fmcp11a.test_sample_29 ... ok
test_fmcp11a.test_sample_30 ... ok
test_fmcp11a.test_sample_31 ... ok
test_fmcp11a.test_sample_32 ... ok
test_fmcp11a.test_sample_33 ... ok
test_fmcp11a.test_sample_34 ... ok
test_fmcp11a.test_sample_35 ... ok
test_fmcp11a.test_sample_36 ... ok
test_fmcp11a.test_sample_37 ... ok
test_fmcp11a.test_sample_38 ... ok
test_fmcp11a.test_sample_39 ... ok

----------------------------------------------------------------------
Ran 40 tests in 2489.719s

OK
Retrieved from "https://wiki.bnl.gov/dayabay/index.php?title=RACF_NuWa-3.0.0_Status&oldid=4201"