RACF NuWa-1.7.0 Status

From Daya Bay
Jump to navigation Jump to search

Lessons learned

  • Need to obtain token every day, since it is deleted by dailies procedure. This is only a RACF/afs problem.
  • Maintaining all externals in same directory, rather than completely rebuilding externals with each release, has some undesired features:
    • Idempotency of dybinst probably caused problems with re-use of build directories for sqlite, gccxml
    • Dependency of one external on another (here ROOT on python2.7) required modification to build procedure. Probably need to make this procedure more global to avoid future problems.
  • How to checkout of subdir of release. Example:

20110207

  • Start 1.7.0 installation following procedure from RACF NuWa-1.6.2 Status
  • Must obtain token with klog
  • in /afs/rhic.bnl.gov/dayabay/software/releases
  • export CMTCONFIG="x86_64-slc5-gcc43-opt"
  • svn checkout http://dayabay.ihep.ac.cn/svn/dybsvn/NuWa/releases/NuWa-1.7.0
  • ./dybinst 1.7.0 checkout
  • ./dybinst 1.7.0 projects
    • Failed to build relax, suspect ROOT not up-to-date
  • ./dybinst 1.7.0 external ROOT
  • ./dybinst 1.7.0 projects
    • Failed to build relax, not ROOT (at 5.26). try gccxml.
  • ./dybinst 1.7.0 external gccxml
    • Fails
  • ./dybinst 1.7.0 external
    • Fails
 Installing external packages, this will take a while.  Go get coffee...
 Installing aida ... done with aida
 Installing sqlite ... failed with 1

Some of dybinst-recent.log: 

configure: creating ./config.status
config.status: creating Makefile
config.status: error: cannot find input file: Makefile.in
+ check 'running command: ./configure --prefix=/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/sqlite/3.6.8/x86_64-slc5-gcc43-opt --disable-tcl'
+ err=1
+ msg='running command: ./configure --prefix=/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/sqlite/3.6.8/x86_64-slc5-gcc43-opt --disable-tcl'
+ '[' -n 'running command: ./configure --prefix=/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/sqlite/3.6.8/x86_64-slc5-gcc43-opt --disable-tcl' ']'
+ shift
+ '[' 1 '!=' 0 ']'
+ fatal 'running command: ./configure --prefix=/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/sqlite/3.6.8/x86_64-slc5-gcc43-opt --disable-tcl'
+ '[' -n 'running command: ./configure --prefix=/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/sqlite/3.6.8/x86_64-slc5-gcc43-opt --disable-tcl' ']'
+ msg='running command: ./configure --prefix=/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/sqlite/3.6.8/x86_64-slc5-gcc43-opt --disable-tcl'
+ shift
+ echo 'sqlite: FATAL: "running command: ./configure --prefix=/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/sqlite/3.6.8/x86_64-slc5-gcc43-opt --disable-tcl"'
sqlite: FATAL: "running command: ./configure --prefix=/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/sqlite/3.6.8/x86_64-slc5-gcc43-opt --disable-tcl"
+ exit 1
  • Install latest dybinst (3Jan2011 was last update). First rename old dybinst to dybinst.old.
  • ./dybinst 1.7.0 external
    • Fails at sqlite as before
  • ./dybinst 1.7.0 projects
    • Fails at relax
  • ./dybinst 1.7.0 checkout
  • ./dybinst 1.7.0 external
    • Fails at sqlite as before (what was the definition of insanity again?)
  • rm -rf ../external/build/LCG/sqlite-3.6.8
  • ./dybinst 1.7.0 external
    • Failed at gccxml, here is chunk of log file
gccxml: "running command: cd /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/build/LCG/gccxml-0.9.0_20100428-build"
+ cd /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/build/LCG/gccxml-0.9.0_20100428-build
+ check 'running command: cd /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/build/LCG/gccxml-0.9.0_20100428-build'
+ err=0
+ msg='running command: cd /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/build/LCG/gccxml-0.9.0_20100428-build'
+ '[' -n 'running command: cd /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/build/LCG/gccxml-0.9.0_20100428-build' ']'
+ shift
+ '[' 0 '!=' 0 ']'
+ '[' -n bin/gccxml -a -f bin/gccxml ']'
+ cmd make
+ info 'running command: make'
+ '[' -n 'running command: make' ']'
+ msg='running command: make'
+ shift
+ echo 'gccxml: "running command: make"'
gccxml: "running command: make"
+ make
make: *** No targets specified and no makefile found.  Stop.

20110208

  • Have to obtain a new token, probably due to daily build
  • rm -rf ../external/build/LCG/gccxml-0.9.0_20100428-build/
  • export CMTCONFIG="x86_64-slc5-gcc43-opt"
  • ./dybinst 1.7.0 external gccxml
  • ./dybinst 1.7.0 external gsl mysql zsi ROOT xercesc hepmc heppdt openmotif openscientistvis geant4 setuptools nose xmlnose ipython more mysql_python django
    • Failed: Installing setuptools ... failed with 1
Command: pkg_build setuptools
Creating setup scripts.
Creating cleanup scripts.
LCG_tardir="/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/tarFiles"
LCG_builddir="/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/build/LCG"
Creating setup scripts.
Creating cleanup scripts.
setuptools: running "cmt pkg_get"
Execute action pkg_get => python /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/lcgcmt/LCG_Builders/LCG_BuildPolicy/scripts/pkg_get.py
/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/lcgcmt/LCG_Builders/LCG_BuildPolicy/scripts/pkg_get.py : INFO: Downloading http://pypi.python.org/packages/2.7/s/setuptools/setuptools-0.6c11-py2.7.egg to /afs/rhic.bnl.gov/dayabay/software/release
s/NuWa-1.7.0/../external/tarFiles/setuptools-0.6c11-py2.7.egg
Traceback (most recent call last):
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/lcgcmt/LCG_Builders/LCG_BuildPolicy/scripts/pkg_get.py", line 264, in <module>
    pg.get()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/lcgcmt/LCG_Builders/LCG_BuildPolicy/scripts/pkg_get.py", line 252, in get
    elif self.LCG_get == 'http' : self.get_http()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/lcgcmt/LCG_Builders/LCG_BuildPolicy/scripts/pkg_get.py", line 97, in get_http
    urllib.urlretrieve(url,target)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/urllib.py", line 91, in urlretrieve
    return _urlopener.retrieve(url, filename, reporthook, data)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/urllib.py", line 237, in retrieve
    fp = self.open(url, data)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/urllib.py", line 205, in open
    return getattr(self, name)(url)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/urllib.py", line 342, in open_http
    h.endheaders(data)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/httplib.py", line 940, in endheaders
    self._send_output(message_body)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/httplib.py", line 803, in _send_output
    self.send(msg)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/httplib.py", line 755, in send
    self.connect()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/httplib.py", line 736, in connect
    self.timeout, self.source_address)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/socket.py", line 567, in create_connection
    raise error, msg
IOError: [Errno socket error] [Errno 97] Address family not supported by protocol
CMT> Error: execution_failed : pkg_get
  • suspect proxy problem, try
  • source ../trunk/setup_bnl_proxy.sourceme
  • ./dybinst 1.7.0 external setuptools nose xmlnose ipython more mysql_python django
  • done with externals!
  • ./dybinst 1.7.0 projects
    • Building gaudi ... failed with 10
/afs/rhic.bnl.gov/dayabay/software/releases/external/CMT/v1r20p20080222/mgr/cmt_install_action.sh \
            -source "`(cd ../x86_64-slc5-gcc43-opt/; pwd)`" \
            -name "libGaudiPython.so" \
            -out "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/gaudi/InstallArea/x86_64-slc5-gcc43-opt/lib" \
            -cmd "python /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/gaudi/GaudiPolicy/cmt/fragments/install.py -xCVS -x.svn -x*~ -x*.stamp -s --log=./install.history " \
            -cmtpath "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/gaudi"
#CMT---> installing file libGaudiPython.so into /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/gaudi/InstallArea/x86_64-slc5-gcc43-opt/lib
eval ${install_command} ${full_source_name} ${dest_file_path}
python /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/gaudi/GaudiPolicy/cmt/fragments/install.py -xCVS -x.svn -x*~ -x*.stamp -s --log=./install.history /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/gaudi/GaudiPython/x86_64-slc5-gcc43-o
pt/libGaudiPython.so /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/gaudi/InstallArea/x86_64-slc5-gcc43-opt/lib/libGaudiPython.so
Create Link to '../../../GaudiPython/x86_64-slc5-gcc43-opt/libGaudiPython.so' in '/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/gaudi/InstallArea/x86_64-slc5-gcc43-opt/lib'
echo ${full_source_name} >${ref_file}
if test "${makecmd}"; then set +v; fi
#CMT---> installation done
#CMT---> (constituents.make) GaudiPython done
#CMT---> (constituents.make) Building GaudiPythonConf.make
Document GaudiPythonConf
#CMT---> (constituents.make) Creating GaudiPythonConf.lock and Starting GaudiPythonConf
:::::: libraries : [ GaudiPython ] ::::::
:::: processing library: GaudiPython...
ERROR: libpython2.5.so: cannot open shared object file: No such file or directory
:::::: libraries : [ GaudiPython ] :::::: [DONE]
make[3]: *** [/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/gaudi/GaudiPython/genConf/GaudiPython/GaudiPythonConf.py] Error 1
make[2]: *** [GaudiPythonConf] Error 2
make[1]: *** [common_target] Error 2
make: *** [check_config] Error 2
CMT> Error: execution_error : make
### start env dump ###
Command: env
PythonVERS=2.7
  • Why is it looking for libpython2.5? Check environmentals during build:
grep PYTHON dybinst-recent.log 
GAUDIPYTHONROOT=/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/gaudi/GaudiPython
PYTHONDOCS=/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/Python/2.7/x86_64-slc5-gcc43-opt/share/doc/python
PYTHONROOT=/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/lcgcmt/LCG_Interfaces/Python
PYTHONPATH=/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/gaudi/GaudiPython/python:/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e/x86_64-slc5-gcc43-opt/root/lib
  • insanely try, ./dybinst 1.7.0 projects gaudi
    • Fails. Try to build the part that fails
      • source NuWa-1.7.0/setup.sh
      • source NuWa-1.7.0/gaudi/GaudiRelease/cmt/setup.sh
      • cd NuWa-1.7.0/gaudi/GaudiPython/cmt/
      • cmt config
      • source setup.sh
      • make
      • Fails as before
    • Component-wise make-ing
 make -f ../x86_64-slc5-gcc43-opt/GaudiPythonConf.make
:::::: libraries : [ GaudiPython ] ::::::
:::: processing library: GaudiPython...
ERROR: libpython2.5.so: cannot open shared object file: No such file or directory
:::::: libraries : [ GaudiPython ] :::::: [DONE]
make: *** [/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/gaudi/GaudiPython/genConf/GaudiPython/GaudiPythonConf.py] Error 1
    • both ldd ../x86_64-slc5-gcc43-opt/libGaudiPython.so and ldd ../x86_64-slc5-gcc43-opt/libGaudiPythonLib.so report
        libpython2.5.so => not found
    • Similar 'not found' from ldd /afs/rhic.bnl.gov/dayabay/software/releases/external/ROOT/5.26.00e/x86_64-slc5-gcc43-opt/root/lib/libPyROOT.so.
      Brett sez this is because we didn't build ROOT 5.26.00e against python2.7 as was done for, say, mysql 1.2.3_mysql5.0.67_python2.7. Need to add this and install ROOT in this new directory.
    • Edit LCG_Builders/ROOT/cmt/requirements to add _python2.7 to the destination directory guided by the example for mysql_python Committed r10446
    • ./dybinst 1.7.0 external ROOT
    • external/ROOT/5.26.00e_python2.7/ created
    • Edit NuWa-1.7.0/lcgcmt/LCG_Interfaces/ROOT/cmt/requirements to change ROOT_native_version again guided by mysql_python example Committed r10447
    • ./dybinst -r 1.7.0 projects
      • Building relax ... failed with 10
    • typo in NuWa-1.7.0/lcgcmt/LCG_Interfaces/ROOT/cmt/requirements
    • ./dybinst -r 1.7.0 projects
      • Building gaudi ... failed with 10
    • Suspect path is stale, start with fresh session
    • cd /afs/rhic.bnl.gov/dayabay/software/releases/
    • export CMTCONFIG="x86_64-slc5-gcc43-opt"
    • ./dybinst -r 1.7.0 projects
      • Building gaudi ... failed with 10
    • do setup dance described above, examine .so's
dayabay@daya0001:GaudiPython> ldd x86_64-slc5-gcc43-opt/libGaudiPythonLib.so 
        libdl.so.2 => /lib64/libdl.so.2 (0x00002b362fd40000)
        libGaudiAlgLib.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/gaudi/InstallArea/x86_64-slc5-gcc43-opt/lib/libGaudiAlgLib.so (0x00002b362ff44000)
        libGaudiUtilsLib.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/gaudi/InstallArea/x86_64-slc5-gcc43-opt/lib/libGaudiUtilsLib.so (0x00002b3630278000)
        libGaudiKernel.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/gaudi/InstallArea/x86_64-slc5-gcc43-opt/lib/libGaudiKernel.so (0x00002b3630493000)
        libReflex.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libReflex.so (0x00002b3630aed000)
        libCore.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libCore.so (0x00002b3630d98000)
        libCint.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libCint.so (0x00002b36317db000)
        libTree.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libTree.so (0x00002b3632188000)
        libpthread.so.0 => /lib64/libpthread.so.0 (0x00002b363259b000)
        libRIO.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libRIO.so (0x00002b36327b6000)
        libMathCore.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libMathCore.so (0x00002b3632b4b000)
        libPyROOT.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libPyROOT.so (0x00002b3632f44000)
        libboost_system-gcc43-mt-1_38.so.1.38.0 => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/Boost/1.38.0_python2.7/x86_64-slc5-gcc43-opt/lib/libboost_system-gcc43-mt-1_38.so.1.38.0 (0x00002b36331e1000)
        libboost_filesystem-gcc43-mt-1_38.so.1.38.0 => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/Boost/1.38.0_python2.7/x86_64-slc5-gcc43-opt/lib/libboost_filesystem-gcc43-mt-1_38.so.1.38.0 (0x00002b36333e4000)
        libboost_regex-gcc43-mt-1_38.so.1.38.0 => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/Boost/1.38.0_python2.7/x86_64-slc5-gcc43-opt/lib/libboost_regex-gcc43-mt-1_38.so.1.38.0 (0x00002b36335f9000)
        libboost_thread-gcc43-mt-1_38.so.1.38.0 => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/Boost/1.38.0_python2.7/x86_64-slc5-gcc43-opt/lib/libboost_thread-gcc43-mt-1_38.so.1.38.0 (0x00002b36338b9000)
        libutil.so.1 => /lib64/libutil.so.1 (0x00002b3633acf000)
        libCLHEP-Cast-2.0.4.2.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/clhep/2.0.4.2/x86_64-slc5-gcc43-opt/lib/libCLHEP-Cast-2.0.4.2.so (0x00002b3633cd2000)
        libCLHEP-Evaluator-2.0.4.2.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/clhep/2.0.4.2/x86_64-slc5-gcc43-opt/lib/libCLHEP-Evaluator-2.0.4.2.so (0x00002b3633ed9000)
        libCLHEP-Exceptions-2.0.4.2.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/clhep/2.0.4.2/x86_64-slc5-gcc43-opt/lib/libCLHEP-Exceptions-2.0.4.2.so (0x00002b36340e8000)
        libCLHEP-GenericFunctions-2.0.4.2.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/clhep/2.0.4.2/x86_64-slc5-gcc43-opt/lib/libCLHEP-GenericFunctions-2.0.4.2.so (0x00002b36342fa000)
        libCLHEP-Geometry-2.0.4.2.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/clhep/2.0.4.2/x86_64-slc5-gcc43-opt/lib/libCLHEP-Geometry-2.0.4.2.so (0x00002b3634557000)
        libCLHEP-Random-2.0.4.2.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/clhep/2.0.4.2/x86_64-slc5-gcc43-opt/lib/libCLHEP-Random-2.0.4.2.so (0x00002b3634769000)
        libCLHEP-RandomObjects-2.0.4.2.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/clhep/2.0.4.2/x86_64-slc5-gcc43-opt/lib/libCLHEP-RandomObjects-2.0.4.2.so (0x00002b36349e3000)
        libCLHEP-RefCount-2.0.4.2.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/clhep/2.0.4.2/x86_64-slc5-gcc43-opt/lib/libCLHEP-RefCount-2.0.4.2.so (0x00002b3634bed000)
        libCLHEP-Vector-2.0.4.2.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/clhep/2.0.4.2/x86_64-slc5-gcc43-opt/lib/libCLHEP-Vector-2.0.4.2.so (0x00002b3634def000)
        libCLHEP-Matrix-2.0.4.2.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/clhep/2.0.4.2/x86_64-slc5-gcc43-opt/lib/libCLHEP-Matrix-2.0.4.2.so (0x00002b3635040000)
        libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00002b3635270000)
        libm.so.6 => /lib64/libm.so.6 (0x00002b3635571000)
        libgcc_s.so.1 => /lib64/libgcc_s.so.1 (0x00002b36357f4000)
        libc.so.6 => /lib64/libc.so.6 (0x00002b3635a02000)
        /lib64/ld-linux-x86-64.so.2 (0x00002b362f714000)
        libHist.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libHist.so (0x00002b3635d5a000)
        libncurses.so.5 => /usr/lib64/libncurses.so.5 (0x00002b36363d4000)
        libcrypt.so.1 => /lib64/libcrypt.so.1 (0x00002b3636632000)
        libNet.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libNet.so (0x00002b363686a000)
        libThread.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libThread.so (0x00002b3636b9f000)
        libGraf.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libGraf.so (0x00002b3636df5000)
        libGraf3d.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libGraf3d.so (0x00002b3637222000)
        libGpad.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libGpad.so (0x00002b3637552000)
        libMatrix.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libMatrix.so (0x00002b3637847000)
        libpython2.5.so => not found
        librt.so.1 => /lib64/librt.so.1 (0x00002b3637cab000)
dayabay@daya0001:GaudiPython> ldd /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libPyROOT.so 
        libCore.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libCore.so (0x00002b69b4dec000)
        libCint.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libCint.so (0x00002b69b582f000)
        libRIO.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libRIO.so (0x00002b69b61dc000)
        libNet.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libNet.so (0x00002b69b6570000)
        libHist.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libHist.so (0x00002b69b68a5000)
        libGraf.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libGraf.so (0x00002b69b6f1f000)
        libGraf3d.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libGraf3d.so (0x00002b69b734b000)
        libGpad.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libGpad.so (0x00002b69b767c000)
        libTree.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libTree.so (0x00002b69b7970000)
        libMatrix.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libMatrix.so (0x00002b69b7d84000)
        libMathCore.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libMathCore.so (0x00002b69b81e8000)
        libThread.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libThread.so (0x00002b69b85e1000)
        libReflex.so => /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/../external/ROOT/5.26.00e_python2.7/x86_64-slc5-gcc43-opt/root/lib/libReflex.so (0x00002b69b8838000)
        libdl.so.2 => /lib64/libdl.so.2 (0x00002b69b8af9000)
        libpython2.5.so => not found
        libstdc++.so.6 => /usr/lib64/libstdc++.so.6 (0x00002b69b8cfe000)
        libm.so.6 => /lib64/libm.so.6 (0x00002b69b8ffe000)
        libgcc_s.so.1 => /lib64/libgcc_s.so.1 (0x00002b69b9281000)
        libc.so.6 => /lib64/libc.so.6 (0x00002b69b9490000)
        libncurses.so.5 => /usr/lib64/libncurses.so.5 (0x00002b69b97e7000)
        libcrypt.so.1 => /lib64/libcrypt.so.1 (0x00002b69b9a44000)
        libpthread.so.0 => /lib64/libpthread.so.0 (0x00002b69b9c7d000)
        /lib64/ld-linux-x86-64.so.2 (0x00002b69b4932000)
    • Apparently build of ROOT/5.26.00e_python2.7 used old, pre-python2.7, build that was still on the scratch disk (due to over-enthusiastic idempotency?)
    • rm -rf /data4/dayabay/software/external/build/LCG/ROOT /data4/dayabay/software/external/build/LCG/root
    • (in external/ROOT) rm -rf 5.26.00e_python2.7
    • (in releases/ ) ./dybinst 1.7.0 external ROOT
    • ./dybinst -r 1.7.0 projects

20110209

  • Done.(17:00 No, not done!) Do checks.
  • nuwaenv -r 1.7.0
  • nuwa.py
    • ImportError: No module named PyCintex
    • CMTCONFIG wrong. See Trac ticket #348 and FMCP11a instructions
    • edit NuWa-1.7.0/setup/default/cmt/requirements to fix. Needed to get token first.
    • Create and fill data/ according to FMCP11a instructions (Note: I did not create a softlink as for 1.6.x in order to get NewMuonGenerator/data)
  • OK. Is there a way to run all nosetests without descending into each package directory? YES
    • ./dybinst 1.7.0 tests
  • Output of some tests (some output removed)
cd RootIO/RootIOSvc/
dayabay@daya0001:RootIOSvc> nosetests
Ran 4 tests in 0.075s
OK

cd ../RootIOTest/
nosetests
Ran 16 tests in 71.566s
FAILED (failures=16)

cd ../../Utilities/GaudiMessages/
nosetests
Ran 3 tests in 6.697s
OK

cd ../../Simulation/GenTools/
nosetests
Ran 2 tests in 13.086s
FAILED (failures=2)

cd ../../Production/MDC10b/
nosetests
Ran 2 tests in 13.600s
FAILED (failures=1)

cd ../../DybAlg/
nosetests
FAIL: Modification of material properties
Ran 3 tests in 4.687s
FAILED (failures=1)

cd  dybgaudi/Simulation/DetSim/ ; nosetests
FAIL: Basic physics test using gun kinematics
FAIL: Test with historian
Ran 2 tests in 16.678s
FAILED (failures=2)

$ nuwa.py -A None -n 5000 -R 30000 -m "SpadeSvc -S ibd"  -m "FMCP11a.runIBD -e DetSim -w 2011-01-12T00:00:00 " -o $OutDir/FMCP11a_IBD_DayaBayAD1_RACF_D30000.root 
Traceback (most recent call last):
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/dybgaudi/InstallArea/scripts/nuwa.py", line 6, in <module>
    nuwa = main()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/dybgaudi/InstallArea/python/DybPython/Control.py", line 850, in main
    nuwa.configure()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/dybgaudi/InstallArea/python/DybPython/Control.py", line 717, in configure
    self.configure_framework()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/dybgaudi/InstallArea/python/DybPython/Control.py", line 351, in configure_framework
    import DybEventMgr
ImportError: No module named DybEventMgr

20110210

  • Something happened to the dybinst-..log file. Yesterday I was watching each package compile with tail -f, but when I look at the log file now I only see Now trying [cmt config] in... with no compilation information. Odd.
  • Run 1st FMCP11a RACF production job of IBD,Rad.,Muon as (as djaffed):
    • in dayabay/offline/NuWa-trunk/people/djaffe/panda/latest_sendjobs/FMCP11a/
    • export MuonDataPath=$SITEROOT/data/NewMuonGenerator/data/
    • export LogDir=log
    • export OutDir=out
    • nuwa.py -A None -n 5000 -R 30000 -m "SpadeSvc -S ibd" -m "FMCP11a.runIBD -e DetSim -w 2011-01-12T00:00:00 " -o $OutDir/FMCP11a_IBD_DayaBayAD1_RACF_D30000.root >& $LogDir/FMCP11a_IBD_DayaBayAD1_RACF_D30000.log &
    • $ nuwa.py -A None -n 50000 -R 30010 -m "SpadeSvc -S radioact" -m "FMCP11a.runRadioact -r U238_gds -d DayaBayAD1 -e DetSim -w 2011-03-10T20:53:20 " -o $OutDir/FMCP11a_U238-gds_DayaBayAD1_RACF_D30010.root >& $LogDir/FMCP11a_U238-gds_DayaBayAD1_RACF_D30010.log &
    • nuwa.py -A None -n 10000 -R 30856 -m "SpadeSvc -S muon" -m "FMCP11a.runMuon -e DetSim " -o $OutDir/FMCP11a_Muon_DayaBay_RACF_D30856.root >& $LogDir/FMCP11a_Muon_DayaBay_RACF_D30856.log &
  • All test jobs completed. No obvious, serious problems.

20110217

Change /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-1.7.0/dybgaudi/DybPython/python/DybPython/Control.py to allow reading of xrootd files 

        # Should check that the files exist but this may fail for
        # xrootd files?
        for fname in self.input_files:
            if fname[:7]=='root://' :
                if self.input_files.index( fname ) < 1 :
                    print 'Cannot test for existence of xrootd file. Here is first file',fname
            else:
                if not os.path.exists(fname):
                    msg = 'Warning: input file does not exist "%s"'%fname
                    raise RuntimeError,msg
                continue

will need to propagate this change to trunk. Done r10527

Diagnostic tools

Tools used

  • ldd
  • make -f <Makefile> --dry-run
  • make -d
  • cmt -warnings make
  • ld -t
  • ./dybinst 1.7.0 tests
Retrieved from "https://wiki.bnl.gov/dayabay/index.php?title=RACF_NuWa-1.7.0_Status&oldid=4204"