RACF NuWa-3.3.0 Status

From Daya Bay
Jump to navigation Jump to search

20111109

  • get tokens
    • /usr/kerberos/bin/kinit -k -t /dc/krb5.keytab_dayabay dayabay
    • /usr/bin/aklog
  • clean up /afs/rhic.bnl.gov/dayabay/software/releases/
    • mkdir DYBINST_LOGS
    • mv dybinst-2*.log DYBINST_LOGS/.
  • in /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.3.0/ , get dybinst and install
  • ./dybinst 3.3.0 all (start 16:24)

20111110

  • Installing geant4 ... failed with 1
Wed Nov  9 18:14:00 EST 2011
Command: pkg_build geant4
### start env dump ###

./dybinst 3.3.0 external geant4 setuptools nose xmlnose ipython more mysql_python django data SQLAlchemy virtualenv

  • Wrong. Disk quota exceeded. Forgot to make scratch directories for external/tarFiles and external/build
    • rm -rf external/tarFiles/
    • cd external/
    • mkdir /data2/dayabay/NuWa-3.3.0/external/tarFiles
    • ln -s /data2/dayabay/NuWa-3.3.0/external/tarFiles .
    • rm -rf build
    • ln -s /data2/dayabay/NuWa-3.3.0/external/build .
  • Start again exploit idempotency
  • ./dybinst 3.3.0 all
    • Installing setuptools ... failed with 1
Execute action pkg_get => python /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.3.0/NuWa-3.3.0/lcgcmt/LCG_Builders/LCG_BuildPolicy/scripts/pkg_get.py
/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.3.0/NuWa-3.3.0/lcgcmt/LCG_Builders/LCG_BuildPolicy/scripts/pkg_get.py : INFO: Downloading http://pypi.python.org/packages/2.7/s/setuptools/setuptool
s-0.6c11-py2.7.egg to /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.3.0/NuWa-3.3.0/../external/tarFiles/setuptools-0.6c11-py2.7.egg

[snip]

IOError: [Errno socket error] [Errno 97] Address family not supported by protocol
CMT> Error: execution_failed : pkg_get
  • need proxy?
 .  ../../trunk/setup_bnl_proxy.sourceme 
http_proxy=http://192.168.1.130:3128/
ftp_proxy=http://192.168.1.130:3128/
  • yep
  • ./dybinst 3.3.0 external setuptools nose xmlnose ipython more mysql_python django data SQLAlchemy virtualenv
  • OK
  • ./dybinst 3.3.0 projects
    • Building dybgaudi ... failed with 10 WTF?
# Now trying [cmt config] in /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.3.0/NuWa-3.3.0/dybgaudi/DybRelease/cmt (309/309)
#--------------------------------------------------------------
Creating setup scripts.
Creating cleanup scripts.
Command: cmt br make
### start env dump ###
  • just try again ./dybinst 3.3.0 projects dybgaudi
  • working OK until PerGenEvent_load.o: Disk quota exceeded
dayabay@daya0001:NuWa-3.3.0> du -h --max-depth=2
1.1M    ./installation/3.3.0
1.1M    ./installation
15M     ./external/CMT
2.7M    ./external/AIDA
4.5M    ./external/sqlite
142M    ./external/Python
4.3M    ./external/pyxml
73M     ./external/Boost
22M     ./external/clhep
34M     ./external/CMake
16M     ./external/gccxml
9.1M    ./external/GSL
104M    ./external/mysql
580K    ./external/suds
2.5M    ./external/zsi
1.4G    ./external/ROOT
10M     ./external/XercesC
13M     ./external/HepMC
17M     ./external/HepPDT
49M     ./external/OpenMotif
229M    ./external/OpenScientist
643M    ./external/geant4
348K    ./external/setuptools
1011K   ./external/nose
81K     ./external/xmlnose
11M     ./external/ipython
31M     ./external/More
304K    ./external/mysql_python
278M    ./external/data
5.4M    ./external/SQLAlchemy
575K    ./external/virtualenv
3.0G    ./external
20K     ./NuWa-3.3.0/.svn
19M     ./NuWa-3.3.0/lcgcmt
1.1G    ./NuWa-3.3.0/gaudi
499M    ./NuWa-3.3.0/lhcb
46M     ./NuWa-3.3.0/relax
1.1G    ./NuWa-3.3.0/dybgaudi
2.3M    ./NuWa-3.3.0/ldm
25K     ./NuWa-3.3.0/setup
2.7G    ./NuWa-3.3.0
5.8G    .
  • DOH! Forgot to build OPTIMIZED

20111110 better

  • in /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.3.0
  • clean up my mess rm -rf installation NuWa-3.3.0 external
  • softlinks
    • mkdir external
    • cd external/
    • ln -s /data2/dayabay/NuWa-3.3.0/external/build .
    • ln -s /data2/dayabay/NuWa-3.3.0/external/tarFiles .
    • cd ..
  • export CMTCONFIG="x86_64-slc5-gcc43-opt"
  • ./dybinst 3.3.0 all
  • Installing openscientistvis ... failed with
  • ./dybinst 3.3.0 external openscientistvis geant4 setuptools nose xmlnose ipython more mysql_python django data SQLAlchemy virtualenv

20111114

  • Installing openscientistvis ... failed with 1
    • rm -rf external/build/LCG/OpenScientist; rm -rf external/tarFiles/osc_vis_source_16.11.zip
  • Reacquire tokens
  • ./dybinst 3.3.0 external openscientistvis geant4 setuptools nose xmlnose ipython more mysql_python django data SQLAlchemy virtualenv
  • Nope
build CoinXt/v1r122p9 ...
+ ./sh/build -group Xt -v
WARNING : Motif not found under /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.3.0/NuWa-3.3.0/../external/OpenMotif/2.3.0/x86_64-slc5-gcc43-opt
+ obuild_status=1
+
  • Assume openmotif didn't get built properly
    • rm -rf external/OpenMotif external/build/LCG/OpenScientist external/build/LCG/openmotif-2.3.0 external/build/LCG/openmotif-2.3.0.tar.gz external/build/LCG/osc_vis_source_16.11.zip external/tarFiles/openmotif-2.3.0.tar.gz external/tarFiles/osc_vis_source_16.11.zip
  • ./dybinst 3.3.0 external openmotif openscientistvis geant4 setuptools nose xmlnose ipython more mysql_python django data SQLAlchemy virtualenv
  • Nope
+ echo 'build CoinPython/v1r0p12 ...'
build CoinPython/v1r0p12 ...
+ ./sh/build -v -group Python
WARNING : Python not found under /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.3.0/NuWa-3.3.0/../external/Python/2.7/x86_64-slc5-gcc43-opt
+ obuild_status=1
  • WTH?
 ls /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.3.0/NuWa-3.3.0/../external/Python/2.7/x86_64-slc5-gcc43-opt
ls: /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.3.0/NuWa-3.3.0/../external/Python/2.7/x86_64-slc5-gcc43-opt: No such file or directory
dayabay@daya0001:NuWa-3.3.0> ls /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.3.0/NuWa-3.3.0/../external/Python/2.7/
x86_64-slc5-gcc43-dbg
  • Assume staleness in /data2 files is the problem. cleanup
 rm -rf installation external NuWa-3.3.0 
dayabay@daya0001:NuWa-3.3.0> ls /data2/dayabay/NuWa-3.3.0/external/
build/    tarFiles/ 
dayabay@daya0001:NuWa-3.3.0> rm -rf  /data2/dayabay/NuWa-3.3.0/external/build/LCG
dayabay@daya0001:NuWa-3.3.0> ls /data2/dayabay/NuWa-3.3.0/external/tarFiles/
aida-3.2.1.tar.gz     Django-1.2.1.tar.gz           HepMC-2.03.09.tar.gz   mysql-5.0.67.tar.gz        python-2.7-docs-html.tar.bz2  setuptools-0.6c11-py2.7.egg  xmlnose-3150.tar.gz
boost_1_38_0.tar.bz2  ensdf-files.tar               HepPDT-2.05.04.tar.gz  MySQL-python-1.2.3.tar.gz  Python-2.7.tgz                SQLAlchemy-0.6.7.tar.gz      ZSI-2.0.tar.gz
clhep-2.0.4.2.tgz     gccxml-0.9.0_20100428.tar.gz  ipython-0.9.1.tar.gz   nose-0.11.4.tar.gz         python-suds-0.4.tar.gz        sqlite-3.6.8.tar.gz
cmake-2.6.4.tar.gz    geant4.9.2.p01.tar.gz         more-0.8.3.tar.bz2     openmotif-2.3.0.tar.gz     PyXML-0.8.4.tar.gz            virtualenv-1.5.1.tar.gz
daqdata-0.0.tgz       gsl-1.10.tar.gz               muondata-0.0.tgz       osc_vis_source_16.11.zip   root_v5.26.00e.source.tar.gz  xerces-c-src_2_8_0.tar.gz
dayabay@daya0001:NuWa-3.3.0> rm  /data2/dayabay/NuWa-3.3.0/external/tarFiles/*
dayabay@daya0001:NuWa-3.3.0> mkdir external
dayabay@daya0001:NuWa-3.3.0> cd external/
dayabay@daya0001:external> ln -s /data2/dayabay/NuWa-3.3.0/external/tarFiles .
dayabay@daya0001:external> ln -s /data2/dayabay/NuWa-3.3.0/external/build .
dayabay@daya0001:external> cd ..
  • Fresh terminal
 cd /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.3.0/
dayabay@daya0001:NuWa-3.3.0> export CMTCONFIG="x86_64-slc5-gcc43-opt"
dayabay@daya0001:NuWa-3.3.0> /usr/kerberos/bin/kinit -k -t /dc/krb5.keytab_dayabay dayabay
dayabay@daya0001:NuWa-3.3.0> /usr/bin/aklog
dayabay@daya0001:NuWa-3.3.0> .  ../../trunk/setup_bnl_proxy.sourceme 
http_proxy=http://192.168.1.130:3128/
ftp_proxy=http://192.168.1.130:3128/
dayabay@daya0001:NuWa-3.3.0> ./dybinst 3.3.0 all

20111115

  • /afs got really slow so build failed in dybgaudi because tokens expired
  • ./dybinst 3.3.0 projects dybgaudi
  • OK
  • ./dybinst 3.3.0 tests
  • OK
  • make opt by default
    • cd NuWa-3.3.0/NuWa-3.3.0/setup/default/cmt/
    • echo "macro host-optdbg 'opt' " >> requirements
  • Done!