RACF NuWa-3.1.0 Status

From Daya Bay
Jump to navigation Jump to search

20110901 Install NuWa-3.1.0

  • Install 3.1.0. New policy: externals will be built with each release
  • Note: can't get tokens on daya0002 because /dc only exists on daya0001!
  • Setup so that external build/ , tarFiles/ are on scratch
dayabay@daya0001:~> mkdir  /data4/dayabay/software/releases/NuWa-3.1.0
dayabay@daya0001:~> mkdir  /data4/dayabay/software/releases/NuWa-3.1.0/external
dayabay@daya0001:~> mkdir  /data4/dayabay/software/releases/NuWa-3.1.0/external/build
dayabay@daya0001:~> mkdir  /data4/dayabay/software/releases/NuWa-3.1.0/external/tarFiles
  • Go there:
    • cd /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.1.0
  • Get token
    • /usr/kerberos/bin/kinit -k -t /dc/krb5.keytab_dayabay dayabay
    • dayabay@daya0001:NuWa-3.1.0> /usr/bin/aklog
  • Get dybinst:
  • Setup scratch directories for build
    • mkdir external
    • cd external/
    • ln -s /data4/dayabay/software/releases/NuWa-3.1.0/external/build .
    • ln -s /data4/dayabay/software/releases/NuWa-3.1.0/external/tarFiles/ .
    • cd ..
  • Set CMTCONFIG export CMTCONFIG="x86_64-slc5-gcc43-opt"
  • Let's go
    • ./dybinst 3.1.0 all

20110902 Continue NuWa-3.1.0 installation

  • Failure in installation of externals
    • Installing setuptools ... failed with 1.
    • It appears this is the first download in the installation that does not use our cache http://dayabay.bnl.gov/..... Details
setuptools: running "cmt pkg_get"
Execute action pkg_get => python /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.1.0/NuWa-3.1.0/lcgcmt/LCG_Builders/LCG_BuildPolicy/scripts/pkg_get.py
/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.1.0/NuWa-3.1.0/lcgcmt/LCG_Builders/LCG_BuildPolicy/scripts/pkg_get.py : INFO: Downloading http://pypi.python.org/packages/2.7/s/setuptools/setuptools-0.6c11-py2.7.egg to /afs/rhic.bnl.gov/dayabay/software/releases/NuWa
-3.1.0/NuWa-3.1.0/../external/tarFiles/setuptools-0.6c11-py2.7.egg
Traceback (most recent call last):
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.1.0/NuWa-3.1.0/lcgcmt/LCG_Builders/LCG_BuildPolicy/scripts/pkg_get.py", line 264, in <module>
    pg.get()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.1.0/NuWa-3.1.0/lcgcmt/LCG_Builders/LCG_BuildPolicy/scripts/pkg_get.py", line 252, in get
    elif self.LCG_get == 'http' : self.get_http()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.1.0/NuWa-3.1.0/lcgcmt/LCG_Builders/LCG_BuildPolicy/scripts/pkg_get.py", line 97, in get_http
    urllib.urlretrieve(url,target)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.1.0/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/urllib.py", line 91, in urlretrieve
    return _urlopener.retrieve(url, filename, reporthook, data)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.1.0/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/urllib.py", line 237, in retrieve
    fp = self.open(url, data)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.1.0/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/urllib.py", line 205, in open
    return getattr(self, name)(url)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.1.0/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/urllib.py", line 342, in open_http
    h.endheaders(data)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.1.0/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/httplib.py", line 940, in endheaders
    self._send_output(message_body)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.1.0/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/httplib.py", line 803, in _send_output
    self.send(msg)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.1.0/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/httplib.py", line 755, in send
    self.connect()
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.1.0/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/httplib.py", line 736, in connect
    self.timeout, self.source_address)
  File "/afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.1.0/external/Python/2.7/x86_64-slc5-gcc43-opt/lib/python2.7/socket.py", line 567, in create_connection
    raise error, msg
IOError: [Errno socket error] [Errno 97] Address family not supported by protocol
CMT> Error: execution_failed : pkg_get
  • Try again after setting proxys AND GETTING NEW TOKEN
    • . ../../trunk/setup_bnl_proxy.sourceme
    • ./dybinst 3.1.0 external setuptools nose xmlnose ipython more mysql_python django data SQLAlchemy virtualenv
  • OK. Also install optional valgrind
    • ./dybinst 3.1.0 external valgrind
  • OK. Also install optional data
    • ./dybinst 3.1.0 external data
  • OK. On to projects
    • ./dybinst 3.1.0 projects
  • OK.
  • Make opt by default
    • cd NuWa-3.1.0/setup/default/cmt/
    • echo "macro host-optdbg 'opt' " >> requirements
  • Testing (in /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.1.0)
    • ./dybinst 3.1.0 tests
  • All tests completed OK.
  • Updated ~dayabay/.nuwaenv.cfg to use 3.1.0 as default release.
  • Begin valgrind test. See also #972

Size of 3.1.0 installation

In /afs/rhic.bnl.gov/dayabay/software/releases/NuWa-3.1.0: 

du -sh *
26K     dybinst
27M     dybinst-20110901-170119.log
1.3M    dybinst-20110902-081914.log
502K    dybinst-20110902-082519.log
4.0K    dybinst-20110902-083320.log
9.8M    dybinst-20110902-083409.log
1.0K    dybinst-recent.log
2.2G    external
1.1M    installation
1005M   NuWa-3.1.0

Debug installation 20110916

Make a debug installation on daya0001 so that I can setup valgrind nosetests

  1. Start with clean session and fresh dybinst
 mkdir /data0/djaffed/3.1.0-dbg
 cd  /data0/djaffed/3.1.0-dbg
 .  /afs/rhic.bnl.gov/dayabay/software/trunk/setup_bnl_proxy.sourceme 
svn export       http://dayabay.ihep.ac.cn/svn/dybsvn/installation/trunk/dybinst/dybinst
./dybinst 3.1.0 all
 ./dybinst 3.1.0 external valgrind
  1. dybinst ... all took 3hours. dybinst...valgrind to 2 minutes
Retrieved from "https://wiki.bnl.gov/dayabay/index.php?title=RACF_NuWa-3.1.0_Status&oldid=4200"