Trusted, Bureaucrats
1,382
edits
Changes
Jump to navigation
Jump to search
no edit summary
= Setting up relax on Beagle2 0
See
# http://thread.gmane.org/gmane.science.nmr.relax.user/1821
# http://beagle.ci.uchicago.edu/using-beagle/
<source lang="text">
We got the modelfree analysis running on the Cray computer with a bunch of help from the staff there.
We basically called in the correct versions of python, scipy, numpy and mpi4py and also implemented a virtual environment to run the relax program in.
We believe that the virtualenv is necessary because of the architecture of the Cray, and might not be needed for a small cluster.
Below is the commands we used to do this, and the submission script that we have to use for our queue. The specific paths to the modules will be spcific to your system, of course.
We run the local_tm script first, then sphere, prolate, oblate and ellipsoid in parallel.
When they are done, we run the final script. As long as the data, the script and the submission instructions are all in the same directory, we haven't had any problems.
Installation
#loaded version of python and libraries we want to use:
module load python/2.7.3
export PATH=/soft/python/2.7/2.7.3/python/bin/:$PATH
export LD_LIBRARY_PATH=/soft/python/2.7/2.7.3/python/lib:$LD_LIBRARY_PATH
export PYTHONPATH=${PYTHONPATH}:/soft/python/2.7/2.7.3/modules/numpy/1.7.0/lib/python2.7/site-packages
export PYTHONPATH=${PYTHONPATH}:/soft/python/2.7/2.7.3/modules/scipy/0.12.0/lib/python2.7/site-packages
export PYTHONPATH=${PYTHONPATH}:/soft/python/2.7/2.7.3/modules/mpi4py/1.3/lib/python2.7/site-packages
#install virtualenv
wget https://pypi.python.org/packages/source/v/virtualenv/virtualenv-12.1.1.tar.gz#md5=901ecbf302f5de9fdb31d843290b7217
tar -xvf virtualenv-12.1.1.tar.gz
cd virtualenv-12.1.1
python virtualenv.py myVE
virtualenv ENV
#inside virtualenv dir I installed relax
wget http://download.gna.org/relax/relax-3.3.8.src.tar.bz2
tar xvjf relax-3.3.8.src.tar.bz2
cd relax-3.3.8
python -m compileall .
#after that was completed
export LD_LIBRARY_PATH=/lustre/beagle2/ams/python_ins/virtualenv-12.1.1/relax-3.3.8/lib:$LD_LIBRARY_PATH
Submission script
#Aftert that I tried to run it on compute nodes via PBS script:
#!/bin/bash
#PBS -N test
#PBS -q batch
#PBS -l walltime=00:30:00
#PBS -l mppwidth=64
#PBS -j oe
. /opt/modules/default/init/bash
module swap PrgEnv-cray PrgEnv-gnu
module load python/2.7.3
export PATH=/soft/python/2.7/2.7.3/python/bin/:$PATH
export PYTHONPATH=${PYTHONPATH}:/soft/python/2.7/2.7.3/modules/numpy/1.7.0/lib/python2.7/site-packages
export PYTHONPATH=${PYTHONPATH}:/soft/python/2.7/2.7.3/modules/scipy/0.12.0/lib/python2.7/site-packages
export PYTHONPATH=${PYTHONPATH}:/soft/python/2.7/2.7.3/modules/mpi4py/1.3/lib/python2.7/site-packages
export LD_LIBRARY_PATH=${LD_LIBRARY_PATH}:/lustre/beagle2/ams/python_ins/virtualenv-12.1.1/relax-3.3.8/lib
cd $PBS_O_WORKDIR
aprun -n 2 python /lustre/beagle2/ams/python_ins/virtualenv-12.1.1/relax-3.3.8/relax --multi='mpi4py' --tee log.localtm /lustre/beagle2/ams/python_ins/SR1_localtm.py
</source>
= See also =
[[Category:Installation]]
[[Category:Devel]]
