Open main menu

Changes

Run relax at Google Cloud Computing

1,430 bytes added, 12:47, 27 October 2017
Switch to the {{relax source}} and {{relax url}} templates for the code URLs.
The [https://en.wikipedia.org/wiki/Google_Cloud_Platform Google Cloud Platform] is a cloud computing platform that can be used for cheaply running relax on a cluster.
 
== Background ==
This follows the same idea as from [[Run_relax_at_cloud.sagemath.com|Run relax at cloud.sagemath.com]]
gcloud compute zones list
gcloud compute machine-types list | grep us-central1-f
gcloud compute machine-types list | grep us-central1-f | sort -k3 -n
gcloud compute images list
# Create instance
gcloud compute instances create relax --zone us-central1-f --machine-type n1-highcpu-8 4 --image ubuntu-14-04 --boot-disk-size 10GB
gcloud compute instances list
 
# Or
gcloud compute instances create relax --zone us-central1-f --machine-type n1-highcpu-4 --image rhel-6-v20160921 --boot-disk-size 10GB
 
</source>
PROJ=relax-1
ZONE=us-central1-f
PRID=relaxinstance-1
GCC=gcc
gcloud compute --project $PROJ ssh --zone $ZONE $PRID
 
gcloud compute --project "relax-1" ssh --zone "us-central1-f" "instance-1"
</source>
For '''rapid deployment''' use this command. This will install current version of relax and trunk.
[http://svn.gna.org/viewcvs/See the list of deploy scripts here*checkout*/{{relaxurl|path=devel_scripts/trunkdeploy_scripts/devel_scripts/deploy_google_computing_ubuntu}} Then download the script that matches the system.{{#tag: source|# Select a version script# Redhat Version 6VERS=deploy_google_computing_redhat_6_86_x64.sh?content-typeVERS=text%2Fplain See the install script here]deploy_google_computing_redhat_6_86_x64_upgrade_python.sh# Centos Version 6<source langVERS="bash">deploy_google_computing_centos_6_86_x64_upgrade_python.sh# Redhat Version 7URLVERS=http://svndeploy_google_computing_redhat_7_86_x64.gnash# UbuntuVERS=deploy_google_computing_ubuntu_14-04_86_x64.org/viewcvs/*checkout*/sh # Then set download URLURL={{relaxurl|path=devel_scripts/trunkdeploy_scripts/devel_scripts/deploy_google_computing_ubuntu.sh$VERS|view=raw}} #eval "Download and readlsudo yum -y install wgetwget $(curl "URL $URL")"VERSmv $VERS* $VERSwget cat $URLVERS # Load functionssource deploy_google_computing_ubuntu.sh$VERS
# See functionscat deploy_google_computing_ubuntu.shDo installation
installandcheck
</source>| lang="bash"}} 
'''Check installation of relax'''
{{#tag:source|
mpirun --np 8 2 relax_trunk --multi='mpi4py'
relax_trunk --time -x
|lang="bash"
}}
 
== Test openmpi ==
 
For BASH shell<br>
{{relax source|path=devel_scripts/openmpi_test_install_bash.sh|view=raw|text=See the script here}}
{{#tag: source|
URL={{relax url|path=devel_scripts/openmpi_test_install_bash.sh|view=raw}}
wget $URL
mv openmpi_test_install_bash.sh* openmpi_test_install_bash.sh
 
# Source functions
source openmpi_test_install_bash.sh
testopenmpi
| lang="bash"
}}
 
For TCSH shell<br>
{{relax source|path=devel_scripts/openmpi_test_install_tcsh.sh|view=raw|text=See the script here}}
{{#tag: source|
alias get 'set noglob; wget {{relax url|path=devel_scripts/openmpi_test_install_tcsh.sh|view=raw}}; mv openmpi_test_install_tcsh.sh* openmpi_test_install_tcsh.sh;unset noglob'
get
 
# Source functions
source openmpi_test_install_tcsh.sh
| lang="bash"
}}
 
==Transfer files back and forth to the server==
This follows some example data from the tutorial here [[Tutorial_for_sorting_data_stored_as_numpy_to_on-resonance_R1rho_analysis|Tutorial for sorting data stored as numpy to on resonance R1rho_analysis]]
[http://svn.gna.org/viewcvs/{{relax/trunk/source|path=test_suite/shared_data/dispersion/Paul_Schanda_2015_Nov |text=Overview of directory]}}
Copy data to local dir
[http://svn.gna.org/viewcvs/*checkout*/{{relax/trunk/source|path=test_suite/shared_data/dispersion/Paul_Schanda_2015_Nov/1_tutorial_prepare_data.py?content-type|text=text%2Fplain Prepare data]}}
{{#tag:source|
cat 1_tutorial_prepare_data.py
}}
[http://svn.gna.org/viewcvs/*checkout*/{{relax/trunk/source|path=test_suite/shared_data/dispersion/Paul_Schanda_2015_Nov/2_tutorial_load_data.py?revision|text=28131&content-type=text%2Fplain Run analysis]}}
{{#tag:source|
cat 2_tutorial_load_data.py
mpirun --np 8 2 relax_trunk --multi='mpi4py' 2_tutorial_load_data.py
ls -latr
|lang="bash"
}}
[http://svn.gna.org/viewcvs/*checkout*/{{relax/trunk/source|path=test_suite/shared_data/dispersion/Paul_Schanda_2015_Nov/3_tutorial_clustered.py?content-type|text=text%2Fplain Run clustered analysis]}}
{{#tag:source|
cat 3_tutorial_clustered.py
mpirun --np 8 2 relax_trunk --multi='mpi4py' 3_tutorial_clustered.py
ls -latr
|lang="bash"
==Deploy google datalab to your server==
{{warning|This does not work}}
 
Read more here: http://techcrunch.com/2015/10/13/google-launches-cloud-datalab-an-interactive-tool-for-exploring-and-visualizing-data
See Location at: https://appengine.google.com/
Start Stop your server:
<source lang="bash">
gcloud compute --project $PROJ instances start stop --zone $ZONE $PRIDssh $GCC
</source>
* Launch datalab
* Sign in
* Deploy to your project. This takes '''10 min.'''
== See also ==
[[Category:Installation]]
Trusted, Bureaucrats
4,223

edits