Changes

== Background ==

* [https://github.com/nmr-relax-code/test_suiterelax/system_testsblob/scriptsmaster/model_freeauto_analyses/dauvergne_protocol.py* nmr-relax-code/auto_analyses/dauvergne_protocol.py]

== Scripts ==For references, see [http://www.nmr-relax.com/refs.shtml relax references]:To get * [[Model-free_analysis_single_field#Protocol|See this description of the protocol by Edward]] and image [http://www.nmr-relax.com/manual/The_diffusion_seeded_paradigm.html The diffusion seeded paradigm]* [http://www.nmr-relax.com/manual/Model_free_analysis.html Link to the manual]* [http://www.nmr-relax.com/manual/The_model_free_models.html Summary of model-free models]* [http://www.nmr-relax.com/manual/molmol_macro_apply.html#SECTION081284600000000000000 Summary of parameter meaning and value to workpymol visualization]* d'Auvergne, E. J. and Gooley, P. R. (2008). [http://dx.doi.org/10.1007/s10858-007-9214-2 Optimisation of NMR dynamic models I. Minimisation algorithms and their performance within the model-free and Brownian rotational diffusion spaces. J. Biomol. NMR, 40(2), 107-119.]* d'Auvergne, E. J. and Gooley, P. R. (2008). [http://dx.doi.org/10.1007/s10858-007-9213-3 Optimisation of NMR dynamic models II. A new methodology for the dual optimisation of the model-free parameters and the Brownian rotational diffusion tensor. J. Biomol. NMR, we need to 40(2), 121-133.]

* Load a PDB structure= Script inspiration =* Assign the "data structure" in relax through spin== model-assignmentsfree : Script inspiration for setup and analysis ==* Assign necessary "information" as isotope information to each spin-assignmentThe distribution of relax includes a folder '''sample_scripts/model_free''' which contain* Read "R1, R2 and NOE" a folder with scripts for different magnet field strengths* Calculate some properties* Check the data* Run the protocolanalysis.

To work most efficiently, it is important to perform each step 1 by 1, and closely inspect the log for any errorsIt can be seen here: https://github.com/nmr-relax/relax/tree/master/sample_scripts/model_free

For similar tutorial, have Here is the current list* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/back_calculate.py back_calculate.py]. Back-calculate and save relaxation data starting from a saved model-free results file.* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/bmrb_deposition.py bmrb_deposition.py] Script for creating a look at NMR-STAR 3.1 formatted file for BMRB deposition of model-free results.* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/cv.py cv.py] Script for model-free analysis using cross-validation model selection.* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/dasha.py dasha.py] Script for model-free analysis using the program Dasha.* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/dauvergne_protocol.py dauvergne_protocol.py] Script for black-box model-free analysis.* [Tutorial_for_modelhttps://github.com/nmr-free_analysis_sam_mahdi Tutorial relax/relax/blob/master/sample_scripts/model_free/diff_min.py diff_min.py] Demonstration script for diffusion tensor optimisation in a model-free analysis sam mahdi.]* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/final_data_extraction.py final_data_extraction.py] Extract Data to Table* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/generate_ri.py generate_ri.py] Script for back-calculating the relaxation data.* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/grace_S2_vs_te.py grace_S2_vs_te.py] Script for creating a grace plot of the simulated order parameters vs. simulated correlation times.* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/ grace_ri_data_correlation.py] Script for creating correlations plots of experimental verses back calculated relaxation data.* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/map.py map.py] Script for mapping the model-free space for OpenDX visualisation.* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/mf_multimodel.py mf_multimodel.py] This script performs a model-free analysis for the models 'm0' to 'm9' (or 'tm0' to 'tm9').* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/modsel.py modsel.py] Script for model-free model selection.* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/molmol_plot.py molmol_plot.py] Script for generating Molmol macros for highlighting model-free motions* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/palmer.py palmer.py] Script for model-free analysis using Art Palmer's program 'Modelfree4'. Download from http://comdnmr.nysbc.org/comd-nmr-dissem/comd-nmr-software* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/remap.py remap.py] Script for mapping the model-free space.* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/single_model.py single_model.py] This script performs a model-free analysis for the single model 'm4'.* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/table_csv.py table_csv.py] Script for converting the model-free results into a CSV table.* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/model_free/table_latex.py table_latex.py] Script for converting the model-free results into a LaTeX table.

=== 01 It can be seen here: https://github.com/nmr- Test load of data ===relax/relax/tree/master/sample_scripts

'''R1 / R2 Calculation'''* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/relax_fit.py relax_fit.py] Script for relaxation curve fitting.* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/relax_curve_diff.py relax_curve_diff.py] Script for creating a Grace plot of peak intensity differences.The resultant plot is useful for finding bad points or bad spectra when fitting exponential curves determine the R1 and R2 relaxation rates. If the averages deviate systematically from zero, bias in the spectra or fitting will be clearly revealed. To use this script, R1 or R2 exponential curve fitting must have previously have been carried out the program state saved to the file 'rx.save' (either with or without the .gz or .bz2 ). The file name of the saved state can be changed at the top of this script. '''NOE calculation'''* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/noe.py noe.py] Script for calculating NOEs. '''Test data'''* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/jw_mapping.py jw_mapping.py] Script for reduced spectral density mapping.* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/consistency_tests.py consistency_tests.py] Script for consistency testing. Severe artifacts can be introduced if model-free analysis is performed from inconsistent multiple magnetic field datasets. The use of simple tests as validation tools for the consistency assessment can help avoid such problems in order to extract more reliable information from spin relaxation experiments. In particular, these tests are useful for detecting inconsistencies arising from R2 data. Since such inconsistencies can yield artifactual Rex parameters within model-free analysis, these tests should be use routinely prior to any analysis such as model-free calculations.This script will allow one to calculate values for the three consistency tests J(0), F_eta and F_R2. Once this is done, qualitative analysis can be performed by comparing values obtained at different magnetic fields. Correlation plots and histograms are useful tools for such comparison, such as presented in Morin & Gagne (2009a) J. Biomol. NMR, 45: 361-372. '''Other representations'''* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/angles.py angles.py] Script for calculating the protein NH bond vector angles with respect to the diffusion tensor.* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/xh_vector_dist.py xh_vector_dist.py] Script for creating a PDB representation of the distribution of XH bond vectors.* [https://github.com/nmr-relax/relax/blob/master/sample_scripts/diff_tensor_pdb.py diff_tensor_pdb.py] Script for creating a PDB representation of the Brownian rotational diffusion tensor. =Scripts - Part 2 = We now try to setup things a little more efficient. Relax is able to read previous results file, so let us divide the task up into: * 1: Load the data and save as state file. Inspect in GUI before running.* 2: Run the Model 1: local_tm. * 3: Here make 4 scripts. Each of them only depends on Model 1:** Model 2: sphere** Model 3: prolate** Model 4: oblate** Model 5: ellipsoid* 4: Make an intermediate 'final' model script. This will automatically detect files from above.  == Prepare data ==We make a new folder and try. {| class="mw-collapsible mw-collapsed wikitable"! See commands|-|<source lang="bash">mkdir 20171010_model_free_2_HADDOCKcp 20171010_model_free/*.dat 20171010_model_free_2_HADDOCKcp 20171010_model_free/*.pdb 20171010_model_free_2_HADDOCK # Get scriptscd 20171010_model_free_2_HADDOCKgit initgit remote add origin git@github.com:tlinnet/relax_modelfree_scripts.gitgit fetchgit checkout -t origin/master</source>|} And a new one, changing the NOE error{| class="mw-collapsible mw-collapsed wikitable"! See commands|-|<source lang="bash">mkdir 20171010_model_free_3_HADDOCKcp 20171010_model_free/*.dat 20171010_model_free_3_HADDOCKcp 20171010_model_free/*.pdb 20171010_model_free_3_HADDOCK # Get scriptscd 20171010_model_free_3_HADDOCKgit initgit remote add origin git@github.com:tlinnet/relax_modelfree_scripts.gitgit fetchgit checkout -t origin/master # Change NOE errorsed -i 's/0.1*$/0.05/' NOE_600MHz_new.datsed -i 's/0.1*$/0.05/' NOE_750MHz.dat</source>|} And a new one, changing the NOE error, and deselecting N-terminal.<br>Consistency test, found that this stretch contained outliers.{| class="mw-collapsible mw-collapsed wikitable"! See commands|-|<source lang="bash">mkdir 20171010_model_free_4_HADDOCKcp 20171010_model_free/*.dat 20171010_model_free_4_HADDOCKcp 20171010_model_free/*.pdb 20171010_model_free_4_HADDOCK # Get scriptscd 20171010_model_free_4_HADDOCKgit initgit remote add origin git@github.com:tlinnet/relax_modelfree_scripts.gitgit fetchgit checkout -t origin/master # Change NOE errorsed -i 's/0.1*$/0.05/' NOE_600MHz_new.datsed -i 's/0.1*$/0.05/' NOE_750MHz.dat # Make deselectionecho "#" > deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t151" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t152" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t153" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t154" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t155" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t156" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t157" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t158" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t159" >> deselect.txt</source>|} And a new one, changing the NOE error, and deselecting spins found from consistency test.<br>{| class="mw-collapsible mw-collapsed wikitable"! See commands|-|<source lang="bash">mkdir 20171010_model_free_5_HADDOCKcp 20171010_model_free/*.dat 20171010_model_free_5_HADDOCKcp 20171010_model_free/*.pdb 20171010_model_free_5_HADDOCK # Get scriptscd 20171010_model_free_5_HADDOCKgit initgit remote add origin git@github.com:tlinnet/relax_modelfree_scripts.gitgit fetchgit checkout -t origin/master # Change NOE errorsed -i 's/0.1*$/0.05/' NOE_600MHz_new.datsed -i 's/0.1*$/0.05/' NOE_750MHz.dat # Make deselectionecho "#" > deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t158" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t157" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t17" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t159" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t120" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t59" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t98" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t49" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t76" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t155" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t156" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t48" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t154" >> deselect.txt</source>|} And a new one, without changing the NOE error, and deselecting spins found from consistency test.<br>{| class="mw-collapsible mw-collapsed wikitable"! See commands|-|<source lang="bash">mkdir 20171010_model_free_6_HADDOCKcp 20171010_model_free/*.dat 20171010_model_free_6_HADDOCKcp 20171010_model_free/*.pdb 20171010_model_free_6_HADDOCK # Get scriptscd 20171010_model_free_6_HADDOCKgit initgit remote add origin git@github.com:tlinnet/relax_modelfree_scripts.gitgit fetchgit checkout -t origin/master # Make deselectionecho "#" > deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t158" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t157" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t17" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t159" >> deselect.txt cat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t59" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t98" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t76" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t155" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t156" >> deselect.txt cat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t120" >> deselect.txt cat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t49" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t48" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t154" >> deselect.txt cat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t33" >> deselect.txtcat R1_600MHz_new_model_free.dat | grep -P "ArcCALD\t67" >> deselect.txt</source>|} == 11_read_data_GUI_inspect.py - Read data GUI inspect ==This will read the data and save as a state. The GUI can be a good place to inspect the setup and files. See content of:[https://github.com/tlinnet/relax_modelfree_scripts/blob/master/11_read_data_GUI_inspect.py 11_read_data_GUI_inspect.py] Run with<source lang="bash">relax 11_read_data_GUI_inspect.py -t 11_read_data_GUI_inspect.log</source> To check in GUI* relax -g* File -> Open relax state* In folder "result_10" open "result_10_ini.bz2"* View -> Data pipe editor* Right click on pipe, and select "Associate with a new auto-analysis" === relax 11_test_consistency.py - Consistency test of our data ===Before running the analysis, it is wise to run a script for [[Tutorial_for_model_free_SBiNLab#Other_script_inspiration_for_checking|consistency testing]]. See here:* Morin & Gagne (2009a) [http://dx.doi.org/10.1007/s10858-009-9381-4 Simple tests for the validation of multiple field spin relaxation data. J. Biomol. NMR, 45: 361-372.] Highlights:* Comparing results obtained at different magnetic fields should, in the case of perfect consistency and assuming the absence of conformational exchange, yield equal values independently of the magnetic field.* avoid the potential extraction of erroneous information as well as the waste of time associated to dissecting inconsistent datasets using numerous long model-free minimisations with different subsets of data.* The authors prefer the use of the spectral density at zero frequency J(0) alone since it '''does not rely''' on an estimation of the global correlation time '''tc/tm''', neither on a measure of theta, the angle between the 15N–1H vector and the principal axis of the 15N chemical shift tensor. Hence, J(0) is less likely to be affected by incorrect parameterisation of input parameters. See content of:[https://github.com/tlinnet/relax_modelfree_scripts/blob/master/11_test_consistency.py 11_test_consistency.py]<source lang="bash">relax 11_test_consistency.py -t 11_test_consistency.py.log #Afterwards, go into the folder at plot data.python plot_txt_files.py./grace2images.py </source> == 12_Model_1_I_local_tm.py - Only run local_tm ==Now we only run '''Model 1'''. * DIFF_MODEL = ['local_tm']* GRID_INC = 11 # This is the standard* MC_NUM = 0 # This has no influence in Model 1-5* MAX_ITER = 20 # Stop if it has not converged in 20 rounds Normally between 8 to 15 multiple rounds of optimisation of the are required for the proper execution of this script.<br>This is can also be see here in Figure 2.* d'Auvergne, E. J. and Gooley, P. R. (2008). [http://dx.doi.org/10.1007/s10858-007-9213-3 Optimisation of NMR dynamic models II. A new methodology for the dual optimisation of the model-free parameters and the Brownian rotational diffusion tensor. J. Biomol. NMR, 40(2), 121-133.] Relax should stop calculation, if a model does not converge. See content of:[https://github.com/tlinnet/relax_modelfree_scripts/blob/master/12_Model_1_I_local_tm.py 12_Model_1_I_local_tm.py] We use [http://www.dayid.org/comp/tm.html tmux] to make a terminal-session, we can get back to,if our own terminal connection get closed. Run with<source lang="bash"># Make terminal-sessiontmux new -s m1 relax 12_Model_1_I_local_tm.py -t 12_Model_1_I_local_tm.log # ortmux new -s m1mpirun -np 22 relax --multi='mpi4py' 12_Model_1_I_local_tm.py -t 12_Model_1_I_local_tm.log</source> You can then in another terminal follow the logfile by<source lang="bash">less +F 12_Model_I_local_tm.log</source> * To scroll up and down, use keyboard: '''Ctrl+c'''* To return to follow mode, use keyboard: '''Shift+f'''* To exit, use keyboard: '''Ctrl+c''' and then: '''q''' == 13_Model_2-5 - Run Model 2 to 5 ==When Model 1 is completed, then make 4 terminal windows and run them at the same time. These scripts do:* Read the state file from before with setup* Change DIFF_MODEL accordingly [https://github.com/tlinnet/relax_modelfree_scripts/blob/master/13_Model_2_II_sphere.py 13_Model_2_II_sphere.py]<source lang="bash">tmux new -s m2relax 13_Model_2_II_sphere.py -t 13_Model_2_II_sphere.log# Ormpirun -np 5 relax --multi='mpi4py' 13_Model_2_II_sphere.py -t 13_Model_2_II_sphere.log # When relax is running, push: Ctrl+b and then d, to disconnect without exit</source> [https://github.com/tlinnet/relax_modelfree_scripts/blob/master/13_Model_3_III_prolate.py 13_Model_3_III_prolate.py]<source lang="bash">tmux new -s m3relax 13_Model_3_III_prolate.py -t 13_Model_3_III_prolate.log# Ormpirun -np 5 relax --multi='mpi4py' 13_Model_3_III_prolate.py -t 13_Model_3_III_prolate.log</source> [https://github.com/tlinnet/relax_modelfree_scripts/blob/master/13_Model_4_IV_oblate.py 13_Model_4_IV_oblate.py]<source lang="bash">tmux new -s m4relax 13_Model_4_IV_oblate.py -t 13_Model_4_IV_oblate.log# Ormpirun -np 5 relax --multi='mpi4py' 13_Model_4_IV_oblate.py -t 13_Model_4_IV_oblate.log</source> [https://github.com/tlinnet/relax_modelfree_scripts/blob/master/13_Model_5_V_ellipsoid.py 13_Model_5_V_ellipsoid.py]<source lang="bash">tmux new -s m5relax 13_Model_5_V_ellipsoid.py -t 13_Model_5_V_ellipsoid.log# Ormpirun -np 5 relax --multi='mpi4py' 13_Model_5_V_ellipsoid.py -t 13_Model_5_V_ellipsoid.log</source> To join session<source lang="bash"># Listtmux list-s # Join eithertmux a -t m1tmux a -t m2tmux a -t m3tmux a -t m4tmux a -t m5</source> == 14_intermediate_final.py - Inspection during model optimization ==During running of model 2-5, the current results can be inspected withthis nifty scripts. The script will ask for input of MC numbers. So just run it. [https://github.com/tlinnet/relax_modelfree_scripts/blob/master/14_intermediate_final.py 14_intermediate_final.py]<source lang="bash">tmux new -s finalrelax 14_intermediate_final.py -t 14_intermediate_final.log</source> This does:* Option: Collect current best result from Model 2-5, and make MC simulations, and finalize to get current results files ** [http://comdnmr.nysbc.org/comd-nmr-dissem/comd-nmr-software Make analysis script for palmer Modelfree4]** Get more spin information* Make a pymol file, that collects all of relax pymol command files into 1 pymol session* Option: Collect all chi2 and number of params k, for each iteration per model** Make a python plot file for plotting this results === Per iteration get: chi2, k, tm ===Afterwards, plot the data.<source lang="bash">python results_collected.py</source> === Pymol macro ===You also get a pymol folder. See here for info how the macro is applied* [http://www.nmr-relax.com/manual/molmol_macro_apply.html#SECTION081284600000000000000 Summary of parameter meaning and value to pymol visualization] Run with<source lang="bash">pymol 0_0_apply_all_pymol_commands.pml</source> = To run on Haddock =Have a look here, how to get standalone python [[Anaconda_linux_mac|Anaconda linux]].Also have a look here [[OpenMPI]]. <source lang="bash"># SSH inssh haddock # Test with shellmpirun -np 6 echo "hello world" # Test with pythonmpirun -np 6 python -m mpi4py helloworld # Test with relaxmpirun -np 6 relax --multi='mpi4py'# Look for: Processor fabric: MPI 2.2 running via mpi4py with 5 slave processors & 1 master. Using MPICH2 1.4.1.</source> Now we run '''04_run_default_with_tolerance_lim.py''' with more power!<br>We use [http://www.dayid.org/comp/tm.html tmux] to make a terminal-session, we can get back to,if our own terminal connection get closed. * start a new session: '''tmux'''* re-attach a detached session: '''tmux attach''' <source lang="bash"># Make terminal-sessiontmux # Start relaxmpirun -np 20 relax --multi='mpi4py' 04_run_default_with_tolerance_lim.py -t 04_run_default_with_tolerance_lim.log</source> = Useful commands to log file = While the analysis is running, these commands could be used to check the logfile for errors<source lang="bash">### Check convergence # For chi2cat 04_run_default_with_tolerance_lim.log | grep -A 10 "Chi-squared test:" # For other testscat 04_run_default_with_tolerance_lim.log | grep -A 10 "Identical "cat 04_run_default_with_tolerance_lim.log | grep -A 10 "Identical model-free models test:"cat 04_run_default_with_tolerance_lim.log | grep -A 10 "Identical diffusion tensor parameter test:"cat 04_run_default_with_tolerance_lim.log | grep -A 10 "Identical model-free parameter test:" # To look for not converged errors# For chi2cat 04_run_default_with_tolerance_lim.log | grep -B 7 "The chi-squared value has not converged." # For other testscat 04_run_default_with_tolerance_lim.log | grep -B 7 " have not converged."cat 04_run_default_with_tolerance_lim.log | grep -B 7 "The model-free models have not converged."cat 04_run_default_with_tolerance_lim.log | grep -B 7 "The diffusion parameters have not converged."cat 04_run_default_with_tolerance_lim.log | grep -B 7 "The model-free parameters have not converged."</source> You can then inspect the logfile by '''less''': [http://www.thegeekstuff.com/2010/02/unix-less-command-10-tips-for-effective-navigation 10-tips for less] <source lang="bash">less 04_run_default_with_tolerance_lim.log</source> '''To find pattern:''' We have to escape with '''\''' for special character like: ()[] etc.<source lang="bash"># Search forward/Value \(iter 14\)/The chi-squared value has not converged</source>'''n''' or '''N''' – for next match in forward / previous match in backward * To return to follow mode, use keyboard: '''Shift+f'''* To exit, use keyboard: '''Ctrl+c''' and then: '''q''' = rsync files === rsync files after completion to Sauron ==When a run is completed, then sync files to Sauron file server. Make a '''rsync_to_sbinlab.sh''' file with content{| class="mw-collapsible mw-collapsed wikitable"! See file content|-|<source lang="bash">#!/bin/bash read -p "Username on sauron :" -r RUSER=$REPLYSAURON=10.61.4.60PROJ=`basename "$PWD"` FROM=${PWD}TO=${RUSER}@${SAURON}:/data/sbinlab2/${RUSER}/Downloads # -a: "archive"- archive mode; equals -rlptgoD (no -H,-A,-X). syncs recursively and preserves symbolic links, special and device files, modification times, group, owner, and permissions.# We want to remove the -o and -g options:# -o, --owner preserve owner (super-user only)# -g, --group preserve group# -rlptD : Instead or# -a --no-o --no-g # -z: Compression over network# -P: It combines the flags --progress and --partial. The first of these gives you a progress bar for the transfers and the second allows you to resume interrupted transfers:# -h, Output numbers in a more human-readable format. # Always double-check your arguments before executing an rsync command.# -n  echo "I will now do a DRY RUN, which does not move files"read -p "Are you sure? y/n :" -n 1 -recho "" if [[ $REPLY =~ ^[Yy]$ ]]; then rsync -rlptDPzh -n ${FROM} ${TO} else echo "Not doing DRY RUN"fi echo "" echo "I will now do the sync of files"read -p "Are you sure? y/n :" -n 1 -recho "" if [[ $REPLY =~ ^[Yy]$ ]]; then rsync -rlptDPzh ${FROM} ${TO}else echo "Not doing anything"fi</source> Make it executable and run<source lang="bash">chmod +x rsync_to_sbinlab.sh #run./rsync_to_sbinlab2.sh</source>|} == rsync files from BIO to home mac ==To inspect from home mac. Make a '''rsync_from_bio_to_home.sh''' file with content{| class="mw-collapsible mw-collapsed wikitable"! See file content|-|<source lang="bash">#!/bin/bash read -p "Username on bio:" -r RUSER=$REPLYBIO=ssh-bio.science.ku.dk #PROJ=Desktop/kaare_relaxPROJ=Desktop/kaare_relax/20171010_model_free_HADDOCKPROJDIR=`basename "$PROJ"` FROM=${RUSER}@${BIO}:/home/${RUSER}/${PROJ} TO=${PWD}/${PROJDIR} # -a: "archive"- archive mode; equals -rlptgoD (no -H,-A,-X). syncs recursively and preserves symbolic links, special and device files, modification times, group, owner, and permissions.# We want to remove the -o and -g options:# -o, --owner preserve owner (super-user only)# -g, --group preserve group# -rlptD : Instead or# -a --no-o --no-g # -z: Compression over network# -P: It combines the flags --progress and --partial. The first of these gives you a progress bar for the transfers and the second allows you to resume interrupted transfers:# -h, Output numbers in a more human-readable format. # Always double-check your arguments before executing an rsync command.# -n echo "I will now do a DRY RUN, which does not move files"read -p "Are you sure? y/n :" -n 1 -recho "" if [[ $REPLY =~ ^[Yy]$ ]]; then rsync -rlptDPzh -n ${FROM} ${TO} else echo "Not doing DRY RUN"fi echo "" echo "I will now do the sync of files"read -p "Are you sure? y/n :" -n 1 -recho "" if [[ $REPLY =~ ^[Yy]$ ]]; then rsync -rlptDPzh ${FROM} ${TO}else echo "Not doing anything"fi</source> Make it executable and run<source lang="bash">chmod +x rsync_from_bio_to_home.sh #run./rsync_from_bio_to_home.sh</source>|} = About the protocol = '''Model I - 'local_tm''''<br>This will optimise the diffusion model whereby all spin of the molecule have a local tm value, i.e. there is no global diffusion tensor. This model needs to be optimised prior to optimising any of the other diffusion models. Each spin is fitted to the multiple model-free models separately, where the parameter tm is included in each model. '''Model II - 'sphere''''<br>This will optimise the isotropic diffusion model. Multiple steps are required, an initial optimisation of the diffusion tensor, followed by a repetitive optimisation until convergence of the diffusion tensor. In the relax script UI each of these steps requires this script to be rerun, unless the conv_loop flag is True. In the GUI (graphical user interface), the procedure is repeated automatically until convergence. For the initial optimisation, which will be placed in the directory './sphere/init/', the following steps are used:* The model-free models and parameter values for each spin are set to those of diffusion model MI.* The local tm parameter is removed from the models.* The model-free parameters are fixed and a global spherical diffusion tensor is minimised* For the repetitive optimisation, each minimisation is named from 'round_1' onwards. The initial 'round_1' optimisation will extract the diffusion tensor from the results file in './sphere/init/', and the results will be placed in the directory './sphere/round_1/'. Each successive round will take the diffusion tensor from the previous round. The following steps are used:** The global diffusion tensor is fixed and the multiple model-free models are fitted to each spin.** AIC model selection is used to select the models for each spin.** All model-free and diffusion parameters are allowed to vary and a global optimisation of all parameters is carried out. '''Model III - 'prolate''''<br>The methods used are identical to those of diffusion model MII, except that an axially symmetric diffusion tensor with Da >= 0 is used. The base directory containing all the results is './prolate/'. '''Model IV -'oblate''''<br>The methods used are identical to those of diffusion model MII, except that an axially symmetric diffusion tensor with Da <= 0 is used. The base directory containing all the results is './oblate/'. '''Model V - 'ellipsoid''''<br>The methods used are identical to those of diffusion model MII, except that a fully anisotropic diffusion tensor is used (also known as rhombic or asymmetric diffusion). The base directory is './ellipsoid/' ''''final''''<br>Once all the diffusion models have converged, the final run can be executed. This is done by setting the variable diff_model to 'final'. This consists of two steps, diffusion tensor model selection, and Monte Carlo simulations. Firstly AIC model selection is used to select between the diffusion tensor models. Monte Carlo simulations are then run solely on this selected diffusion model. Minimisation of the model is bypassed as it is assumed that the model is already fully optimised (if this is not the case the final run is not yet appropriate).The final black-box model-free results will be placed in the file 'final/results'. = See also =