-
Notifications
You must be signed in to change notification settings - Fork 0
/
cluster-connection.qmd
98 lines (57 loc) · 3.87 KB
/
cluster-connection.qmd
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
---
title: "How to connect to servers?"
---
## How will we work?
In this workshop, we will use our computers, and we will connect to high performance computing (HPC) systems. Therefore, you will need to bring your laptops with you.
You should be comfortable using the Unix/Linux command line to take this course. In this page, you will find recommendations on how to connect to high performance computers depending on your laptop's operating system.
N.B. During this course, we will use the terms server, cluster and high performance computers interchangeably.
### Linux systems
If you have a Linux system (e.g. Ubuntu), you're all set! Most of the command line tools (like the necessary `ssh`) will be already installed on your system.
### Mac systems
Mac systems also have a default support on the command line. The `terminal` application on your Mac system is enough. But you can also install [iTerm2](https://iterm2.com/) as a `terminal` replacement for your Mac, if you'd like something fancier.
### Windows systems
If you have a Windows system, the easiest choice to connect to a remote server is [Mobaxterm](https://mobaxterm.mobatek.net).
## High performance computers
In this workshop, we have two different cluster systems at our disposal. The first system TRUBA (Turkish National Scientific Cluster) is funded by the TUBİTAK (The Scientific and Technological Research Council of Türkiye). The second system is located at Middle East Technical University.
### TRUBA Cluster system
This cluster system accepts connections from a Turkish university network only. Therefore, you should be in a university network in order to access TRUBA computers. We will provide a username and a password for your connection.
You can connect to TRUBA by writing this command in your terminal:
```bash
```
N.B. There is a trick to connect to the TRUBA system outside of the university network described at the end of this document.
### Middle East Technical University computing systems
This computer system is located at Middle East Technical University. It consists of two subclusters: `baggins` and `NEOGENE`.
Since the NEOGENE cluster does not accept connections from outside the university networks, we will first connect to `baggins` via `ssh`. Then we can connect to `NEOGENE` from within this system.
Your username and password will be provided on the first day of the workshop.
Connect to the `baggins` server with your `username` like this:
```bash
ssh -p 2275 [email protected]
```
Afterwards, you can connect to `NEOGENE` from withing `baggins` this way:
```bash
```
### Connecting to the TRUBA system from outside the university network
We can connect to the TRUBA system from outside the university network with a small trick. First, we connect to the `baggins` cluster as described above, so to be using the Middle East Technical University network. Then we can connect to TRUBA from within that terminal.
```bash
ssh -p 2275 [email protected]
# Enter your password when prompted
```
## Configuration
All the tools are installed on these server systems. Before using the tools, we need to set the `PATH` variable and show the system where these tools are installed, in case we want to run commands from the terminal. The `PATH` variable will already be set for you in the bash scripts in `TRUBA`.
### Configuration of the TRUBA system
To use all the tools for aMeta, please set your `PATH` variable like this:
```bash
export PATH=${PATH}:/truba/home/egitim/miniconda3/envs/aMeta/bin/
```
### Configuration on the Ankara computers
To use all the tools for aMeta, please set your `PATH` variable like this:
```bash
export PATH=${PATH}:/usr/local/sw/anaconda3/envs/aMeta/
```
The workshop folder on the Ankara computer will be here:
```
cd /mnt/NEOGENE4/projects/microbe_2023/
```