KestrelHPC

Documentation - Tutorial

Managing node images

• Create an image for the slave nodes :

  $ sudo kestrel-images --new image2

  Detecting host :
  [...]
  Creating image
  [...]
  Installing extra software
  [...]
  Executing install scripts
  [...]
  Executing configure scripts
  [...]
  

• List available images :

  $ sudo kestrel-images --list

  image1
  image2

• Install or uninstall software on the nodes :

  $ sudo kestrel-apt --install "vim" --remove "nano"

  Installs vim and removes nano from the default image.

• Chroot into the image, for example for setting the root's password :

  $ sudo kestrel-images --chroot image1

  # passwd

  Enter new UNIX password: 
  Retype new UNIX password: 
  passwd: password updated successfully

Manage kestrel users

• Add a user to the cluster :

  $ sudo kestrel-users --add-to-cluster jonan

  Adding user `jonan' to group `kestrel' ...
  Adding user jonan to group kestrel
  Done.

• Delete user from the cluster :

  $ sudo kestrel-users --delete jonan

  Removing user `jonan' from group `kestrel' ...
  Done.

  Note: It does not delete the user, it only removes it from the kestrel group.

Manage slave nodes

• Register some nodes :
  1. Turn on the slave nodes that we want to add to this group.
  2. Press control+c to finish

  $ sudo kestrel-control --register group1

  Turn now on the nodes to add them to the group "image1"
  
  Press crtl+c when you are done
  
  The node "kestrel-group1-1" was already registered
  
  	mac : 08:00:27:08:f3:b6
  	ip  : 192.168.30.226
  
  The node "kestrel-group1-2" was already registered
  
  	mac : 1b:52:27:b6:5c:f3
  	ip  : 192.168.30.227
  
  ^C

• List registered nodes :

  $ kestrel-control --registered

  kestrel-grupo1-1, mac:08:00:27:08:f3:b6, ip:192.168.30.226
  kestrel-grupo1-2, mac:1b:52:27:b6:5c:f3, ip:192.168.30.227

• Remove a group of nodes

  $ sudo kestrel-control --remove-group group1

  kestrel-group1-1, mac:08:00:27:08:f3:b6 removed
  kestrel-group1-2, mac:08:00:27:6f:5a:70 removed

Wake and shutdown nodes

• Wake a node by its hostname :

  $ sudo kestrel-control --wake-node "kestrel-group1-1"

  Starting up "kestrel-group1-1", mac:"08:00:27:08:f3:b6"

  Note: The Wake On Lan signal only works on a common PC if :

  • Wake On Lan support is enabled on the node's BIOS.
  • The node was shutdown correctly.
  • The node was shutdown with the network card's Wake On Lan support enabled. If you use the node with other OSes you will need to enable the WOL support on them.
• Wake a group of nodes :

  $ sudo kestrel-control --wake-group "group1"

  Starting up "kestrel-group1-1", mac:"08:00:27:08:f3:b6"
  Starting up "kestrel-group1-2", mac:"08:00:3b:a3:3d:4b"
  Starting up "kestrel-group1-2", mac:"08:00:a5:8c:fa:c3"

• Log into a node :

  $ kestrel-control --ssh "kestrel-group1-1"

  jonan@kestrel-group1-1:~$ 

  Note: if you get the message "Agent admitted failure to sign using the key.", run $ ssh-add
• Halt a node by its hostname :

  $ sudo kestrel-control --halt-node "kestrel-group1-1"

  Halting the "kestrel-group1-1", ip:192.168.30.226

• List connected nodes :

  $ kestrel-control --connected "group1"

  kestrel-grupo1-2, mac:1b:52:27:b6:5c:f3, ip:192.168.30.227

• List disconnected nodes :

  $ kestrel-control --disconnected "group1"

  kestrel-grupo1-1, mac:08:00:27:08:f3:b6, ip:192.168.30.226

• Halt a group of nodes :

  $ kestrel-control --halt-group "group1"

  Halting the "kestrel-group1-2", ip:192.168.30.227

MPI

• Launch a MPI job :

  $ mpirun mpiapp

  Note: If you get :

  • "Permission denied, please try again". Check if you have added the user to the cluster with $ kestrel-users --add-to-cluster myuser
  • "Agent admitted failure to sign using the key.", run $ ssh-add.