Pre-confluence:Ceph testing and development cluster

Overview

• The *Ceph testing and development cluster* is a desktop Ceph cluster built using old lab HP Elitedesk mini PC's
• It is located in Peter's cubicle
• The cluster itself is on a private subnetwork behind one of the PC's (the top one in the stack) which functions as a gateway
• The gateway is cephtest.cse.unsw.edu.au (129.94.173.173) and can be reached by SSH from CSE's trust, untrust, and server subnetworks
• The cluster nodes should be added to /etc/hosts on cephtest. The cluster nodes should have no domain component in their names
• The gateway provides access by the cluster nodes to the world using NAT
• The cluster nodes connect to the gateway (cephtest) using a switch filched from the server room (ex: "smartswitch"). The switch has been reset to factory defaults and therefore does not operate in any sort of managed mode

Network settings

Description	Value
Configuration	Static
DHCP	None
Subnetwork	192.168.155.0/24
Gateway	192.168.155.1
DNS server(s)	129.94.172.11

Setting up a PC

• In the HP PC's BIOS reset the security to factory defaults

Installing Debian

• Use the USB boot key on top of the cluster
• Allocate 512M for EFI, 50G for root, and 1G for swap (which allows space on the SSD for a local OSD)
• Tell the installer to set up SSH server ONLY
• Install (and configure) unattended-upgrades, systemd-timesyncd, rsync, man-db, tcpdump lsof, strace
• Set UsePAM to NO in sshd_config
• Add "selinux=0 audit=0 ipv6.disable=1" to /etc/default/grub and run "grub-mkconfig -o /boot/grub/grub.cfg". Reboot
• Once the SSH keys have been set up, disable PasswordAuthentication in sshd_config and restart sshd
• Copy authorized_keys for the nodes from cephtest.

Installing Ceph

• Also see Storage and compute cluster
• The cluster has been bootstrapped with a single mon daemon running on node01