Proposed home directory architecture, configuration and management

From techdocs
Revision as of 13:20, 5 July 2023 by Plinich (talk | contribs) (Created page with "== Preamble == === The way it was === In the Old World the majority of the CSE home directories were stored on six main NFS servers, each server having local RAID disk storage for home directories. These servers had names such as ravel, kamen, etc., and home directories were located in ext3/ext4/xfs file systems created on the local block storage and mounted under <code>/export</code> (e.g., <code>/export/kamen/1</code>, <code>/export/ravel/2</code>, etc.). I.e. e...")
(diff) ← Older revision | Latest revision (diff) | Newer revision → (diff)
Jump to navigation Jump to search

Preamble

The way it was

In the Old World the majority of the CSE home directories were stored on six main NFS servers, each server having local RAID disk storage for home directories.

These servers had names such as ravel, kamen, etc., and home directories were located in ext3/ext4/xfs file systems created on the local block storage and mounted under /export (e.g., /export/kamen/1, /export/ravel/2, etc.). I.e. each physical server had its available disk storage divided into logical block devices of less than 1TB.

User home directory paths would be hard-coded to be on a particular file system on a particular server, e.g., /export/kamen/1/plinich.

This arrangement meant that a problem on a particular server could potentially affect 1/6th of all accounts until such time as the server itself was fixed, or until the affected home directories were restored from backup to another server and the users' home directory locations were update. This arrangement also meant that home directories were stored in one geographic location.

The way it might be

The proposed architecture disassociates home directories from specific physical/virtual NFS servers and places home directories in virtual hard disk volumes which are actually stored either in the Amazon AWS S3 cloud, or in CSE's distributed Ceph storage cluster.