All public logs
Jump to navigation
Jump to search
Combined display of all available logs of techdocs. You can narrow down the view by selecting a log type, the username (case-sensitive), or the affected page (also case-sensitive).
- 16:14, 27 Haziran 2022 Plinich talk contribs created page Template:Cfengine intro (Created page with "[https://docs.cfengine.com/docs/3.15/guide-introduction.html CFEngine Introduction and System Overview]")
- 16:08, 27 Haziran 2022 Plinich talk contribs created page Local storage (Created page with "See also local storage. Local storage is the term for disk storage on a New World host that is available for private use to users of that particular host. The storage is persistent but is not backed up. For the specific, cfengine-managed additional storage mounted at <code>/localstorage</code> on some New World hosts see: # The host class <code>localstorage</code> in hostlist.csv, and # The file <code>[[/var/lib/cfengine3/masterfiles]...")
- 15:23, 27 Haziran 2022 Plinich talk contribs created page Automounter (Created page with "* Automounter operation")
- 15:22, 27 Haziran 2022 Plinich talk contribs moved page Automounter to Automounter operation without leaving a redirect
- 15:22, 27 Haziran 2022 Plinich talk contribs created page Automounter (Created page with "cfengine configuration locations: <code>/usr/local/warehouse/autofsconf.*</code> <code>/usr/local/warehouse/automounter.*</code> <code>/var/lib/cfengine3/masterfiles/automounter.inc</code> The automounter is <code>autofs</code>. See: $ '''man automounter''' $ '''man autofs.conf''' $ '''man auto.master''' At least these mount points are managed by the automounter: /import/<server>/<index> /home /web The server name is used by heuristics in the...")
- 14:54, 27 Haziran 2022 Plinich talk contribs created page Creating and editing teaching content (Created page with "# Look [https://www.mediawiki.org/wiki/Help:Formatting here] and [https://www.mediawiki.org/wiki/Help:Links here] for editing help. # Use descriptive page titles so they can be found by searches. For example, not "Exercise 1", but "COMP1541/BINF7890 - exercise 1 - creating your first bubblesort". # For pages which are specific to one or more courses prefix the page title with the applicable course numbers separated by slashes. This avoids confusion with similar pages cre...")
- 14:18, 27 Haziran 2022 Plinich talk contribs moved page New world versus Old World to New World versus Old World without leaving a redirect
- 14:17, 27 Haziran 2022 Plinich talk contribs created page New world versus Old World (Created page with "See also New World and Old World. We're talking here about a project to revisit and revitalise all aspects of the technology landscape provided and managed by CSG. Rather than ''lift-and-shift'' where existing applications and operational strategies are re-homed in a new hardware and operating system enviroment, this project looked at what CSG was doing to support CSE's teaching and research needs versus what was actually required. Thus it became a project...")
- 17:37, 24 Haziran 2022 Plinich talk contribs created page /usr/local/extrafiles (Created page with "<code>/usr/local/extrafiles</code> is a directory on the cfengine hub to which teaching staff have full access. The contents of this directory are synch'ed by <code>cf-agent</code> to the same-named directory on all user-loginable New World computers (i.e., lab computers, login servers and VLAB servers). Additionally, all user-loginable computers have the following two files installed in <code>/etc/profile.d</code>: # <code>extrafiles.sh</code> # <code>extr...")
- 17:24, 24 Haziran 2022 Plinich talk contribs created page New World (Created page with "In the current revamp-CSE's-IT-infrastructure project, the term New World refers to a new way of doing thigs as compared to the Old World. In particular: * Use of cfengine to manage a minimal amount of installed software and configuration files (mainly in <code>/etc</code>), * Use of Debian's <code>apt</code> family of tools to automatically manage installation and upgrading of software packages, * Naming of servers after geographical location and function (...")
- 17:15, 24 Haziran 2022 Plinich talk contribs created page Old World (Created page with "In the current revamp-CSE's-IT-infrastructure project, the term Old World refers to implementation of different bits of technology. In particular: * conform to manage all installed software and configurations on hosts, * Naming of servers after composers, labs after musical instruments or instrument types, and infrastructure support systems after musical accessories (such as baton, bandstand, etc.), and * VMWare to virtualise hosts. Compare to New World.")
- 15:56, 24 Haziran 2022 Plinich talk contribs created page SNMP query examples (Created page with "=== Querying the interface table === Two queries shown here. One “walks” the whole interface table (see the relevant RFC‘s), and the other “gets” two particular values — in this case they are the receive and transmit byte counts for “eth0”. Also see <code># cat /sys/class/net/eth0/ifindex</code>. root@nw-syd-monitor1:/usr/share/snmp/mibs# '''snmpwalk -v 1 -c csereader nw-syd-vx1 iso.3.6.1.2.1.2''' iso.3.6.1.2.1.2.1.0 = INTEGER: 2 iso.3.6.1.2.1.2.2.1...")
- 15:50, 24 Haziran 2022 Plinich talk contribs created page Resize the root/boot volume of an AWS host (Created page with "In this case nw-syd-vxdb (which involves an extra few steps to safeguard the <code>localstorage</code> volume)… == Running order == # Do a test on a created-for-the-occasion VM running the same OS # <span style="color:red;">Always</span> check that commanded operations complete via AWS console when doing shutdown, resize, snapshot, detach, attach, etc. # Create <code>/etc/nologin</code>. Test that root can still log in, and that users can't login via SSH or XDM/...")
- 15:47, 24 Haziran 2022 Andrewt talk contribs created page Run student code (Created page with "https://gitlab.cse.unsw.edu.au/ccs/extrafiles/-/blob/master/bin/run_student_code run_student_code allows code to be executed with limited resources and privileges. It is intended to be used for testing & marking of student code. The code is run as a subordinate uid/gid and will not have read/write access to files owned by the executing user unless they are publically readable/writeable. <pre> $ run_student_code id uid=65534(nobody) gid=60001(nobody) groups=60001(...")
- 15:39, 24 Haziran 2022 Plinich talk contribs created page Debian preseed example (old) (Created page with "<p style="color: red;">While informative, this is an old page (which you can see from its reference to Debian Buster).</p> # Require a web server accessible from the host-to-set-up # Require a copy of the Debian [Buster] install CD/DVD (on USB?) # Require a DHCP server configured to give the host-to-set-up its IP address/mask/gateway/DNS servers, etc. # Boot from install media # At install menu, press <ESC> # At prompt, enter: <code>auto url=http://192.168.100.1/b...")
- 15:30, 24 Haziran 2022 Plinich talk contribs created page Initial install and setup of cfengine on a New World host (Created page with "The full cfengine documentation is on the [https://cfengine.com/ cfengine web site]. === <span id="install-cfengine-for-aws-clients">Install cfengine for AWS clients</span> === After Debian has been installed on a host (e.g., Initial setup of a Debian AMI instance) perform the following steps on the host: * Install the cfengine3 package: # '''apt-get -y install cfengine3''' # '''cd /var/lib/cfengine3''' # '''mv inputs inputs.original''' # '''mv masterfiles...")
- 15:08, 24 Haziran 2022 Andrewt talk contribs created page Running software from other Debian releases (Created page with "CSE "new world" systems run Debian stable. Software from other Debian releases can be useful for other purposes - particularly more recent versions of software from Debian testing. The programs <code>unstable</code>, <code>testing</code>, <code>stable</code>, <code>oldstable</code>, <code>sid</code> <code>bookworm</code> <code>bullseye</code> <code>buster</code> in <code>/usr/local/extrafiles/bin/</code> run software from the corresponding Debian release. For example...")
- 16:56, 23 Haziran 2022 Plinich talk contribs created page Email (Created page with "There is no email capability in New World. * maillard * UDB * PostFix * mlalias - Mailing lists")
- 16:54, 23 Haziran 2022 Plinich talk contribs created page User database, authentication and authorisation (Created page with "* Old UDB * New UDB * bandleader * Kerberos * LDAP")
- 12:27, 23 Haziran 2022 Andrewt talk contribs created page Autotest (Created page with "autotest is custom software written by Andrew Taylor used in several CSE courses including COMP1511, COMP1521, COMP1911 & COMP2041. autotest has a [https://github.com/COMP1511UNSW/autotest github repo] It will be manually added to CSE systems as [https://gitlab.cse.unsw.edu.au/ccs/extrafiles/-/tree/master/lib/autotest/ /usr/local/extrafiles/lib/autotest] It is run via shim shell script which add class-specific information. autotest provides pre-submission and post-su...")
- 12:14, 23 Haziran 2022 Andrewt talk contribs created page Dcc (Created page with "dcc is used in several CSE courses including COMP1511, COMP1521 & COMP1911. dcc has a https://github.com/COMP1511UNSW/dcc github repo It is manually added to CSE systems as https://gitlab.cse.unsw.edu.au/ccs/extrafiles/-/blob/master/bin/dcc /usr/local/extrafiles/bin/dcc dcc compiles C programs with {{man|clang}} & {{man|gcc}} adding extra explanation to error messages suitable for novice programmers. dcc injects {{man|python3}} into the binary which catches...")
- 08:51, 23 Haziran 2022 Andrewt talk contribs created page Template:Man7 (Created page with "<noinclude> == Usage == A template to link to manual entries on a topic at [https://man7.org/ man7]. Usage: <nowiki>{{</nowiki>man|'''''topic'''''|'''''section'''''|'''''text to display'''''}} If parameters '''''text to display''''' is not specified it defaults to '''''topic''''' If parameters '''''section''''' is not specified it defaults to 1 For example: <nowiki>{{</nowiki>man|setbuf|3|setbuf, setbuffer and friends}} displays as: {{man|setbuf|3|setbuf, setbuffer a...")
- 07:42, 23 Haziran 2022 Plinich talk contribs created page MediaWiki (Created page with "== MediaWiki installation leftovers == <strong>MediaWiki has been installed.</strong> Consult the [https://www.mediawiki.org/wiki/Special:MyLanguage/Help:Contents User's Guide] for information on using the wiki software. == Getting started == * [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:Configuration_settings Configuration settings list] * [https://www.mediawiki.org/wiki/Special:MyLanguage/Manual:FAQ MediaWiki FAQ] * [https://lists.wikimedia.org/postori...")
- 07:27, 23 Haziran 2022 Plinich talk contribs created page Conform gives way to cfengine (Created page with "{{conform intro}} The New World grew out a HoS-supported project to move as much CSE infrastructure as possible out of CSE's K17 data centre and into "the cloud", specifically Amazon's AWS. Early on, a decision was made that <code>conform</code> would be left behind and that all new servers and hosts set up in AWS would be managed some other way. This other way ended up being -- after a review of configuration management tools -- a split between <code>...")
- 07:24, 23 Haziran 2022 Plinich talk contribs moved page Policies to Policies and principles without leaving a redirect
- 07:22, 23 Haziran 2022 Plinich talk contribs created page Software package management and Debian (Created page with "* Debian package management - installation, purging, auto update, CSG-managed lists, teaching-managed lists")
- 07:20, 23 Haziran 2022 Plinich talk contribs created page Configuration management and operation with cfengine (Created page with "* cfengine - stripped down compared to how it is distributed, m4 * hostlist.csv * host classes * update_hosts - host generators * cfengine hub * run-cf-agent * check_and_install_promises * /var/lib/cfengine3/masterfiles -> promises.cf * /usr/local/warehouse * /usr/local/administration * /usr/local/extrafiles * /usr/local/extrapackages - installations triggered by list changes")
- 07:16, 23 Haziran 2022 Plinich talk contribs created page User session and account management (Created page with "* systemd-logind user session management and clean up * Clean-up scripts on userlogin hosts")
- 07:14, 23 Haziran 2022 Plinich talk contribs created page Host and server installation and setup (Created page with "* Initial setup of a Debian AMI instance * Install and configure techdocs server * Installing a lab computer")
- 07:09, 23 Haziran 2022 Plinich talk contribs created page Networking (Created page with "* UNSW reserved network block for CSE AWS hosting * DHCP * CSE network diagram")
- 07:03, 23 Haziran 2022 Plinich talk contribs created page Virtualisation and cloud (Created page with "* QEMU/KVM * Virtual machines on lab computers * CSE and VMWare * CSE's datacentre == Amazon AWS == * AWS * VPN to AWS * AWS security groups and merge_ip_addresses_into_blocks")
- 07:03, 23 Haziran 2022 Plinich talk contribs created page Home and shared directories (Created page with "* AWS EFS home directories * Automounter * Home directories - file system types - NFS, AFS, CephFS * Local storage")
- 09:51, 22 Haziran 2022 Andrewt talk contribs created page Template:Man (Created page with "[http://en.wikipedia.org/wiki/{{{1|Main_Page}}} {{{2|{{{1|Wikipedia}}}}}}]")
- 20:56, 21 Haziran 2022 Andrewt talk contribs created page Controlling Resources & Privileges with Linux namespaces, cgroups & limits (Created page with "== resource limits == The Linux setrlimit system call is useful when running student code. The shell builtin ulimit in bash provide convenient access. Useful options include: <pre> -c the maximum size of core files created -d the maximum size of a process's data segment -f the maximum size of files written by the shell and its children -i the maximum number of pending signals -m the maximum resident set size -n the maximum number of open file descriptors -s the maximum...")
- 16:10, 21 Haziran 2022 Plinich talk contribs created page Cfplaypen (Created page with "cfplaypen.cseunsw.site is a small Debian server running in AWS. It has a stripped-down implementation and file layout of that set up on cfengine hub and can be used to experiment with cfengine and learn how to create and use promises files. * cfplaypen can only be logged in to as root via SSH key from CSE's server, trusted and untrusted subnetworks. * The raw promises files are in <code>/var/lib/cfengine3/masterfiles</code>. * After making a change run <code>c...")
- 09:41, 21 Haziran 2022 User account Andrewt talk contribs was created by Plinich talk contribs
- 09:40, 21 Haziran 2022 User account Meicheng talk contribs was created by Plinich talk contribs
- 09:35, 21 Haziran 2022 User account Jbc talk contribs was created by Plinich talk contribs
- 08:01, 21 Haziran 2022 Plinich talk contribs created page Style guide (Created page with "# On pages which are works-in-progress or are incomplete, add to the bottom of the page <nowiki>Category:Pages needing work</nowiki> so that editors who are bored can easily find the page and maybe work on it a bit. Also maybe add some notes at the top of the page to say what needs to be done.")
- 07:52, 21 Haziran 2022 Plinich talk contribs moved page Install techdocs server to Install and configure techdocs server without leaving a redirect
- 19:31, 20 Haziran 2022 Plinich talk contribs created page Guide to TechDocs for administrators and content creators (Created page with "* It's techdocs.cseunsw.tech * Access limited to UNSW subnetworks * All wiki pages are public * Authorised editors * SAMBA and file sharing * SSH access to the TechDocs server * Install techdocs server * Administration notes ** MediaWiki users and groups ** MediaWiki user authentication ** Local host logins and user accounts ** SAMBA *** User names and passwords *** Local host user accounts ** SSH keys and SSH access Category:Pages needing work")
- 16:01, 20 Haziran 2022 Plinich talk contribs created page File:Techdocs logo.png
- 16:01, 20 Haziran 2022 Plinich talk contribs uploaded File:Techdocs logo.png
- 14:01, 20 Haziran 2022 Plinich talk contribs created page Install techdocs server (Created page with "== Host OS installation == # Do minimal Debian Bullseye install # Disable IPv6 in /etc/default grub * Install updates and set hostname # Ensure unattended-upgrades package is installed # Allow root access via SSH key == Security == The firewall rules (i.e., AWS security group) allow: # Ping, SSH and HTTPs from 129.94.0.0/16 and 149.171.0.0/16 # HTTP from anywhere (to allow certbot to renew the Let's Encrypt SSL certificate # Everything else is blocked == Initial web...")
- 11:48, 20 Haziran 2022 Plinich talk contribs created page AWS EFS home directories (Created page with "== Basics == Hosts which can currently access AWS EFS: nw-syd-vx1, nw-syd-vx2, vx2, vx3, vx4, vx5, vx6, vx7, vx8, zappa, williams, wagner, weber, weaver. (11nov2021) * Amazon’s EFS service provides an unquotaed, unlimited, NFS-accessible file storage service. * Only NFS version 4 (4.1) is available. * When configured an EFS service appears as a host (IP address) on a subnetwork. * The EFS “host” only responds to connections on TCP port 2049. * There is no separat...")
- 11:21, 20 Haziran 2022 Plinich talk contribs created page Policies (Created page with "In all design and implementation choices: * Prefer obviousness over cleverness, even if longer or more complex, * Assume those who come after you aren't as expert as you, * If there's the remotest possibility that it may be misunderstood, add comments, * Bad grammar, bad spelling, bad punctuation and/or bad layout are better than no documentation. * Install the minimum software and configuration on a host or server to achieve desired functionality. This increases securi...")
- 11:18, 20 Haziran 2022 Plinich talk contribs created page UNSW reserved network block for CSE AWS hosting (Created page with "== Email from Andy Sun (Central IT) allocating address block for New World infrastructure == From: Andy Sun <andy.sun@unsw.edu.au> To: Peter Linich <p.linich@unsw.edu.au> CC: CASD Maileater <casd-maileater@unsw.edu.au>, <ss@cse.unsw.edu.au> Subject: Request 3143026 - Notify - Request for IPv4 address block (RFC 1918) Date: Mon, 1 Mar 2021 16:59:22 +1100 Hi Peter, I have deployed the new block as: VLAN418 is KENS - CSE Virtual Infrastructure (10.197.80.0/20...")
- 11:13, 20 Haziran 2022 Plinich talk contribs created page Lifecycle management of accounts (Created page with "[1:59 pm] Zain Rahmat FYI: While classifying accounts and home directories as part of the project to eventually move homes into the cloud, I was reminded that we have a large number of old accounts in the new/old UDB that are in transit (In fact I remember Philip Rodwell telling me this a while ago, and asking why they hadn't been removed). I have run an old script written a while ago to purge accounts in transit more than 8 years old (/home/ss/accounts/bin/transit purge...")
- 10:44, 20 Haziran 2022 Plinich talk contribs created page Installing a lab computer (Created page with "== What you do on the lab computer == Configuration of an out-of-the-box lab computer is done using an off-the-shelf Debian minimal/network install CD/DVD. This was <code>debian-10.10.0-amd64-netinst.iso</code> at time of writing. <ol> <li>Connect the lab computer/host to the network.</li> <li>Boot from the install media.</li> <li>At the installer selection menu, press the ESC key. If that doesn't give you a <code>boot:</code> prompt, go to step 5.</li> <li>At the <cod...")
- 10:40, 20 Haziran 2022 Plinich talk contribs created page Initial setup of a Debian AMI instance (Created page with "== Initial connection must be as user "admin" == # <code># ssh -l admin -A <IP address></code>. This step will [usually] require the SSH user has access to the AWS-known SSH keys (<code>*.pem</code>) allocated to the VM when it was created. E.g., <code>Amazon-CSE-key.pem</code> (Sydney) or <code>Amazon-CSE-SNG-key.pem</code> (Singapore). These keys are instantiated in the VM's <code>authorized_keys</code> file when it is created but may be overwritten with CSE's own key...")