Short Training Videos

The Center for High Performance Computing has created a number short videos to help you get started. New videos will be published on the YouTube channel to support different resolutions and closed captions; feel free to subscribe to receive updates when new videos are released.

Many of the videos parallel or introduce concepts that are discussed in-depth during various presentations or on the documentation.

This page serves as a central index for all training videos. When videos are updated or removed, changes will be noted here. Old videos will not be listed on the YouTube channel but will still be available on this page as "Other versions."

Index

• Computational Resources
  • Basics and Introduction
  • Environment and Jobs
  • Slurm (Job Scheduling)
• Storage and Files
• Guides for Services and Software
  • Presentations
  • Packages and Software Installation
  • Rclone

• Computational Resources

  • Basics and Introduction

    • Introduction to CHPC
      A brief introduction to the Center for High Performance Computing. This video introduces the various tools and services offered by CHPC. This includes an overview of training and documentation, information about tools for connecting to resources, a look at allocations, and introductions to other software.
      Relevant documentation: Documentation, Getting Started Guide, Allocations, Storage Services, Protected Environment, Slurm
    • Connecting to HPC resources
      An introduction to connecting to HPC resources on Windows and Linux. This video shows how to connect through SSH, including brief introductions to tools that enable this on Windows, and discusses graphical alternatives.
      Relevant documentation: Accessing CHPC Resources, Secure Shell (SSH)
    • Introduction to FastX
      A brief look at the FastX tool, which can be used as a graphical environment for Linux systems (as a desktop application or in a web browser), and the nodes that are recommended for graphical work.
      Relevant documentation: FastX2
      Other versions: 2015, 2017
    • Introduction to Linux
      This is a brief introduction to Linux and a number of command-line tools that are commonly used on CHPC resources. It's recommended for new users who have limited experience with the Linux command line interface.
    • Using remote desktop software to access Windows resources
      A remote desktop connection can be used to access Windows resources offered by CHPC. This video walks through connecting to Windows resources on Windows, macOS, and Linux.
      Relevant documentation: Remote Desktop (RDP)
      Other versions: 2016

  • Environment and Jobs

    • Introduction to managing your environment with modules
      Modules allow a user to manage his or her environment by compartmentalizing tools and allowing for dynamism in development and computation, making configuration fast and simple. This video introduces the concept, shows how to use modules, and briefly mentions the creation of custom modules.
      Relevant documentation: Modules at CHPC, Advanced Modules
      External resources: Lmod

  • Slurm (Job Scheduling)

    • Basics of Slurm
      Slurm is used to schedule jobs on computational resources and is what users must interact with to run programs on compute nodes.
      Relevant documentation: Slurm Scheduler
      External resources: SchedMD documentation
    • Submitting batch jobs with Slurm (introduction to batch scripts)
      An introduction to creating and submitting batch jobs (largely independent programs running on compute nodes) through Slurm.
      Relevant documentation: Slurm Scheduler
    • Using Slurm for interactive work
      An introduction to interacting with jobs running on compute nodes. This is typically done during testing or when software requires a graphical user interface or other user interaction.
      Relevant documentation: Slurm Scheduler

• Storage and Files

  • Mapping a network drive
    Files on CHPC resources can be accessed directly from another computer connected to the University of Utah network. This video walks through the process of mapping one's files on Windows, macOS, and Linux for small transfers. If connected to an external network, the University's VPN is required. UPDATED - Jan 2021: The video and documentation have been updated for the new samba service.
    Relevant documentation: Data Transfer Services, Virtual Private Network (VPN)
  • Tools for small data transfers
    Files can transferred to and from CHPC file systems with tools like scp, rsync, Cyberduck, and WinSCP. This video covers different software available on Windows, Linux, and macOS to facilitate transfers of (small amounts of) data. For large data sets, please consider using the Data Transfer Nodes and parallel transfer tools.
    Relevant documentation: Data Transfer Services

• Guides for Services and Software

  • Available Git resources
    An introduction to Git on Linux resources, using the GitLab Community Edition server for remote repositories, and installing and using Git on Windows and macOS.
    Relevant documentation: Git
    Other versions: 2016
  • Using the campus VPN
    The University of Utah's VPN service is required to connect to some resources in the Protected Environment (PE) and access file systems from an external network. This video shows how to install and use the VPN client on Windows, macOS, and Linux.
    Relevant documentation: Virtual Private Network (VPN), Protected Environment (PE)
  • Transition from JIRA to ServiceNow
    CHPC has recently changed from JIRA to ServiceNow for its helpdesk platform. This (very short) video details the changes that will affect users.
  • Persistent sessions with screen, tmux, and FastX
    An introduction to maintaining persistent sessions and an overview of the tools that are available for doing so.
    Relevant documentation: screen, tmux, FastX

  • Packages and Software Installation

    • Introduction to installing your own R packages
      This video walks through the steps needed to set up a copy of an R module and install packages through the high-level (from the R command line) installation process. It briefly mentions the low-level installation process and the steps required for installation.
      Relevant documentation: R (Installing additional R packages)
      Other versions: 2017
    • Installing your own Python packages (series; also available as a playlist)
      • Series overview
        This video introduces the process of installing your own Python packages (and different methods for doing so).
      • Using Miniconda
        Miniconda (or Anaconda) allows you to easily install and manage Python environments. It's the recommended method for maintaining sets of Python packages.
        Relevant documentation: User-installed Python
        External resources: Miniconda website
      • Using virtual environments
        This video walks through the steps necessary for a high-level package installation. It mentions virtual environments for both Python 2 and Python 3.
        Relevant documentation: Python Virtual Environment
      • Compiling your own Python
        Compiling Python directly (in your home or group directory, for instance) will give you complete control over the version of Python you're using and the packages you install. This is less maintainable than other methods but offers the most flexibility.
        External resources: Python releases

  • Rclone

    • Basic Rclone usage
      A remote-agnostic introduction to common Rclone commands and basic principles for data transfers and backups. This video mentions loading the module, viewing files and directories in different ways, copying and syncing data, and creating and removing directories and files.
      Relevant documentation: Rclone
      External resources: Rclone official documentation
    • Rclone and Google Drive
      Specific instructions for configuring Rclone to work with Google Drive, especially at the University of Utah, with mention of security policies. This video also mentions Drive File Sync, which can be used as an alternative on desktops.
      Relevant documentation: Rclone (Configuration)
      External resources: Rclone official documentation, University of Utah Google Cloud
      Other versions: 2017
    • Rclone and Box
      Specific instructions for configuring Rclone to work with Box, especially at the University of Utah, with mention of security policies.
      Relevant documentation: Rclone (Configuration)
      External resources: Rclone official documentation, Ubox
    • Rclone and pando
      Specific instructions for configuring Rclone to work with pando to access archive storage purchased from CHPC. This video also mentions the relevant documentation pages and current security policies.
      Relevant documentation: Rclone (Configuration), Storage Services (Archive Storage)
      External resources: Rclone official documentation, Ceph official documentation

If you have a suggestion for a future video or any questions please send us an email.