I had a lot of fun at the recent ARM HPC User Group (A-HUG) Hackathon. We had access to a variety of machines and it was very cool to use the HPC stack, including schedulers like SLURM. One of the machines was AWS Parallel Cluster. A nice thing about AWS is that they have a lot of tutorials. I've literally found about 30 on the topic of HPC, including a ton of in-depth workshops.
There's also a Coursera course from the University of Colorado Boulder: https://www.coursera.org/learn/introduction-high-performance-computing?
I'm finishing up a master's in computer science and working in web dev. I'd like to learn HPC skills and knowledge so I'm probably going to keep looking for opportunities to use hardware and learn the basics. Hit me up if you'd like to work through an AWS workshop or the Coursera together. I had some success doing the same with someone on Reddit for graphics programming.