{"id":153,"date":"2022-03-31T21:00:55","date_gmt":"2022-03-31T21:00:55","guid":{"rendered":"https:\/\/www-devel.ssc.wisc.edu\/?p=153"},"modified":"2026-10-01T14:41:22","modified_gmt":"2026-10-01T14:41:22","slug":"sscc-news-april-2022","status":"publish","type":"post","link":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/2022\/03\/31\/sscc-news-april-2022\/","title":{"rendered":"SSCC News April 2022"},"content":{"rendered":"\n

Introducing Slurm<\/a><\/h2>\n\n\n\n

We are very excited to announce the launch of a pilot Slurm cluster at the SSCC. Slurm (Simple Linux Utility for Resource Management) is a powerful system for managing and scheduling computing jobs that is very popular at large-scale research computing centers. The SSCC is currently running a pilot with a small Slurm cluster as we all learn more about it, but we anticipate that it will become the main way SSCC researchers run large research computing jobs.<\/p>\n\n\n\n

The easy way to submit a job to Slurm is to log into Linstat and use the ssubmit<\/kbd> command. For example:<\/p>\n\n\n\n

ssubmit --cores=32 --mem=20g \"stata -b do my_do_file\"<\/kbd><\/p>\n\n\n\n

Slurm will then find a server in the Slurm cluster that has 32 cores and 20GB of memory available, and run your Stata do file there. It\u2019s possible your job might have to wait until those resources are free, but once it starts it is guaranteed exclusive use of them\u2014no more having your job slow down or run out of memory because the server is busy. If you\u2019re not sure how many cores and how much memory your job uses, Identifying the Computing Resources Used by a Linux Job<\/a> will show you how to find out.<\/p>\n\n\n\n

Right now the Slurm cluster consists of four servers with 44 cores and 384GB of memory each. If it gets busy (and we hope it will) we\u2019ll move servers from the Condor and Linstat clusters into Slurm. We plan to create a Slurm cluster within Silo as well.<\/p>\n\n\n\n

To learn more about the Slurm cluster and how to use it, read Using the SSCC Slurm Cluster<\/a>. We will also hold three short training sessions on Slurm over the next two weeks, two of them online. Visit our training page<\/a> for details and to register.<\/p>\n\n\n\n

Summer Training Schedule<\/a><\/h2>\n\n\n\n

The SSCC\u2019s Summer training schedule<\/a> is now available. This includes introduction and data wrangling workshops in Stata<\/a>, R<\/a>, and Python<\/a> and regression workshops in Stata<\/a> and R<\/a>. We especially want to highlight workshops on regression diagnostics in Stata<\/a> and R<\/a>. Researchers who need to run big computing jobs are encouraged to sign up for one of our workshops on running them at the SSCC<\/a>, which will cover both Linux basics and Slurm.<\/p>\n\n\n\n

We\u2019ve also scheduled introduction and data wrangling workshops in Stata<\/a>, R<\/a>, and Python<\/a> for the week of August 29th<\/sup>. All are welcome, but these workshops are especially for incoming graduate students. In our experience, the sooner most graduate students become competent at using statistical software the better (and no, what they learn as undergraduates is not usually sufficient for graduate work). If you are in contact with incoming graduate students, please make sure they are aware of these workshops.<\/strong><\/p>\n\n\n\n

Winstat Changes<\/a><\/h2>\n\n\n\n

With the permanent shift towards remote work, we realize that many of you rely on Winstat. The challenge is that when one person runs a big statistical job on Winstat it can slow down that Winstat server for everyone that\u2019s using it\u2014especially if the job runs the server out of memory. We\u2019ve done a variety of things to address this, including the load balancing that moves you to the least busy server if you log out and log back in, temporary steps during the pandemic like making lab computers available remotely as alternatives to Winstat, and many others behind the scenes. But we\u2019re planning two more, and the first especially should make a dramatic difference:<\/p>\n\n\n\n

First, we want to separate the big jobs from the day-to-day interactive work most of you do on Winstat. We plan to do this by having a large number of small Winstat servers and a small number of large Winstat servers. The large Winstat servers will be similar to the current servers and intended for medium-size jobs (truly big jobs should move to the Linux servers). The small Winstat servers will be designed for the kinds of work you\u2019d do on a laptop or desktop computer (if your computer had all the software Winstat does and fast access to the SSCC network drives). Since we\u2019ll have more of the small Winstats you\u2019ll be sharing a server with a smaller number of people\u2014none of whom should be running big statistical jobs. This will give more consistent performance.<\/p>\n\n\n\n

In the coming weeks we\u2019ll launch a public beta test of the smaller Winstat servers (one class is already using them). You\u2019ll see the new servers when you sign in to use Winstat, and we encourage you to try them out. Send any feedback to the Help Desk<\/a>. <\/p>\n\n\n\n

Second, we will begin to automatically check for and terminate jobs that are running the Winstat servers out of memory (and are in violation of our Server Usage Policy<\/a>). The process will also send an email to the job\u2019s owner. If you find your jobs are being killed, our Statistical Consultants<\/a> may be able to help you reduce their memory usage. They can also help you learn to run your jobs on the SSCC\u2019s Linux servers, which have much larger amounts of memory available.<\/p>\n\n\n\n

Annual SSCC Account Renewal Reminder<\/a><\/h2>\n\n\n\n

The SSCC suspended its annual account renewal process during the first two years of the COVID-19 pandemic so as not to cut anyone off from essential computing services, but as things return to normal, we need to return to annual account renewals as well.<\/p>\n\n\n\n

Lab users must renew their accounts by April 4th.\u00a0 To renew your account, lab users should receive an email with a customized link that you will use to renew your account.<\/p>\n\n\n\n

Full members must renew their accounts by May 31st.\u00a0 To renew your account, full members can follow the link to our\u00a0account renewal page<\/a>\u00a0and follow the instructions on the page.<\/p>\n\n\n\n

If you have graduated or otherwise left UW\u2013Madison, do not renew your account.<\/strong>\u00a0If you go to the form and answer \u201cNo\u201d to \u201cDo you want your account renewed?\u201d we won\u2019t send you any more reminders.<\/p>\n\n\n\n

If you have left UW\u2013Madison but are still collaborating on a project here, renew your account. However, your collaborator should speak with the administrative staff in the agency that sponsors your account about continuing to sponsor it. Note that these decisions are made by our member agencies, not SSCC staff.<\/p>\n","protected":false},"excerpt":{"rendered":"

Introducing Slurm We are very excited to announce the launch of a pilot Slurm cluster at the SSCC. Slurm (Simple Linux Utility for Resource Management) is a powerful system for managing and scheduling computing jobs that is very popular at large-scale research computing centers. The SSCC is currently running a pilot with a small Slurm …<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_uw_seo_meta_title":"","_uw_seo_meta_description":"","_uw_seo_twitter_card_type":"summary_large_image","_uw_seo_meta_image":"","_uw_seo_meta_image_url":"","_uw_seo_meta_image_sizes":[],"_uw_seo_custom_meta_tags":[],"uw_external_link":"","footnotes":""},"categories":[4],"tags":[],"class_list":["post-153","post","type-post","status-publish","format-standard","hentry","category-sscc-news"],"_links":{"self":[{"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/posts\/153","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/comments?post=153"}],"version-history":[{"count":1,"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/posts\/153\/revisions"}],"predecessor-version":[{"id":180,"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/posts\/153\/revisions\/180"}],"wp:attachment":[{"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/media?parent=153"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/categories?post=153"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/tags?post=153"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}