{"id":147,"date":"2023-07-31T14:47:34","date_gmt":"2023-07-31T14:47:34","guid":{"rendered":"https:\/\/www-devel.ssc.wisc.edu\/?p=147"},"modified":"2026-10-01T14:41:20","modified_gmt":"2026-10-01T14:41:20","slug":"sscc-news-for-august-2023","status":"publish","type":"post","link":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/2023\/07\/31\/sscc-news-for-august-2023\/","title":{"rendered":"SSCC News for August 2023"},"content":{"rendered":"\n<h2 class=\"wp-block-heading\">SSCC Training<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">The SSCC\u2019s <a href=\"https:\/\/sscc.wisc.edu\/sscc_jsp\/training\/\">fall training schedule<\/a> is now available. We\u2019d like to particularly draw the attention of new graduate students to the \u201cIntroduction to\u2026\u201d and \u201cData Wrangling in\u2026\u201d workshops in Stata, R, and Python, as these workshops are designed for you!<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">You should take an \u201cIntroduction to\u2026\u201d workshop if you:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Will be taking a quantitative methods class that uses statistical software you haven\u2019t used before<\/li>\n<li>Don\u2019t feel like you really understand the statistical software you use<\/li>\n<li>Plan to take an SSCC \u201cData Wrangling in\u2026\u201d workshop (unless you\u2019re very confident you don\u2019t need it)<\/li>\n<\/ul>\n\n\n\n\n<p class=\"wp-block-paragraph\">You should take a \u201cData Wrangling in\u2026\u201d workshop if you plan to do quantitative research and you have never taken a class that spent a significant amount of time on preparing real-world data for analysis. For example, you should be able to do the following quickly and easily using reproducible code:<\/p>\n\n\n\n<ul class=\"wp-block-list\">\n<li>Given a categorical \u201ceducation\u201d variable with a large number of very specific categories, combine them into a small number of broader categories<\/li>\n<li>Given a data set of individuals grouped into households, calculate the household incomes and create an indicator variable for \u201cthis household has children\u201d<\/li>\n<li>Given a data set of individuals and a data set of counties, combine them into a single data set containing both individual-level variables and county-level variables<\/li>\n<\/ul>\n\n\n\n\n<p class=\"wp-block-paragraph\">The SSCC\u2019s statistical consultants have many years of experience helping graduate students like you, so we know what you need to learn and what\u2019s most likely to be a challenge to you. Let us help you learn it!<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Summer Tech Update and Downtime<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">On\u00a0Saturday, August 12, from 9:00AM to 5:00PM, SSCC staff will take Winstat, Linstat, Silo, and Slurm offline for updates. SSCC disk space will also be unavailable (U:, V:, X:, Z:, \/project, etc.). Any running jobs will be terminated, though Slurm will restart some jobs automatically once the downtime is over.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">During this time all software will be updated to the latest version, including\u00a0<a href=\"https:\/\/sscc.wisc.edu\/sscc_jsp\/training\/details.jsp?class_id=2846\">Stata 18<\/a>.<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Slurm Tips<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">While it\u2019s unusual for jobs not to be able to run immediately on the Slurm cluster, when it does happen the bottleneck is almost always memory rather than cores. Keep in mind we have a large number of servers with 128 cores and 256GB of memory, and a much smaller number of servers with 128 cores and 512GB or 1024GB of memory. Only reserve more than 250Gb of memory if you\u2019re sure you need it\u2013jobs that reserve less than 250GB of memory essentially always start running immediately because they can run on any of the servers. It\u2019s good to give your job a safety margin, but we\u2019re seeing too many jobs reserving many times more memory than they need.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If you need to use a large fraction of a server\u2019s memory, and if your job can benefit from multiple cores at all, please use at least a similar fraction of the server\u2019s cores. As an example of what we hate to see, two jobs that reserve 500GB of memory and four cores each will fully occupy one of the high-memory servers but leave 120 cores sitting idle. Better for each job to use half the server\u2019s cores (64) since it\u2019s using half the memory, so when the server is full all the cores will be in use. Using more cores actually benefits others by making your job run faster and free up the memory it\u2019s using sooner.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">If your job cannot use multiple cores, consider whether the job itself can be broken up into many smaller jobs that the cluster can run in parallel. We\u2019ve created simple instructions for doing so in <a href=\"https:\/\/www.sscc.wisc.edu\/sscc\/pubs\/slurm\/stata_slurm_loops.html\">Stata<\/a>, <a href=\"https:\/\/www.sscc.wisc.edu\/sscc\/pubs\/slurm\/R_slurm_loops.html\">R<\/a>, and <a href=\"https:\/\/www.sscc.wisc.edu\/sscc\/pubs\/slurm\/python_slurm_loops.html\">Python<\/a>. The SSCC\u2019s <a href=\"https:\/\/www.sscc.wisc.edu\/statistics\/statistical-consulting\/\">statistical consultants<\/a> will be happy to help you figure out if your work is a candidate for parallelization.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">Don\u2019t forget the \u201cshort\u201d partition, especially on those occasions when the Slurm cluster is full. One high-memory server is reserved for short jobs, but jobs submitted to the short partition will also run on other servers if they\u2019re available. Thus there\u2019s no downside to using the short partition other than the maximum job length of six hours (as opposed to ten days in the default \u201csscc\u201d partition).<\/p>\n\n\n\n<h2 class=\"wp-block-heading\">Planning For the End of Windows 10<\/h2>\n\n\n\n<p class=\"wp-block-paragraph\">Microsoft has announced that it will stop supporting Windows 10 in October 2025. That means security problems will no longer be fixed after that time, which will make computers running Windows 10 a threat to any network they\u2019re on. In accordance with UW System policy, all computers running Windows 10, whether personal or University-owned, will be blocked from the SSCC network once support for Windows 10 ends. Windows users should upgrade to Windows 11 well before that point, though there\u2019s no particular need to do so now.<\/p>\n\n\n\n<p class=\"wp-block-paragraph\">In general, computers made prior to 2017 will not be able to run Windows 11. If you have a computer that is older than that, make plans to replace it sometime in the next two years\u2013at that point it will be at least eight years old and ready to be replaced anyway. Unfortunately, SSCC departments have about 300 computers that fall in that category. We will be reaching out to departments to provide a list and help you develop a plan, as we realize finding room in your budget to replace those computers may take the full two years.<\/p>\n","protected":false},"excerpt":{"rendered":"<p>SSCC Training The SSCC\u2019s fall training schedule is now available. We\u2019d like to particularly draw the attention of new graduate students to the \u201cIntroduction to\u2026\u201d and \u201cData Wrangling in\u2026\u201d workshops in Stata, R, and Python, as these workshops are designed for you! You should take an \u201cIntroduction to\u2026\u201d workshop if you: Will be taking a &hellip;<\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"","format":"standard","meta":{"_uw_seo_meta_title":"","_uw_seo_meta_description":"","_uw_seo_twitter_card_type":"summary_large_image","_uw_seo_meta_image":"","_uw_seo_meta_image_url":"","_uw_seo_meta_image_sizes":[],"_uw_seo_custom_meta_tags":[],"uw_external_link":"","footnotes":""},"categories":[4],"tags":[],"class_list":["post-147","post","type-post","status-publish","format-standard","hentry","category-sscc-news"],"_links":{"self":[{"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/posts\/147","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/comments?post=147"}],"version-history":[{"count":1,"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/posts\/147\/revisions"}],"predecessor-version":[{"id":174,"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/posts\/147\/revisions\/174"}],"wp:attachment":[{"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/media?parent=147"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/categories?post=147"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/www-devel.ssc.wisc.edu\/index.php\/wp-json\/wp\/v2\/tags?post=147"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}