Crew Launcher Plugins for Traditional High-Performance Computing Clusters

In computationally demanding analysis projects, statisticians and data scientists asynchronously deploy long-running tasks to distributed systems, ranging from traditional clusters to cloud services. The 'crew.cluster' package extends the 'mirai'-powered 'crew' package with worker launcher plugins for traditional high-performance computing systems. Inspiration also comes from packages 'mirai' by Gao (2023) < https://github.com/r-lib/mirai>, 'future' by Bengtsson (2021) , 'rrq' by FitzJohn and Ashton (2023) < https://github.com/mrc-ide/rrq>, 'clustermq' by Schubert (2019) ), and 'batchtools' by Lang, Bischl, and Surmann (2017). .


Reference manual

It appears you don't have a PDF plugin for this browser. You can click here to download the reference manual.

install.packages("crew.cluster")

0.4.0 by William Michael Landau, a year ago


https://wlandau.github.io/crew.cluster/, https://github.com/wlandau/crew.cluster


Report a bug at https://github.com/wlandau/crew.cluster/issues


Browse source code at https://github.com/cran/crew.cluster


Authors: William Michael Landau [aut, cre] (ORCID: , Michael Gilbert Levin [aut] (ORCID: , Brendan Furneaux [aut] , Eli Lilly and Company [cph, fnd]


Documentation:   PDF Manual  


MIT + file LICENSE license


Imports crew, lifecycle, nanonext, ps, R6, rlang, utils, vctrs, xml2, yaml

Suggests knitr, markdown, rmarkdown, testthat


See at CRAN