About Project
Overview
The systemPipe project provides a suite of R/Bioconductor packages for designing, building and running end-to-end analysis workflows on local machines and HPC systems, while generating at the same time publication quality analysis reports.
This site serves mainly as a landing page providing a high-level overview of each package and links to the corresponding pages on Bioconductor. Detailed usage instructions are provided in the vignetted of each package on Bioconductor.
Core Packages
-
systemPipeR: Workflow Management System (WMS)
systemPipeR is the core workflow management package, enabling users to define, organize, and run workflows that combine R functions with external command-line software(H Backman and Girke 2016). A scientific reporting system is integral part of the package. -
systemPipeRdata: Workflow Templates
systemPipeRdata offers a set of pre-configured workflow templates and associated resources that simplify the setup of common analysis pipelines. -
systemPipeShiny: Visualization Toolbox
systemPipeShiny provides a Shiny-based graphical interface for executing selected workflows and accessing a collection of interactive visualizations.
Workflow
Templates
The systemPipeRdata package provides preconfigured workflow templates that are compatible with the systemPipeR WMS. These templates include the necessary CWL parameter files for running a chosen workflow. Many of the templates come equipped with sample data. This setup serves several purposes: it simplifies the learning curve for using systemPipeR, allows for easy workflow testing, and provides a starting point for developing new workflows.
Contributions
For contributing workflows, we recommend the following fork and pull request approach.
- Create a “Template” Repository: Within your organization, create a public repository that serves as a template or a starting point for submissions. It should contain contribution guidelines (CONTRIBUTING.md), a code of conduct, license information, and potentially a project structure.
- Community Forks the Repository: Users interested in submitting a project will fork this “Template” repository to their personal GitHub account. This creates their own copy where they can work independently.
- User Development: The user develops their project within their personal fork.
- User Opens a Pull Request: When the user is ready to submit their project, they open a pull request from their personal repository back to the main “Template” repository in your organization. This pull request serves as the formal submission and review mechanism.
- Review Process: Organization members review the pull request, provide feedback, request changes, and ensure the submission meets community standards.
- Integration into the Organization:
- If the goal is to integrate their code into the template project, you merge the pull request.
- If the goal is for their entire repository to become a standalone repository within your organization, you would accept the submission via the pull request review process, and then work with the user offline to have them transfer ownership of their repository to the organization.