systemPipeTools: Data Visualizations
Author: Daniela Cassol and Thomas Girke
Last update: 08 May, 2021
systemPipeTools.Rmd
Data Visualization with systemPipeR
systemPipeTools package extends the widely used systemPipeR (SPR) (H Backman and Girke 2016) workflow environment with enhanced toolkit for data visualization, including utilities to automate the analysis of differentially expressed genes (DEGs). systemPipeTools provides functions for data transformation and data exploration via scatterplots, hierarchical clustering heatMaps, principal component analysis, multidimensional scaling, generalized principal components, t-Distributed Stochastic Neighbor embedding (t-SNE), and MA and volcano plots. All these utilities can be integrated with the modular design of the systemPipeR environment that allows users to easily substitute any of these features and/or custom with alternatives.
Installation
systemPipeTools environment can be installed from the R console using the BiocManager::install command. The associated package systemPipeR can be installed the same way. The latter provides core functionalities for defining workflows, interacting with command-line software, and executing both R and/or command-line software, as well as generating publication-quality analysis reports.
if (!requireNamespace("BiocManager", quietly = TRUE)) install.packages("BiocManager")
BiocManager::install("systemPipeTools")
BiocManager::install("systemPipeR")Metadata and Reads Counting Information
The first step is importing the targets file and raw reads counting table. - The targets file defines all FASTQ files and sample comparisons of the analysis workflow. - The raw reads counting table represents all the reads that map to gene (row) for each sample (columns).
## Targets file
targetspath <- system.file("extdata", "targets.txt", package = "systemPipeR")
targets <- read.delim(targetspath, comment = "#")
cmp <- systemPipeR::readComp(file = targetspath, format = "matrix", delim = "-")
## Count table file
countMatrixPath <- system.file("extdata", "countDFeByg.xls", package = "systemPipeR")
countMatrix <- read.delim(countMatrixPath, row.names = 1)
showDT(countMatrix)Data Transformation
For gene differential expression, raw counts are required, however for data visualization or clustering, it can be useful to work with transformed count data. exploreDDS function is convenience wrapper to transform raw read counts using the DESeq2 package transformations methods. The input file has to contain all the genes, not just differentially expressed ones. Supported methods include variance stabilizing transformation (vst) (Anders and Huber (2010)), and regularized-logarithm transformation or rlog (Love, Huber, and Anders (2014)).
exploredds <- exploreDDS(countMatrix, targets, cmp = cmp[[1]], preFilter = NULL,
transformationMethod = "rlog")
exploredds## class: DESeqTransform
## dim: 116 18
## metadata(1): version
## assays(1): ''
## rownames(116): AT1G01010 AT1G01020 ... ATMG00180 ATMG00200
## rowData names(51): baseMean baseVar ... dispFit rlogIntercept
## colnames(18): M1A M1B ... V12A V12B
## colData names(2): condition sizeFactorUsers are strongly encouraged to consult the DESeq2 vignette for more detailed information on this topic and how to properly run DESeq2 on datasets with more complex experimental designs.
Scatterplot
To decide which transformation to choose, we can visualize the transformation effect comparing two samples or a grid of all samples, as follows:
exploreDDSplot(countMatrix, targets, cmp = cmp[[1]], preFilter = NULL, samples = c("M12A",
"M12A", "A12A", "A12A"), scattermatrix = TRUE)The scatterplots are created using the log2 transform normalized reads count, variance stabilizing transformation (VST) (Anders and Huber (2010)), and regularized-logarithm transformation or rlog (Love, Huber, and Anders (2014)).
Hierarchical Clustering Dendrogram
The following computes the sample-wise correlation coefficients using the stats::cor() function from the transformed expression values. After transformation to a distance matrix, hierarchical clustering is performed with the stats::hclust function and the result is plotted as a dendrogram, as follows:
hclustplot(exploredds, method = "spearman")
The function provides the utility to save the plot automatically.
Hierarchical Clustering HeatMap
This function performs hierarchical clustering on the transformed expression matrix generated within the DESeq2 package. It uses, by default, a Pearson correlation-based distance measure and complete linkage for cluster join. If samples selected in the clust argument, it will be applied the stats::dist() function to the transformed count matrix to get sample-to-sample distances. Also, it is possible to generate the pheatmap or plotly plot format.
## Samples plot
heatMaplot(exploredds, clust = "samples", plotly = FALSE)
If ind selected in the clust argument, it is necessary to provide the list of differentially expressed genes for the exploredds subset.
## Individuals genes identified in DEG analysis DEG analysis with `systemPipeR`
degseqDF <- systemPipeR::run_DESeq2(countDF = countMatrix, targets = targets, cmp = cmp[[1]],
independent = FALSE)
DEG_list <- systemPipeR::filterDEGs(degDF = degseqDF, filter = c(Fold = 2, FDR = 10))
### Plot
heatMaplot(exploredds, clust = "ind", DEGlist = unique(as.character(unlist(DEG_list[[1]]))))
The function provides the utility to save the plot automatically.
Principal Component Analysis
This function plots a Principal Component Analysis (PCA) from transformed expression matrix. This plot shows samples variation based on the expression values and identifies batch effects.
PCAplot(exploredds, plotly = FALSE)
The function provides the utility to save the plot automatically.
Multidimensional scaling with MDSplot
This function computes and plots multidimensional scaling analysis for dimension reduction of count expression matrix. Internally, it is applied the stats::dist() function to the transformed count matrix to get sample-to-sample distances.
MDSplot(exploredds, plotly = FALSE)
The function provides the utility to save the plot automatically.
Dimension Reduction with GLMplot
This function computes and plots generalized principal components analysis for dimension reduction of count expression matrix.
exploredds_r <- exploreDDS(countMatrix, targets, cmp = cmp[[1]], preFilter = NULL,
transformationMethod = "raw")
GLMplot(exploredds_r, plotly = FALSE)
The function provides the utility to save the plot automatically.
MA plot
This function plots log2 fold changes (y-axis) versus the mean of normalized counts (on the x-axis). Statistically significant features are colored.
The function provides the utility to save the plot automatically.
t-Distributed Stochastic Neighbor embedding with tSNEplot
This function computes and plots t-Distributed Stochastic Neighbor embedding (t-SNE) analysis for unsupervised nonlinear dimensionality reduction of count expression matrix. Internally, it is applied the Rtsne::Rtsne() (Krijthe 2015) function, using the exact t-SNE computing with theta=0.0.
tSNEplot(countMatrix, targets, perplexity = 5)
Volcano plot
A simple function that shows statistical significance (p-value) versus magnitude of change (log2 fold change).
volcanoplot(degseqDF, comparison = "M12-A12", filter = c(Fold = 1, FDR = 20), genes = "ATCG00280")
Version information
## R Under development (unstable) (2021-02-04 r79940)
## Platform: x86_64-pc-linux-gnu (64-bit)
## Running under: Ubuntu 20.04.2 LTS
##
## Matrix products: default
## BLAS: /usr/lib/x86_64-linux-gnu/blas/libblas.so.3.9.0
## LAPACK: /home/dcassol/src/R-devel/lib/libRlapack.so
##
## locale:
## [1] LC_CTYPE=en_US.UTF-8 LC_NUMERIC=C
## [3] LC_TIME=en_US.UTF-8 LC_COLLATE=en_US.UTF-8
## [5] LC_MONETARY=en_US.UTF-8 LC_MESSAGES=en_US.UTF-8
## [7] LC_PAPER=en_US.UTF-8 LC_NAME=C
## [9] LC_ADDRESS=C LC_TELEPHONE=C
## [11] LC_MEASUREMENT=en_US.UTF-8 LC_IDENTIFICATION=C
##
## attached base packages:
## [1] stats4 parallel stats graphics grDevices utils datasets
## [8] methods base
##
## other attached packages:
## [1] systemPipeR_1.25.14 ShortRead_1.49.2
## [3] GenomicAlignments_1.27.2 SummarizedExperiment_1.21.3
## [5] Biobase_2.51.0 MatrixGenerics_1.3.1
## [7] matrixStats_0.58.0 BiocParallel_1.25.5
## [9] Rsamtools_2.7.2 Biostrings_2.59.2
## [11] XVector_0.31.1 GenomicRanges_1.43.4
## [13] GenomeInfoDb_1.27.11 IRanges_2.25.11
## [15] S4Vectors_0.29.19 BiocGenerics_0.37.5
## [17] systemPipeTools_0.99.10 BiocStyle_2.19.2
##
## loaded via a namespace (and not attached):
## [1] backports_1.2.1 GOstats_2.57.0 BiocFileCache_1.99.8
## [4] systemfonts_1.0.1 plyr_1.8.6 lazyeval_0.2.2
## [7] GSEABase_1.53.1 splines_4.1.0 crosstalk_1.1.1
## [10] ggplot2_3.3.3 digest_0.6.27 htmltools_0.5.1.1
## [13] GO.db_3.13.0 fansi_0.4.2 checkmate_2.0.0
## [16] magrittr_2.0.1 memoise_2.0.0 BSgenome_1.59.4
## [19] base64url_1.4 limma_3.47.13 annotate_1.69.2
## [22] pkgdown_1.6.1 prettyunits_1.1.1 jpeg_0.1-8.1
## [25] colorspace_2.0-1 blob_1.2.1 rappdirs_0.3.3
## [28] ggrepel_0.9.1 textshaping_0.3.3 xfun_0.22
## [31] dplyr_1.0.6 crayon_1.4.1 RCurl_1.98-1.3
## [34] jsonlite_1.7.2 graph_1.69.0 genefilter_1.73.1
## [37] VariantAnnotation_1.37.1 brew_1.0-6 survival_3.2-11
## [40] ape_5.5 glue_1.4.2 gtable_0.3.0
## [43] zlibbioc_1.37.0 V8_3.4.2 DelayedArray_0.17.13
## [46] Rgraphviz_2.35.0 scales_1.1.1 pheatmap_1.0.12
## [49] DBI_1.1.1 GGally_2.1.1 edgeR_3.33.3
## [52] Rcpp_1.0.6 viridisLite_0.4.0 xtable_1.8-4
## [55] progress_1.2.2 tidytree_0.3.3 bit_4.0.4
## [58] rsvg_2.1.2 DT_0.18 AnnotationForge_1.33.4
## [61] htmlwidgets_1.5.3 httr_1.4.2 RColorBrewer_1.1-2
## [64] ellipsis_0.3.2 farver_2.1.0 pkgconfig_2.0.3
## [67] reshape_0.8.8 XML_3.99-0.6 sass_0.3.1
## [70] dbplyr_2.1.1 locfit_1.5-9.4 utf8_1.2.1
## [73] labeling_0.4.2 later_1.2.0 tidyselect_1.1.1
## [76] rlang_0.4.11 AnnotationDbi_1.53.1 munsell_0.5.0
## [79] tools_4.1.0 cachem_1.0.4 generics_0.1.0
## [82] RSQLite_2.2.7 evaluate_0.14 stringr_1.4.0
## [85] fastmap_1.1.0 yaml_2.2.1 ragg_1.1.2
## [88] ggtree_2.5.2 knitr_1.33 bit64_4.0.5
## [91] fs_1.5.0 purrr_0.3.4 KEGGREST_1.31.2
## [94] RBGL_1.67.0 nlme_3.1-152 mime_0.10
## [97] formatR_1.9 aplot_0.0.6 biomaRt_2.47.9
## [100] compiler_4.1.0 plotly_4.9.3 filelock_1.0.2
## [103] curl_4.3.1 png_0.1-7 treeio_1.15.7
## [106] tibble_3.1.1 geneplotter_1.69.0 bslib_0.2.4
## [109] stringi_1.5.3 highr_0.9 GenomicFeatures_1.43.8
## [112] desc_1.3.0 lattice_0.20-44 Matrix_1.3-3
## [115] glmpca_0.2.0 vctrs_0.3.8 pillar_1.6.0
## [118] lifecycle_1.0.0 BiocManager_1.30.13 jquerylib_0.1.4
## [121] data.table_1.14.0 bitops_1.0-7 httpuv_1.6.1
## [124] patchwork_1.1.1 rtracklayer_1.51.5 R6_2.5.0
## [127] BiocIO_1.1.2 latticeExtra_0.6-29 hwriter_1.3.2
## [130] promises_1.2.0.1 bookdown_0.22 codetools_0.2-18
## [133] MASS_7.3-54 assertthat_0.2.1 Category_2.57.2
## [136] DESeq2_1.31.21 rprojroot_2.0.2 rjson_0.2.20
## [139] withr_2.4.2 batchtools_0.9.15 GenomeInfoDbData_1.2.5
## [142] hms_1.0.0 grid_4.1.0 DOT_0.1
## [145] tidyr_1.1.3 rmarkdown_2.8 rvcheck_0.1.8
## [148] Rtsne_0.15 shiny_1.6.0 restfulr_0.0.13Funding
This project is funded by NSF award ABI-1661152.