Core Analysis Tools

The platform provides form-driven analysis pipelines for single-dataset statistics and machine learning, multi-omics integration, and pathway enrichment.

Single-Omics Analysis

The Analysis Configuration page runs correlation analysis, ordination, clustering, statistical tests, and machine-learning methods such as Random Forests against a selected dataset.

Analysis Tools
Analysis Configuration Interface

Multi-Omics Integration

Multi-Omics configurations enable users to fuse orthogonal datasets (e.g. transcriptomics with metabolomics) to discover shared latent factors with MOFA2 or to discriminate pre-defined sample classes across blocks with DIABLO. MOFA2 is a pure-Python unsupervised method; DIABLO is a supervised sparse method that requires R and the mixOmics package. See the Multifactor Analysis Guide for method choice, parameters and interpretation.

Multi-Omics Configuration
Multi-Omics Setup

Pathway Analysis

The Pathway Analysis tool maps a gene list onto biological databases (GO, KEGG, Reactome) with Over-Representation Analysis (ORA), or scores a ranked list against gene sets with GSEA.

Pathway Analysis
Pathway Investigation Panel

Method Catalogue

Every analysis method offered by the live server is listed below, grouped by category. Each entry names the data the method needs. The same registry drives the method selection page, so this list always matches what the server can actually run.

Data Preparation

MethodWhat it doesRequired input
Preprocessing Impute missing values, normalise features and handle outliers. Produces a derived dataset for downstream use.
POST fields: dataset_id, min_col_fraction, missing_strategy, normalization, outlier_handling, outlier_method, target_col
One dataset with numeric columns.
Feature Selection Rank and select the most informative features (importance, SelectKBest, RFE, SFS and more). Produces a derived dataset with the selected features plus the target.
POST fields: dataset_id, feature_selection_method, fs_estimator, fs_threshold, k, target_col
One dataset with a numeric target column.
Feature Engineering Create derived features — ratios, sums, products, means, log1p, polynomial interactions, longitudinal summaries, one-hot columns, or a wide→long reshape — saved as a new dataset for downstream analysis.
POST fields: dataset_id, fe_columns, fe_degree, fe_id_cols, fe_interaction_only, fe_name, fe_operation, fe_prefix
Numeric columns (plus a group column for one-hot).

Statistical Analysis

MethodWhat it doesRequired input
Correlation Analysis Compute a pairwise correlation matrix (Pearson, Spearman or Kendall) across all numeric features.
POST fields: dataset_id, correlation_method
One dataset with at least two numeric columns.
Univariate Screening Pre-modeling screening: per-feature Pearson, Spearman and ANOVA F statistics against a target with FDR correction. Produces a derived dataset of significant features.
POST fields: dataset_id, fdr_threshold, target_col
One dataset with a numeric target column.
t-Test Compare the mean of a numeric variable between two groups (independent or paired samples).
POST fields: dataset_id, alpha, group_col, paired, value_col
A numeric value column and a group column with exactly 2 groups.
One-way ANOVA Compare the mean of a numeric variable across two or more groups.
POST fields: dataset_id, alpha, group_col, value_col
A numeric value column and a group column with 2+ groups.
Chi-Square Test Test whether two categorical variables are independent using a contingency table of observed counts.
POST fields: dataset_id, alpha, column_a, column_b
Two categorical columns.
Mann-Whitney U Test Non-parametric comparison of a numeric variable between two groups (no normality assumption).
POST fields: dataset_id, alpha, group_col, value_col
A numeric value column and a group column with exactly 2 groups.
Kruskal-Wallis Test Non-parametric comparison of a numeric variable across two or more groups.
POST fields: dataset_id, alpha, group_col, value_col
A numeric value column and a group column with 2+ groups.
Repeated-Measures ANOVA Within-subject ANOVA over wide-format timepoint columns (e.g. JUN/JUL/AUG cover), with an optional between-subject factor. Saves the melted long table as a derived dataset.
POST fields: dataset_id, between_col, timepoint_cols
Two or more numeric timepoint columns, one row per subject.
Count GLM (Poisson / NB) Generalised linear model for count responses — Poisson or negative-binomial family with categorical predictors automatically dummy-coded.
POST fields: dataset_id, glm_family, nb_alpha, predictor_cols, value_col
A non-negative count column and one or more predictors.
Mixed-Effects Model (LMM) Linear mixed model with a random intercept per group — handles nested/repeated designs such as plots within pastures or ranches.
POST fields: dataset_id, fixed_col, group_col, value_col
A numeric response, a fixed effect, and a grouping column.
Clustering Group plots or samples into clusters (K-Means or hierarchical) on z-scored numeric features. Saves a derived dataset with a cluster column for downstream use (e.g. management zones).
POST fields: dataset_id, cluster_method, feature_cols, linkage, n_clusters
One dataset with at least one numeric column.
Ordination (PCA / PCoA / NMDS) Reduce a samples-by-features table to a 2-D ordination: PCA, principal coordinates analysis (PCoA) or non-metric multidimensional scaling (NMDS) with a choice of distance metric.
POST fields: dataset_id, color_col, distance_metric, feature_cols, n_components, ordination_method
One dataset with at least two numeric columns.

Community Ecology

MethodWhat it doesRequired input
Alpha Diversity Per-sample diversity indices (richness, Shannon, Simpson, Pielou evenness) over a community matrix; optional group summaries. Saves indices as a derived dataset.
POST fields: dataset_id, feature_cols, group_col
A samples-by-features community matrix.
Beta Diversity (PERMANOVA + ANOSIM) Pairwise distance matrix (Bray-Curtis, Jaccard, ...) with PERMANOVA and ANOSIM group-composition tests plus a distance heatmap.
POST fields: dataset_id, distance_metric, feature_cols, group_col, n_perm
Community matrix plus a categorical group column.
Mantel Test Correlates two distance matrices (e.g. community dissimilarity vs environmental distance) with a permutation p-value.
POST fields: dataset_id, distance_metric, env_cols, env_metric, feature_cols, n_perm
Two non-overlapping sets of numeric columns.
Indicator Species (IndVal) Dufrene-Legendre indicator values: which features are specific to and frequent within each group.
POST fields: dataset_id, feature_cols, group_col, n_perm
Community matrix plus a categorical group column.
Morans I (Spatial Autocorrelation) Tests whether a variable is spatially clustered using k-nearest-neighbour weights and a permutation p-value.
POST fields: dataset_id, k, lat_col, long_col, n_perm, value_col
Latitude, longitude and a numeric value column.

Machine Learning

MethodWhat it doesRequired input
Random Forest Multi-split Random Forest regression with feature importance, optional univariate screening, permutation tests and SHAP values.
POST fields: dataset_id, categorical_encoding, fdr_threshold, n_estimators, n_splits, permutation_repeats, random_state, run_permutation, run_shap, run_univariate, target_col, test_size
One dataset with a numeric target column.
Model Comparison Benchmark multiple regressors (linear, trees, boosting, SVR, neural net) under the same cross-validation splits.
POST fields: dataset_id, categorical_encoding, model_keys, n_splits, target_col, test_size
One dataset with a numeric target column.
Full Pipeline End-to-end run: preprocessing, feature engineering and selection, model training, evaluation and interpretation.
POST fields: dataset_id, categorical_encoding, fdr_threshold, feature_selection_method, k, missing_strategy, n_estimators, n_splits, normalization, outlier_handling, outlier_method, permutation_repeats, run_permutation, run_shap, target_col, test_size
One dataset with a numeric target column.

Multi-Omics Integration

MethodWhat it doesRequired input
PCA (Multi-Omics) Per-block principal component analysis with an integrated overview. Multiple omics blocks (wide table or separate files).
SNF optional dep: snfpy Similarity Network Fusion — integrates blocks into one sample-similarity network. Multiple omics blocks. Requires the snfpy package.
MOFA+ optional dep: mofapy2 Multi-Omics Factor Analysis — latent factors driving variation across views. Multiple omics blocks. Requires the mofapy2 package.
MOFA2 optional dep: mofapy2 Unsupervised factor discovery across multiple omics views (full pipeline). Multiple omics blocks. Requires the mofapy2 package.
DIABLO optional dep: rscript Supervised multi-block discrimination of outcome classes (mixOmics). Multiple omics blocks and a categorical outcome. Requires R + mixOmics.
CCA Canonical Correlation Analysis — maximally correlated components across blocks. Two or more omics blocks.
NMF Non-negative Matrix Factorisation — parts-based decomposition per block. Omics blocks with non-negative values.

Genomics & Pathway

MethodWhat it doesRequired input
GWAS Genome-wide association study: genotype encoding, QC, LD pruning, association testing and Manhattan plot. A genotype dataset (configured in the dataset editor).
Pathway Analysis Map features to pathways and run enrichment analysis (Reactome, KEGG, GO, GSEA). A dataset with mappable feature identifiers.

Minimum data sizes: most statistical tests need at least 3 observations per group; ordination needs at least 3 complete rows; repeated-measures needs 2+ timepoint columns; MOFA2/DIABLO need 2+ blocks with 6+ shared samples each; chi-square needs a 2×2 (or larger) joint contingency table with expected counts preferably above 5.


Parameter Reference Guide

Detailed technical specifications for the core configuration parameters available in the analysis modules.

Analysis Type

Defines the high-level methodology (e.g., Random Forest, Correlation, or GWAS Screening). Controls which downstream parameters are visible.

Number of Estimators

The number of decision trees in the ensemble model. Higher values lead to more stable models but require more memory.

Number of CV Splits

The $k$ partitions used for $k$-fold cross-validation. Typical academic baseline is 5 or 10.

Test Size

Proportion of the dataset used for validation (e.g., 0.2 represents 20% for testing).

Random State (Seed)

Integer seed value ensuring that stochastic operations (like dataset splitting) are identically reproducible across runs.

Categorical Feature Encoding

How non-numeric feature columns are converted before modeling: Exclude drops them, Integer maps each level to a number (1, 2, 3…), and One-hot expands each level into its own 0/1 column (e.g., RANCH_KINSELLA).

Correlation Method

Determines how to measure feature association: Pearson (linear), Spearman (rank), or Kendall (robust).

FDR Threshold (q-value)

The false discovery rate cutoff (Benjamini-Hochberg) for reporting significant biological findings.

Permutation Repeats

The number of shuffles performed to generate internal null distributions for feature importance significance testing.

SHAP Analysis Coverage

Enables calculation of Shapley values for model local interpretability, identifying variable contribution per sample.

Gene List Source

Input selection for enrichment. Utilizes high-ranking features from Random Forest or manually curated user lists.

Feature Subset Size (Top N)

The count of highest-ranking genes to include in ORA calculations.

Minimum Column Fraction

Fraction of numeric columns a row must be outlying in before IQR/Z-Score detection flags it. Higher values are more conservative on wide datasets.

Manual Gene List

Gene or feature identifiers typed or pasted directly — one symbol per line or comma-separated. Used when Gene List Source is "Manual Gene Input".

Biological Organism

Species context for gene ID mapping (e.g., Human vs specialized genomic backends).

GO Namespace

Specifies which Gene Ontology branch to query: Biological Process, Molecular Function, or Cellular Component.

Minimum Overlap Threshold

The minimum number of provided genes required within a pathway to trigger statistical testing.

Data & Target Selection

Dataset Selection

The primary data source for the analysis. All preprocessing, statistics, and modeling are executed against the records in this file. Datasets are uploaded via the Datasets page and can be filtered by project.

Target Column (Dependent Variable)

The outcome variable (Y) to predict or correlate against. For regression models this must be a continuous numeric column; leave blank to auto-detect the first numeric column.

Single-Omics Toggles

Normalize Data

Scales feature values before analysis so that variables measured on large ranges do not dominate distance- or variance-based models. Recommended when columns mix different units or magnitudes.

Pearson Correlation

Univariate screen measuring the linear association between each feature and the target. Fast and interpretable; assumes roughly normal distributions.

Spearman Correlation

Rank-based univariate screen for monotonic (not necessarily linear) relationships. More robust to outliers and skewed data than Pearson.

ANOVA F-test

Compares feature means across groups defined by a categorical target to flag variables that differ significantly between classes or conditions.

Pipeline Editor — Preprocessing

Missing Values

How empty cells are handled before modeling: keep them, or impute each column with its mean (default), median (robust to outliers), or mode (for categorical data).

Normalization

Rescales feature magnitudes: min-max maps each column to the 0–1 range; z-score standardises to zero mean and unit variance.

Outlier Detection

The algorithm used to flag anomalous samples: IQR (simple rule), IsolationForest, LOF, EllipticEnvelope, OneClassSVM, or DBSCAN.

Outlier Handling

What to do with detected outliers: remove the rows, keep them, winsorize extreme values to percentile bounds, or impute with the column median/mean.

Outlier Timing

When outlier handling is applied relative to the train/test split. Training only avoids leaking information from test samples into the decision.

Pipeline Editor — Feature Engineering

Log Transform

Applies log(x) to numeric features, compressing right-skewed distributions common in count and concentration data.

Sqrt Transform

Applies the square-root transform — a milder variance-stabilising correction than log, suited to moderately skewed count data.

Reciprocal Transform

Applies 1/x, strongly shrinking large values and spreading small ones. Useful for extremely right-skewed positive data.

Power Transform (Yeo-Johnson)

Estimates an optimal power transform per feature to approximate a normal distribution; unlike Box-Cox it supports zero and negative values.

Quantile Transform

Maps each feature to a uniform or normal distribution via its empirical quantiles. Robust to any input distribution but destroys relative distances between values.

Polynomial Features

Generates interaction and power terms between features up to the chosen degree, letting the model capture non-linear relationships (e.g., x1·x2, x12).

Polynomial Degree

The maximum power of generated polynomial terms. Higher degrees grow the feature count rapidly and risk overfitting.

Spline Transform

Expands features into piecewise polynomial basis functions so linear models can fit smooth non-linear trends such as dose-response curves.

KBins Discretize

Buckets continuous features into discrete intervals, converting numeric variables into categorical bins.

Pairwise Ratios

Creates ratio features between column pairs, exposing proportional or stoichiometric relationships that absolute values hide.

Pipeline Editor — Feature Selection & Model

Feature Selection Method

Strategy for reducing the feature set before modeling: variance threshold, correlation filter, recursive feature elimination (RFE), K-Best scoring, percentile, FDR, or model-based selection.

K Features

The number of top-ranked features retained by the selection method.

Scoring Function

The metric used to rank features during selection: R², F-regression, or mutual information.

Task Type

Regression predicts a continuous numeric outcome; classification predicts discrete categories. The choice determines which model list and metrics apply.

Model

The machine learning algorithm to train. Random Forest is a robust default for tabular omics data; linear models suit well-understood linear relationships. Optional models (XGBoost, LightGBM, CatBoost) appear only when installed.

Hyperparameter Tuning

Searches a parameter grid to find better model settings. Slower than a single fit but often improves predictive performance.

Tuning CV Folds

Number of cross-validation folds used inside the hyperparameter search loop. More folds give stabler estimates at higher compute cost.

Pipeline Editor — Advanced Options

Pre-Modeling Statistics

Runs Pearson, Spearman, and ANOVA screens before modeling to summarise each feature's relationship with the target.

Impurity Importance

Mean decrease in impurity computed inside tree-based models. Fast and built-in, but biased toward features with many distinct values.

Permutation Importance

Shuffles each feature and measures the resulting accuracy drop, giving a model-agnostic estimate of feature contribution.

Categorical Encoding

How non-numeric columns are converted before saving or modeling: keep as-is, map to integer codes, or expand into one-hot dummy columns.

GWAS Pipeline

Encoding Model

How genotypes are converted to numeric values: additive counts effect alleles (0/1/2); dominant and recessive collapse genotypes by inheritance model.

Min MAF

Minimum Minor Allele Frequency. SNPs rarer than this threshold are filtered out as statistically uninformative (default 0.05).

Max SNP Missingness

Maximum fraction of missing genotype calls allowed per SNP before it is dropped from the analysis.

Max Sample Missingness

Maximum fraction of missing genotypes allowed per sample before the sample is excluded.

HWE Threshold

Hardy-Weinberg Equilibrium p-value cutoff. SNPs below it deviate from expected genotype frequencies and may indicate genotyping error.

LD Pruning

Removes highly correlated SNPs in linkage disequilibrium to reduce redundancy and multicollinearity before association testing.

LD r² Threshold

Pairwise correlation cutoff used during LD pruning. SNP pairs above this r² are reduced to a single representative.

Association Method

The regression framework for SNP-trait testing: linear regression for quantitative traits, logistic regression for binary case/control outcomes.

Genomic Control

Applies an inflation-factor correction to p-values to account for population stratification and reduce spurious associations.

Multiple Testing Correction

Controls false positives across many SNP tests. Bonferroni is strict; Benjamini-Hochberg FDR balances discovery rate and error control.

Significance Threshold

The genome-wide p-value cutoff for calling a SNP-trait association significant after multiple-testing correction (conventional: 5×10−8).

Multi-Omics Integration

Join Column (Primary Key)

The shared variable used to align samples across different omics datasets. It must exist in all selected datasets with matching entry IDs.

Data Layout

How the omics blocks are organised: a single wide table splits columns by prefix; multiple files uses one file per block; transposed has samples in columns and features in rows.

Sample ID Column

The column identifying samples across blocks, used to align rows when joining multiple omics layers.

Block Rule

How columns are assigned to blocks in a single wide table: prefix splits on the first underscore (e.g. ENV_temp → ENV block); manual lets you assign columns explicitly.

Feature ID Column

In transposed layout, the column identifying features (rows). Never auto-detected — it must be specified explicitly.

Outcome Column

The categorical variable DIABLO discriminates. Required for DIABLO; classes with fewer than ~10 members trigger a warning.

Principal Components

Number of latent dimensions extracted during dimensionality reduction (PCA, CCA). More components capture more variance but may include noise.

Cluster Count

The expected number of biological or technical subgroups in the integrated data (e.g., for SNF or K-Means).

Latent Factors

For factor analytic models like MOFA2: the underlying biological drivers or technical variance components spanning multiple omics views.

DIABLO Components (ncomp)

Number of latent components for the multi-block PLS-DA model. More components capture more discriminative structure but risk overfitting.

DIABLO keepX

Number of features retained per block per component in the sparse PLS model. Use the same value for all blocks or specify per-block values.

DIABLO Design Matrix

Controls how blocks are linked: full links all blocks to each other; null treats blocks independently; custom allows pairwise weights.

DIABLO perf Folds

Number of cross-validation folds for the perf() error-rate estimation.

DIABLO perf Repeats

Number of times cross-validation is repeated for balanced error-rate (BER) stability.

DIABLO Random Seed

Integer seed for reproducible DIABLO results.

DIABLO Tuning

Opt-in tuning of keepX via tune.block.splsda. The estimated cost derives from grid_size × ncomp × nrepeat × folds.

MOFA2 Convergence Mode

Controls convergence criteria for the variational EM algorithm: fast stops early; slow runs more iterations for tighter convergence.

MOFA2 dropR2 Threshold

Minimum R-squared contribution for a factor to be retained. Factors explaining less variance than this threshold are pruned.

MOFA2 scale_views

Whether to scale each view to unit variance before fitting. Useful when views have very different magnitudes.

MOFA2 Random Seed

Integer seed for reproducible MOFA2 factor estimation.

Model Predictions

Trained Model File

A pickled scikit-learn compatible model (.pkl, .pickle, .joblib) exported from a previous result. Works for both classification and regression. Only upload models you trust.

Identifier Column

Optional column used to label each row in the prediction output so results can be traced back to individual samples.

Method Pages — Statistical Tests & Selection

Univariate Screening

Runs Pearson, Spearman and ANOVA F tests of every feature against the target with FDR correction. Standalone screening produces a derived dataset containing only the significant features plus the target, ready for downstream preprocessing or modeling.

Value Column

Numeric column whose distribution is compared across groups by t-test, ANOVA, Mann-Whitney or Kruskal-Wallis.

Group Column

Categorical column defining comparison groups. t-test and Mann-Whitney require exactly two distinct values; ANOVA and Kruskal-Wallis accept two or more.

First Categorical Column

First variable in the chi-square test of independence; its distinct values form the contingency-table rows.

Second Categorical Column

Second variable in the chi-square test of independence; its distinct values form the contingency-table columns.

Significance Level (alpha)

P-value threshold for calling a test result statistically significant. 0.05 is standard; 0.01 is stricter.

Paired Samples

Switch the t-test to paired mode for matched observations (e.g. the same subjects measured before and after treatment).

Candidate Models

Regression algorithms benchmarked under identical cross-validation splits in a Model Comparison run.

Selection Threshold

Threshold for filter-type feature selection: minimum variance (Variance), maximum inter-feature correlation (Correlation), or FDR alpha (FDR).

Selector Estimator

Model whose internal feature weights drive SelectFromModel selection: Random Forest importances or Lasso coefficients.

Ordination Method

PCA on standardised data, PCoA (classical MDS), or NMDS on a chosen distance matrix — reduces a samples-by-features table to a few axes.

Distance Metric

Pairwise distance used by PCoA and NMDS: euclidean, braycurtis, manhattan or cosine.

Number of Axes

How many ordination axes to compute; two is enough for the standard scatter plot.

Feature Columns

Comma-separated numeric columns to ordinate; blank uses every numeric column.

Colour Points By

Optional column that colours the ordination scatter points, typically a grouping factor.

Clustering Method

K-Means partitions into k compact clusters; hierarchical agglomerative clustering merges rows bottom-up with a linkage rule.

Number of Clusters (k)

How many groups to split rows into; a small interpretable number works best for management zones.

Linkage Rule

How inter-cluster distance is measured in hierarchical clustering; Ward is the usual default.

Fixed Effect

Predictor of primary interest in a mixed model; categorical columns become factors automatically.

Predictor Columns

Independent variables in a GLM; categorical predictors are dummy-coded automatically.

GLM Family

Poisson for counts where mean ≈ variance; Negative Binomial for overdispersed counts.

NB Dispersion (alpha)

Negative-binomial dispersion parameter; larger alpha means more overdispersion.

Timepoint Columns

Numeric columns holding repeated measurements in wide format — one per timepoint, one row per subject.

Permutations

Label-shuffling permutation count for permutation-based tests (PERMANOVA, ANOSIM, Mantel, IndVal). 999 is standard; larger values refine small p-values.

Environmental Columns

Numeric columns forming the second side of a Mantel test — measured environmental/trait variables whose pairwise distances are correlated with community distances.

Environmental Metric

Distance metric for the environmental side of a Mantel test (euclidean is the usual default).

Operation

Feature-engineering transform: arithmetic, log1p, polynomial interactions, longitudinal summaries, one-hot, or wide→long reshape.

Source Columns

Columns the operation reads; ratio and difference take exactly two.

New Column Name

Optional name for the created column; auto-generated when blank.

Polynomial Degree

Highest power/interaction degree generated.

Interactions Only

Emit only cross-products, skipping squared/power terms.

Output Prefix

Prefix for longitudinal summary columns (_mean/_delta/_slope/_min/_max).

ID Columns

Identifier columns preserved per row in a wide→long reshape.

Latitude Column

Latitude/northing coordinate per sample, used to build the spatial neighbour graph for Moran's I.

Longitude Column

Longitude/easting coordinate per sample.

Neighbours (k)

Nearest neighbours per point in the spatial weight matrix; 4–8 suits plot grids.

Between-Subject Factor

Optional grouping column tested on subject means alongside the within-subject time effect.

Known Limitations

GWAS figure exports are browser-side only

The Manhattan and QQ plot export buttons (PNG, SVG, HTML, CSV) render the file in your browser with JavaScript. There is no server-side GWAS export endpoint, so GWAS figures are not included in combined /reports output and cannot be downloaded by API clients.

Pathway lookups can be slow on first run

GO/KEGG/Reactome enrichment queries external databases. A first run against a cold cache can occasionally time out at the web-server layer; resubmitting the same analysis normally succeeds immediately.

Group-column suggestions are heuristic

Group/category dropdowns list non-numeric columns plus integer-valued numeric columns with few distinct values. Low-cardinality count data (for example sparse species counts) can still appear — verify the column is a real grouping before running a test.

Ordination colouring depends on the column type

The ordination Colour by option maps a categorical column to a discrete legend and a numeric column to a continuous colourbar. Columns that are neither clearly categorical nor numeric may fall back to uncoloured points.