Skill Tracer
Skills › Scientific Agent Skills › aeon › regression.md

regression.md

118 lines · skills/aeon/references/regression.md at 5f2bc03

Open on GitHub
1# Time Series Regression
2
3Selected aeon 1.6 regressors predict one continuous target per series. This is distinct from forecasting future timepoints.
4

Time Series Regression

Selected aeon 1.6 regressors predict one continuous target per series. This is distinct from forecasting future timepoints.

Raw lines 1 to 4
5## Convolution-Based Regressors
6
7Apply convolutional kernels for feature extraction:
8
9- `HydraRegressor` - Multi-resolution dilated convolutions
10- `RocketRegressor` - Random convolutional kernels
11- `MiniRocketRegressor` - Simplified ROCKET for speed
12- `MultiRocketRegressor` - Convolutional features from raw and differenced series with multiple pooling operators
13- `MultiRocketHydraRegressor` - Merges ROCKET and Hydra approaches
15**Use when**: Need fast regression with strong baseline performance.

Convolution-Based Regressors

Apply convolutional kernels for feature extraction:

  • HydraRegressor - Multi-resolution dilated convolutions
  • RocketRegressor - Random convolutional kernels
  • MiniRocketRegressor - Simplified ROCKET for speed
  • MultiRocketRegressor - Convolutional features from raw and differenced series with multiple pooling operators
  • MultiRocketHydraRegressor - Merges ROCKET and Hydra approaches

Use when: Need fast regression with strong baseline performance.

Raw lines 5 to 16
17## Deep Learning Regressors
19Neural architectures for end-to-end temporal regression:
21- `FCNRegressor` - Fully convolutional network
22- `ResNetRegressor` - Residual blocks with skip connections
23- `InceptionTimeRegressor` - Multi-scale inception modules
24- `TimeCNNRegressor` - Standard CNN architecture
25- `RecurrentRegressor` - RNN/LSTM/GRU variants
26- `MLPRegressor` - Multi-layer perceptron
27- `EncoderRegressor` - Convolutional encoder architecture
28- `LITETimeRegressor` - Lightweight inception time ensemble
29- `DisjointCNNRegressor` - Specialized CNN architecture
31**Use when**: Large datasets, complex patterns, or need feature learning.

Deep Learning Regressors

Neural architectures for end-to-end temporal regression:

  • FCNRegressor - Fully convolutional network
  • ResNetRegressor - Residual blocks with skip connections
  • InceptionTimeRegressor - Multi-scale inception modules
  • TimeCNNRegressor - Standard CNN architecture
  • RecurrentRegressor - RNN/LSTM/GRU variants
  • MLPRegressor - Multi-layer perceptron
  • EncoderRegressor - Convolutional encoder architecture
  • LITETimeRegressor - Lightweight inception time ensemble
  • DisjointCNNRegressor - Specialized CNN architecture

Use when: Large datasets, complex patterns, or need feature learning.

Raw lines 17 to 32
33## Distance-Based Regressors
35k-nearest neighbors with temporal distance metrics:
37- `KNeighborsTimeSeriesRegressor` - k-NN with DTW, LCSS, ERP, or other distances
39**Use when**: Small datasets, local similarity patterns, or interpretable predictions.

Distance-Based Regressors

k-nearest neighbors with temporal distance metrics:

  • KNeighborsTimeSeriesRegressor - k-NN with DTW, LCSS, ERP, or other distances

Use when: Small datasets, local similarity patterns, or interpretable predictions.

Raw lines 33 to 40
41## Feature-Based Regressors
43Extract statistical features before regression:
45- `Catch22Regressor` - 22 canonical time-series characteristics
46- `FreshPRINCERegressor` - TSFresh features followed by rotation forest
47- `SummaryRegressor` - Summary statistics features
48- `TSFreshRegressor` - Automated tsfresh feature extraction
50**Use when**: Need interpretable features or domain-specific feature engineering.

Feature-Based Regressors

Extract statistical features before regression:

  • Catch22Regressor - 22 canonical time-series characteristics
  • FreshPRINCERegressor - TSFresh features followed by rotation forest
  • SummaryRegressor - Summary statistics features
  • TSFreshRegressor - Automated tsfresh feature extraction

Use when: Need interpretable features or domain-specific feature engineering.

Raw lines 41 to 51
52## Hybrid Regressors
54Combine multiple approaches:
56- `RISTRegressor` - Randomized Interval-Shapelet Transformation
58**Use when**: Benefit from combining interval and shapelet methods.

Hybrid Regressors

Combine multiple approaches:

  • RISTRegressor - Randomized Interval-Shapelet Transformation

Use when: Benefit from combining interval and shapelet methods.

Raw lines 52 to 59
60## Interval-Based Regressors
62Extract features from time intervals:
64- `CanonicalIntervalForestRegressor` - Random intervals with decision trees
65- `DrCIFRegressor` - Diverse Representation CIF
66- `TimeSeriesForestRegressor` - Random interval ensemble
67- `RandomIntervalRegressor` - Simple interval-based approach
68- `RandomIntervalSpectralEnsembleRegressor` - Spectral interval features
69- `QUANTRegressor` - Quantile-based interval features
71**Use when**: Predictive patterns occur in specific time windows.

Interval-Based Regressors

Extract features from time intervals:

  • CanonicalIntervalForestRegressor - Random intervals with decision trees
  • DrCIFRegressor - Diverse Representation CIF
  • TimeSeriesForestRegressor - Random interval ensemble
  • RandomIntervalRegressor - Simple interval-based approach
  • RandomIntervalSpectralEnsembleRegressor - Spectral interval features
  • QUANTRegressor - Quantile-based interval features

Use when: Predictive patterns occur in specific time windows.

Raw lines 60 to 72
73## Shapelet-Based Regressors
75Use discriminative subsequences for prediction:
77- `RDSTRegressor` - Random Dilated Shapelet Transform
79**Use when**: Need phase-invariant discriminative patterns.

Shapelet-Based Regressors

Use discriminative subsequences for prediction:

  • RDSTRegressor - Random Dilated Shapelet Transform

Use when: Need phase-invariant discriminative patterns.

Raw lines 73 to 80
81## Composition Tools
83Build custom regression pipelines:
85- `RegressorPipeline` - Chain transformers with regressors
86- `RegressorEnsemble` - Weighted ensemble with learnable weights
87- `SklearnRegressorWrapper` - Adapt sklearn regressors for time series

Composition Tools

Build custom regression pipelines:

  • RegressorPipeline - Chain transformers with regressors
  • RegressorEnsemble - Weighted ensemble with learnable weights
  • SklearnRegressorWrapper - Adapt sklearn regressors for time series
Raw lines 81 to 88
89## Utilities
91- `DummyRegressor` - Baseline strategies (mean, median)
92- `BaseRegressor` - Abstract base for custom regressors
93- `BaseDeepRegressor` - Base for deep learning regressors

Utilities

  • DummyRegressor - Baseline strategies (mean, median)
  • BaseRegressor - Abstract base for custom regressors
  • BaseDeepRegressor - Base for deep learning regressors
Raw lines 89 to 94
95## Quick Start
97```python
98from aeon.regression.convolution_based import RocketRegressor
99from aeon.datasets import load_regression
101# Load data
102X_train, y_train = load_regression("Covid3Month", split="train")
103X_test, y_test = load_regression("Covid3Month", split="test")
105# Train and predict
106reg = RocketRegressor()
107reg.fit(X_train, y_train)
108predictions = reg.predict(X_test)
109```

Quick Start

from aeon.regression.convolution_based import RocketRegressor
from aeon.datasets import load_regression

# Load data
X_train, y_train = load_regression("Covid3Month", split="train")
X_test, y_test = load_regression("Covid3Month", split="test")

# Train and predict
reg = RocketRegressor()
reg.fit(X_train, y_train)
predictions = reg.predict(X_test)
Raw lines 95 to 110
111## Algorithm Selection
113- **Speed priority**: MiniRocketRegressor
114- **Accuracy priority**: InceptionTimeRegressor, MultiRocketHydraRegressor
115- **Interpretability**: Catch22Regressor, SummaryRegressor
116- **Small data**: KNeighborsTimeSeriesRegressor
117- **Large data**: Deep learning regressors, ROCKET variants
118- **Interval patterns**: DrCIFRegressor, CanonicalIntervalForestRegressor

Algorithm Selection

  • Speed priority: MiniRocketRegressor
  • Accuracy priority: InceptionTimeRegressor, MultiRocketHydraRegressor
  • Interpretability: Catch22Regressor, SummaryRegressor
  • Small data: KNeighborsTimeSeriesRegressor
  • Large data: Deep learning regressors, ROCKET variants
  • Interval patterns: DrCIFRegressor, CanonicalIntervalForestRegressor
Raw lines 111 to 118