AMFRegressor¶
Aggregated Mondrian Forest regressor for online learning.
This algorithm is truly online, in the sense that a single pass is performed, and that predictions can be produced anytime.
Each node in a tree predicts according to the average of the labels it contains. The prediction for a sample is computed as the aggregated predictions of all the subtrees along the path leading to the leaf node containing the sample. The aggregation weights are exponential weights with learning rate step
using a squared loss when use_aggregation
is True
.
This computation is performed exactly thanks to a context tree weighting algorithm. More details can be found in the original paper1.
The final predictions are the average of the predictions of each of the n_estimators
trees in the forest.
Parameters¶
-
n_estimators
Type → int
Default →
10
The number of trees in the forest.
-
step
Type → float
Default →
1.0
Step-size for the aggregation weights.
-
use_aggregation
Type → bool
Default →
True
Controls if aggregation is used in the trees. It is highly recommended to leave it as
True
. -
seed
Type → int
Default →
None
Random seed for reproducibility.
Attributes¶
- models
Examples¶
from river import datasets
from river import evaluate
from river import forest
from river import metrics
dataset = datasets.TrumpApproval()
model = forest.AMFRegressor(seed=42)
metric = metrics.MAE()
evaluate.progressive_val_score(dataset, model, metric)
MAE: 0.268533
Methods¶
learn_one
Fits to a set of features x
and a real-valued target y
.
Parameters
- x
- y
predict_one
Predict the output of features x
.
Parameters
- x
Returns
The prediction.
-
Mourtada, J., Gaïffas, S., & Scornet, E. (2021). AMF: Aggregated Mondrian forests for online learning. Journal of the Royal Statistical Society Series B: Statistical Methodology, 83(3), 505-533. ↩