HoeffdingAdaptiveTreeClassifier¶
Hoeffding Adaptive Tree classifier.
Parameters¶

grace_period
Type โ int
Default โ
200
Number of instances a leaf should observe between split attempts.

max_depth
Type โ int  None
Default โ
None
The maximum depth a tree can reach. If
None
, the tree will grow indefinitely. 
split_criterion
Type โ str
Default โ
info_gain
Split criterion to use.
 'gini'  Gini
 'info_gain'  Information Gain
 'hellinger'  Helinger Distance 
delta
Type โ float
Default โ
1e07
Significance level to calculate the Hoeffding bound. The significance level is given by
1  delta
. Values closer to zero imply longer split decision delays. 
tau
Type โ float
Default โ
0.05
Threshold below which a split will be forced to break ties.

leaf_prediction
Type โ str
Default โ
nba
Prediction mechanism used at leafs.
 'mc'  Majority Class
 'nb'  Naive Bayes
 'nba'  Naive Bayes Adaptive 
nb_threshold
Type โ int
Default โ
0
Number of instances a leaf should observe before allowing Naive Bayes.

nominal_attributes
Type โ list  None
Default โ
None
List of Nominal attributes. If empty, then assume that all numeric attributes should be treated as continuous.

splitter
Type โ Splitter  None
Default โ
None
The Splitter or Attribute Observer (AO) used to monitor the class statistics of numeric features and perform splits. Splitters are available in the
tree.splitter
module. Different splitters are available for classification and regression tasks. Classification and regression splitters can be distinguished by their propertyis_target_class
. This is an advanced option. Special care must be taken when choosing different splitters. By default,tree.splitter.GaussianSplitter
is used ifsplitter
isNone
. 
bootstrap_sampling
Type โ bool
Default โ
True
If True, perform bootstrap sampling in the leaf nodes.

drift_window_threshold
Type โ int
Default โ
300
Minimum number of examples an alternate tree must observe before being considered as a potential replacement to the current one.

drift_detector
Type โ base.DriftDetector  None
Default โ
None
The drift detector used to build the tree. If
None
thendrift.ADWIN
is used. 
switch_significance
Type โ float
Default โ
0.05
The significance level to assess whether alternate subtrees are significantly better than their main subtree counterparts.

binary_split
Type โ bool
Default โ
False
If True, only allow binary splits.

min_branch_fraction
Type โ float
Default โ
0.01
The minimum percentage of observed data required for branches resulting from split candidates. To validate a split candidate, at least two resulting branches must have a percentage of samples greater than
min_branch_fraction
. This criterion prevents unnecessary splits when the majority of instances are concentrated in a single branch. 
max_share_to_split
Type โ float
Default โ
0.99
Only perform a split in a leaf if the proportion of elements in the majority class is smaller than this parameter value. This parameter avoids performing splits when most of the data belongs to a single class.

max_size
Type โ float
Default โ
100.0
The max size of the tree, in Megabytes (MB).

memory_estimate_period
Type โ int
Default โ
1000000
Interval (number of processed instances) between memory consumption checks.

stop_mem_management
Type โ bool
Default โ
False
If True, stop growing as soon as memory limit is hit.

remove_poor_attrs
Type โ bool
Default โ
False
If True, disable poor attributes to reduce memory usage.

merit_preprune
Type โ bool
Default โ
True
If True, enable meritbased tree prepruning.

seed
Type โ int  None
Default โ
None
Random seed for reproducibility.
Attributes¶

height

leaf_prediction
Return the prediction strategy used by the tree at its leaves.

max_size
Max allowed size tree can reach (in MB).

n_active_leaves

n_alternate_trees

n_branches

n_inactive_leaves

n_leaves

n_nodes

n_pruned_alternate_trees

n_switch_alternate_trees

split_criterion
Return a string with the name of the split criterion being used by the tree.

summary
Collect metrics corresponding to the current status of the tree in a string buffer.
Examples¶
from river.datasets import synth
from river import evaluate
from river import metrics
from river import tree
gen = synth.ConceptDriftStream(stream=synth.SEA(seed=42, variant=0),
drift_stream=synth.SEA(seed=42, variant=1),
seed=1, position=500, width=50)
dataset = iter(gen.take(1000))
model = tree.HoeffdingAdaptiveTreeClassifier(
grace_period=100,
delta=1e5,
leaf_prediction='nb',
nb_threshold=10,
seed=0
)
metric = metrics.Accuracy()
evaluate.progressive_val_score(dataset, model, metric)
Accuracy: 91.49%
Methods¶
debug_one
Print an explanation of how x
is predicted.
Parameters
 x โ 'dict'
Returns
str  None: A representation of the path followed by the tree to predict x
; None
if
draw
Draw the tree using the graphviz
library.
Since the tree is drawn without passing incoming samples, classification trees will show the majority class in their leaves, whereas regression trees will use the target mean.
Parameters
 max_depth โ 'int  None' โ defaults to
None
The maximum depth a tree can reach. IfNone
, the tree will grow indefinitely.
learn_one
Train the model on instance x and corresponding target y.
Parameters
 x
 y
 sample_weight โ defaults to
1.0
Returns
self
predict_one
Predict the label of a set of features x
.
Parameters
 x โ 'dict'
 kwargs
Returns
base.typing.ClfTarget  None: The predicted label.
predict_proba_one
Predict the probability of each label for a dictionary of features x
.
Parameters
 x
Returns
A dictionary that associates a probability which each label.
to_dataframe
Return a representation of the current tree structure organized in a pandas.DataFrame
object.
In case the tree is empty or it only contains a single node (a leaf), None
is returned.
Returns
df
Notes¶
The Hoeffding Adaptive Tree ^{1} uses a drift detector to monitor performance of branches in the tree and to replace them with new branches when their accuracy decreases.
The bootstrap sampling strategy is an improvement over the original Hoeffding Adaptive Tree algorithm. It is enabled by default since, in general, it results in better performance.

Bifet, Albert, and Ricard Gavaldร . "Adaptive learning from evolving data streams." In International Symposium on Intelligent Data Analysis, pp. 249260. Springer, Berlin, Heidelberg, 2009. ↩