Agg¶
Computes a streaming aggregate.
This transformer allows to compute an aggregate statistic, very much like the groupby method from pandas, but on a streaming dataset. This makes use of the streaming statistics from the stats module.
When learn_one is called, the running statistic how of group by is updated with the value of on. Meanwhile, the output of transform_one is a single-element dictionary, where the key is the name of the aggregate and the value is the current value of the statistic for the relevant group. The key is automatically inferred from the parameters.
Note that you can use a compose.TransformerUnion to extract many aggregate statistics in a concise manner.
Parameters¶
-
on (str)
The feature on which to compute the aggregate statistic.
-
by (Union[str, List[str], NoneType])
The feature by which to group the data. All the data is included in the aggregate if this is
None. -
how (river.stats.base.Univariate)
The statistic to compute.
Attributes¶
-
state
Return the current values for each group as a series.
Examples¶
Consider the following dataset:
>>> X = [
... {'country': 'France', 'place': 'Taco Bell', 'revenue': 42},
... {'country': 'Sweden', 'place': 'Burger King', 'revenue': 16},
... {'country': 'France', 'place': 'Burger King', 'revenue': 24},
... {'country': 'Sweden', 'place': 'Taco Bell', 'revenue': 58},
... {'country': 'Sweden', 'place': 'Burger King', 'revenue': 20},
... {'country': 'France', 'place': 'Taco Bell', 'revenue': 50},
... {'country': 'France', 'place': 'Burger King', 'revenue': 10},
... {'country': 'Sweden', 'place': 'Taco Bell', 'revenue': 80}
... ]
As an example, we can calculate the average (how) revenue (on) for each place (by):
>>> from river import feature_extraction as fx
>>> from river import stats
>>> agg = fx.Agg(
... on='revenue',
... by='place',
... how=stats.Mean()
... )
>>> for x in X:
... agg = agg.learn_one(x)
... print(agg.transform_one(x))
{'revenue_mean_by_place': 42.0}
{'revenue_mean_by_place': 16.0}
{'revenue_mean_by_place': 20.0}
{'revenue_mean_by_place': 50.0}
{'revenue_mean_by_place': 20.0}
{'revenue_mean_by_place': 50.0}
{'revenue_mean_by_place': 17.5}
{'revenue_mean_by_place': 57.5}
You can compute an aggregate over multiple keys by passing a tuple to the by argument.
For instance, we can compute the maximum (how) revenue (on) per place as well as per
day (by):
>>> agg = fx.Agg(
... on='revenue',
... by=['place', 'country'],
... how=stats.Max()
... )
>>> for x in X:
... agg = agg.learn_one(x)
... print(agg.transform_one(x))
{'revenue_max_by_place_and_country': 42}
{'revenue_max_by_place_and_country': 16}
{'revenue_max_by_place_and_country': 24}
{'revenue_max_by_place_and_country': 58}
{'revenue_max_by_place_and_country': 20}
{'revenue_max_by_place_and_country': 50}
{'revenue_max_by_place_and_country': 24}
{'revenue_max_by_place_and_country': 80}
You can use a compose.TransformerUnion in order to calculate multiple aggregates in one
go. The latter can be constructed by using the + operator:
>>> agg = (
... fx.Agg(on='revenue', by='place', how=stats.Mean()) +
... fx.Agg(on='revenue', by=['place', 'country'], how=stats.Max())
... )
>>> import pprint
>>> for x in X:
... agg = agg.learn_one(x)
... pprint.pprint(agg.transform_one(x))
{'revenue_max_by_place_and_country': 42, 'revenue_mean_by_place': 42.0}
{'revenue_max_by_place_and_country': 16, 'revenue_mean_by_place': 16.0}
{'revenue_max_by_place_and_country': 24, 'revenue_mean_by_place': 20.0}
{'revenue_max_by_place_and_country': 58, 'revenue_mean_by_place': 50.0}
{'revenue_max_by_place_and_country': 20, 'revenue_mean_by_place': 20.0}
{'revenue_max_by_place_and_country': 50, 'revenue_mean_by_place': 50.0}
{'revenue_max_by_place_and_country': 24, 'revenue_mean_by_place': 17.5}
{'revenue_max_by_place_and_country': 80, 'revenue_mean_by_place': 57.5}
The state property returns a pandas.Series, which can be useful for visualizing the
current state.
>>> agg[0].state
Taco Bell 57.5
Burger King 17.5
Name: revenue_mean_by_place, dtype: float64
>>> agg[1].state
place country
Taco Bell France 50
Burger King Sweden 20
France 24
Taco Bell Sweden 80
Name: revenue_max_by_place_and_country, dtype: int64
Methods¶
learn_one
Update with a set of features x.
A lot of transformers don't actually have to do anything during the learn_one step because they are stateless. For this reason the default behavior of this function is to do nothing. Transformers that however do something during the learn_one can override this method.
Parameters
- x (dict)
Returns
Transformer: self
transform_one
Transform a set of features x.
Parameters
- x (dict)
Returns
dict: The transformed values.