Online machine learning benchmarks

Python implementation: CPython
Python version       : 3.9.12
IPython version      : 7.30.1

river       : 0.10.1
numpy       : 1.22.3
scikit-learn: 1.1.0
pandas      : 1.4.1
scipy       : 1.8.0

Compiler    : Clang 12.0.1 
OS          : Darwin
Release     : 21.3.0
Machine     : x86_64
Processor   : i386
CPU cores   : 8
Architecture: 64bit

Binary classification

Datasets

Results

Dataset
Model
Memory
Time
Accuracy
F1
Phishing
Logistic regression
5.67 KB
00:01:08.272
89.20%
87.89%
Bananas
Logistic regression
4.32 KB
00:02:48.998
53.74%
22.11%

Single-target Regression

Datasets

Results

Dataset
Model
Memory
Time
MAE
R2
RMSE
TrumpApproval
MaxAbs | Linear Regression
4.77 KB
00:00:39.633
0.653
-1.672
2.796
Friedman7k
MaxAbs | Linear Regression
5.38 KB
00:05:22.768
2.176
0.681
2.798
FriedmanLEA10k
MaxAbs | Linear Regression
5.38 KB
00:07:50.940
2.441
0.632
3.240
FriedmanGSG10k
MaxAbs | Linear Regression
5.38 KB
00:07:47.892
2.268
0.662
2.900
TrumpApproval
MaxAbs | Linear Regression with l1 regularization
5 KB
00:00:43.443
0.850
-1.786
2.855
Friedman7k
MaxAbs | Linear Regression with l1 regularization
5.62 KB
00:06:12.344
3.370
0.301
4.142
FriedmanLEA10k
MaxAbs | Linear Regression with l1 regularization
5.62 KB
00:09:02.743
3.685
0.256
4.607
FriedmanGSG10k
MaxAbs | Linear Regression with l1 regularization
5.62 KB
00:08:58.187
3.587
0.215
4.418
TrumpApproval
MaxAbs | Linear Regression with l2 regularization
4.79 KB
00:00:40.765
1.714
-2.549
3.222
Friedman7k
MaxAbs | Linear Regression with l2 regularization
5.4 KB
00:05:37.612
3.666
0.166
4.525
FriedmanLEA10k
MaxAbs | Linear Regression with l2 regularization
5.4 KB
00:08:11.946
3.948
0.152
4.920
FriedmanGSG10k
MaxAbs | Linear Regression with l2 regularization
5.4 KB
00:08:08.812
3.722
0.158
4.576
TrumpApproval
MaxAbs | Passive-Aggressive Regressor, mode 1
4.24 KB
00:00:46.142
3.003
-3.757
3.731
Friedman7k
MaxAbs | Passive-Aggressive Regressor, mode 1
4.96 KB
00:06:07.530
3.398
0.251
4.287
FriedmanLEA10k
MaxAbs | Passive-Aggressive Regressor, mode 1
4.96 KB
00:08:56.063
3.638
0.239
4.662
FriedmanGSG10k
MaxAbs | Passive-Aggressive Regressor, mode 1
4.96 KB
00:08:54.172
3.440
0.241
4.343
TrumpApproval
MaxAbs | Passive-Aggressive Regressor, mode 2
4.24 KB
00:00:44.892
32.626
-405.390
34.483
Friedman7k
MaxAbs | Passive-Aggressive Regressor, mode 2
4.96 KB
00:06:08.220
10.485
-5.820
12.937
FriedmanLEA10k
MaxAbs | Passive-Aggressive Regressor, mode 2
4.96 KB
00:08:56.449
10.957
-5.464
13.581
FriedmanGSG10k
MaxAbs | Passive-Aggressive Regressor, mode 2
4.96 KB
00:08:51.636
10.613
-5.937
13.133
TrumpApproval
MaxAbs | k-Nearest Neighbors
67.18 KB
00:04:52.739
0.374
0.272
1.460
Friedman7k
MaxAbs | k-Nearest Neighbors
76.62 KB
00:14:12.945
2.811
0.496
3.519
FriedmanLEA10k
MaxAbs | k-Nearest Neighbors
76.62 KB
00:01:36.299
3.096
0.446
3.975
FriedmanGSG10k
MaxAbs | k-Nearest Neighbors
76.62 KB
00:01:32.742
2.872
0.487
3.572
TrumpApproval
MaxAbs | Hoeffding Tree
99.04 KB
00:01:53.836
0.613
-1.607
2.762
Friedman7k
MaxAbs | Hoeffding Tree
7.36 MB
00:15:52.990
2.002
0.726
2.595
FriedmanLEA10k
MaxAbs | Hoeffding Tree
12.02 MB
00:15:51.676
2.147
0.702
2.918
FriedmanGSG10k
MaxAbs | Hoeffding Tree
12.08 MB
00:00:04.008
2.279
0.656
2.923
TrumpApproval
MaxAbs | Hoeffding Adaptive Tree
79.63 KB
00:01:56.532
0.564
-1.203
2.539
Friedman7k
MaxAbs | Hoeffding Adaptive Tree
9.7 MB
00:05:39.091
1.951
0.743
2.513
FriedmanLEA10k
MaxAbs | Hoeffding Adaptive Tree
10 MB
00:04:42.101
2.172
0.693
2.958
FriedmanGSG10k
MaxAbs | Hoeffding Adaptive Tree
12.16 MB
00:03:24.262
2.296
0.653
2.938
TrumpApproval
MaxAbs | Adaptive Random Forest
1.4 MB
00:00:39.041
0.283
0.185
1.544
Friedman7k
MaxAbs | Adaptive Random Forest
37.65 MB
00:15:15.976
1.902
0.756
2.447
FriedmanLEA10k
MaxAbs | Adaptive Random Forest
55.3 MB
00:00:07.493
2.125
0.701
2.923
FriedmanGSG10k
MaxAbs | Adaptive Random Forest
54.46 MB
00:05:49.503
2.273
0.657
2.920
TrumpApproval
MaxAbs | Adaptive Model Rules
186.45 KB
00:02:09.805
0.522
0.153
1.575
Friedman7k
MaxAbs | Adaptive Model Rules
28.24 MB
00:13:35.261
2.268
0.656
2.904
FriedmanLEA10k
MaxAbs | Adaptive Model Rules
3.99 MB
00:06:42.265
2.561
0.595
3.398
FriedmanGSG10k
MaxAbs | Adaptive Model Rules
5.69 MB
00:08:09.700
2.454
0.610
3.113
TrumpApproval
MaxAbs | Multi-layer Perceptron
10.99 KB
00:10:28.365
40.755
-567.663
40.790
Friedman7k
MaxAbs | Multi-layer Perceptron
11.87 KB
00:00:55.019
2.369
0.569
3.250
FriedmanLEA10k
MaxAbs | Multi-layer Perceptron
11.87 KB
00:03:27.236
2.592
0.562
3.536
FriedmanGSG10k
MaxAbs | Multi-layer Perceptron
11.87 KB
00:03:21.869
2.409
0.584
3.218
TrumpApproval
MinMax | Linear Regression
6.21 KB
00:00:44.871
1.595
-6.141
4.571
Friedman7k
MinMax | Linear Regression
7.51 KB
00:06:19.208
2.180
0.679
2.805
FriedmanLEA10k
MinMax | Linear Regression
7.51 KB
00:09:11.360
2.444
0.631
3.244
FriedmanGSG10k
MinMax | Linear Regression
7.51 KB
00:09:08.328
2.271
0.661
2.905
TrumpApproval
MinMax | Linear Regression with l1 regularization
6.45 KB
00:00:48.928
1.462
-6.118
4.564
Friedman7k
MinMax | Linear Regression with l1 regularization
7.74 KB
00:07:09.540
3.379
0.297
4.155
FriedmanLEA10k
MinMax | Linear Regression with l1 regularization
7.74 KB
00:10:25.094
3.692
0.254
4.615
FriedmanGSG10k
MinMax | Linear Regression with l1 regularization
7.74 KB
00:10:19.695
3.594
0.212
4.427
TrumpApproval
MinMax | Linear Regression with l2 regularization
6.23 KB
00:00:47.034
2.026
-7.046
4.852
Friedman7k
MinMax | Linear Regression with l2 regularization
7.53 KB
00:06:36.378
3.668
0.164
4.529
FriedmanLEA10k
MinMax | Linear Regression with l2 regularization
7.53 KB
00:09:36.581
3.949
0.151
4.922
FriedmanGSG10k
MinMax | Linear Regression with l2 regularization
7.53 KB
00:09:31.507
3.723
0.157
4.579
TrumpApproval
MinMax | Passive-Aggressive Regressor, mode 1
5.69 KB
00:00:51.157
2.130
-4.811
4.123
Friedman7k
MinMax | Passive-Aggressive Regressor, mode 1
7.08 KB
00:07:06.895
3.390
0.255
4.277
FriedmanLEA10k
MinMax | Passive-Aggressive Regressor, mode 1
7.08 KB
00:10:22.635
3.644
0.239
4.661
FriedmanGSG10k
MinMax | Passive-Aggressive Regressor, mode 1
7.08 KB
00:10:21.479
3.464
0.237
4.356
TrumpApproval
MinMax | Passive-Aggressive Regressor, mode 2
5.69 KB
00:00:51.265
31.504
-411.983
34.761
Friedman7k
MinMax | Passive-Aggressive Regressor, mode 2
7.08 KB
00:07:08.177
10.615
-6.002
13.109
FriedmanLEA10k
MinMax | Passive-Aggressive Regressor, mode 2
7.08 KB
00:10:21.476
10.933
-5.395
13.509
FriedmanGSG10k
MinMax | Passive-Aggressive Regressor, mode 2
7.08 KB
00:10:16.892
10.563
-5.879
13.079
TrumpApproval
MinMax | k-Nearest Neighbors
68.62 KB
00:04:56.442
0.417
0.246
1.485
Friedman7k
MinMax | k-Nearest Neighbors
78.75 KB
00:15:10.569
2.810
0.496
3.515
FriedmanLEA10k
MinMax | k-Nearest Neighbors
78.75 KB
00:03:09.188
3.095
0.447
3.974
FriedmanGSG10k
MinMax | k-Nearest Neighbors
78.75 KB
00:02:55.634
2.871
0.487
3.570
TrumpApproval
MinMax | Hoeffding Tree
155.24 KB
00:02:03.287
1.478
-5.089
4.221
Friedman7k
MinMax | Hoeffding Tree
8.11 MB
00:16:06.333
2.041
0.718
2.629
FriedmanLEA10k
MinMax | Hoeffding Tree
12.25 MB
00:13:21.709
2.160
0.701
2.920
FriedmanGSG10k
MinMax | Hoeffding Tree
11.31 MB
00:01:17.128
2.306
0.648
2.959
TrumpApproval
MinMax | Hoeffding Adaptive Tree
115.85 KB
00:01:57.859
1.454
-4.636
4.061
Friedman7k
MinMax | Hoeffding Adaptive Tree
8.05 MB
00:01:48.584
1.976
0.736
2.543
FriedmanLEA10k
MinMax | Hoeffding Adaptive Tree
12.94 MB
00:00:12.700
2.202
0.691
2.969
FriedmanGSG10k
MinMax | Hoeffding Adaptive Tree
12.16 MB
00:14:58.784
2.297
0.651
2.948
TrumpApproval
MinMax | Adaptive Random Forest
1.38 MB
00:01:00.828
0.811
-0.825
2.311
Friedman7k
MinMax | Adaptive Random Forest
37.48 MB
00:14:55.965
1.853
0.770
2.378
FriedmanLEA10k
MinMax | Adaptive Random Forest
54.66 MB
00:07:06.994
2.087
0.711
2.873
FriedmanGSG10k
MinMax | Adaptive Random Forest
53.65 MB
00:05:36.761
2.262
0.658
2.914
TrumpApproval
MinMax | Adaptive Model Rules
208.7 KB
00:02:08.825
1.038
-0.219
1.888
Friedman7k
MinMax | Adaptive Model Rules
28.24 MB
00:03:14.730
2.269
0.656
2.906
FriedmanLEA10k
MinMax | Adaptive Model Rules
3.83 MB
00:07:21.220
2.548
0.592
3.413
FriedmanGSG10k
MinMax | Adaptive Model Rules
5.7 MB
00:08:36.490
2.457
0.610
3.115
TrumpApproval
MinMax | Multi-layer Perceptron
12.43 KB
00:10:23.640
1.542
-9.929
5.655
Friedman7k
MinMax | Multi-layer Perceptron
13.99 KB
00:03:56.918
2.369
0.570
3.250
FriedmanLEA10k
MinMax | Multi-layer Perceptron
13.99 KB
00:11:34.459
2.592
0.562
3.536
FriedmanGSG10k
MinMax | Multi-layer Perceptron
13.99 KB
00:05:45.517
2.408
0.584
3.218
TrumpApproval
Standard | Linear Regression
5.09 KB
00:00:43.173
1.347
-4.819
4.126
Friedman7k
Standard | Linear Regression
5.32 KB
00:06:03.664
2.238
0.655
2.910
FriedmanLEA10k
Standard | Linear Regression
5.32 KB
00:08:49.868
2.521
0.604
3.362
FriedmanGSG10k
Standard | Linear Regression
5.32 KB
00:08:46.225
2.290
0.649
2.955
TrumpApproval
Standard | Linear Regression with l1 regularization
5.33 KB
00:00:47.425
1.215
-4.651
4.066
Friedman7k
Standard | Linear Regression with l1 regularization
5.56 KB
00:06:53.950
2.355
0.636
2.990
FriedmanLEA10k
Standard | Linear Regression with l1 regularization
5.56 KB
00:10:03.345
2.641
0.577
3.475
FriedmanGSG10k
Standard | Linear Regression with l1 regularization
5.56 KB
00:09:59.159
2.504
0.600
3.153
TrumpApproval
Standard | Linear Regression with l2 regularization
5.12 KB
00:00:45.186
1.998
-5.640
4.408
Friedman7k
Standard | Linear Regression with l2 regularization
5.34 KB
00:06:21.203
2.543
0.582
3.203
FriedmanLEA10k
Standard | Linear Regression with l2 regularization
5.34 KB
00:09:13.637
2.805
0.539
3.626
FriedmanGSG10k
Standard | Linear Regression with l2 regularization
5.34 KB
00:09:10.674
2.591
0.577
3.245
TrumpApproval
Standard | Passive-Aggressive Regressor, mode 1
4.54 KB
00:00:49.939
4.904
-14.172
6.663
Friedman7k
Standard | Passive-Aggressive Regressor, mode 1
4.87 KB
00:06:56.393
6.016
-1.348
7.590
FriedmanLEA10k
Standard | Passive-Aggressive Regressor, mode 1
4.87 KB
00:10:05.548
6.211
-1.151
7.835
FriedmanGSG10k
Standard | Passive-Aggressive Regressor, mode 1
4.87 KB
00:09:58.947
6.044
-1.339
7.626
TrumpApproval
Standard | Passive-Aggressive Regressor, mode 2
4.54 KB
00:00:49.169
31.126
-403.916
34.420
Friedman7k
Standard | Passive-Aggressive Regressor, mode 2
4.87 KB
00:06:51.218
10.120
-5.563
12.691
FriedmanLEA10k
Standard | Passive-Aggressive Regressor, mode 2
4.87 KB
00:09:57.271
10.421
-5.005
13.090
FriedmanGSG10k
Standard | Passive-Aggressive Regressor, mode 2
4.87 KB
00:09:54.866
10.116
-5.511
12.724
TrumpApproval
Standard | k-Nearest Neighbors
67.5 KB
00:05:03.588
0.494
0.223
1.507
Friedman7k
Standard | k-Nearest Neighbors
76.56 KB
00:15:06.285
2.816
0.495
3.521
FriedmanLEA10k
Standard | k-Nearest Neighbors
76.56 KB
00:02:47.511
3.101
0.445
3.981
FriedmanGSG10k
Standard | k-Nearest Neighbors
76.56 KB
00:02:45.209
2.876
0.486
3.576
TrumpApproval
Standard | Hoeffding Tree
512.06 KB
00:10:09.579
1.130
-3.702
3.709
Friedman7k
Standard | Hoeffding Tree
8.53 MB
00:16:20.912
1.921
0.741
2.520
FriedmanLEA10k
Standard | Hoeffding Tree
11.83 MB
00:00:45.801
2.123
0.716
2.849
FriedmanGSG10k
Standard | Hoeffding Tree
11.56 MB
00:03:54.261
2.160
0.673
2.852
TrumpApproval
Standard | Hoeffding Adaptive Tree
534.19 KB
00:10:19.832
1.140
-3.711
3.713
Friedman7k
Standard | Hoeffding Adaptive Tree
7.89 MB
00:01:30.496
1.933
0.739
2.533
FriedmanLEA10k
Standard | Hoeffding Adaptive Tree
11.89 MB
00:13:11.586
2.138
0.712
2.869
FriedmanGSG10k
Standard | Hoeffding Adaptive Tree
13.17 MB
00:00:29.263
2.108
0.687
2.788
TrumpApproval
Standard | Adaptive Random Forest
2.3 MB
00:07:13.532
1.135
-3.132
3.477
Friedman7k
Standard | Adaptive Random Forest
37.3 MB
00:15:57.671
2.072
0.703
2.701
FriedmanLEA10k
Standard | Adaptive Random Forest
53.61 MB
00:14:03.286
2.255
0.671
3.066
FriedmanGSG10k
Standard | Adaptive Random Forest
53.81 MB
00:05:34.698
2.402
0.605
3.134
TrumpApproval
Standard | Adaptive Model Rules
1.84 MB
00:08:58.775
1.023
-0.734
2.252
Friedman7k
Standard | Adaptive Model Rules
28.24 MB
00:06:17.675
2.267
0.651
2.926
FriedmanLEA10k
Standard | Adaptive Model Rules
8.58 MB
00:03:59.227
2.462
0.622
3.284
FriedmanGSG10k
Standard | Adaptive Model Rules
5.69 MB
00:14:06.115
2.374
0.624
3.058
TrumpApproval
Standard | Multi-layer Perceptron
11.31 KB
00:10:25.529
1.590
-8.045
5.144
Friedman7k
Standard | Multi-layer Perceptron
11.81 KB
00:02:42.282
2.147
0.632
3.006
FriedmanLEA10k
Standard | Multi-layer Perceptron
11.81 KB
00:05:28.591
2.402
0.610
3.337
FriedmanGSG10k
Standard | Multi-layer Perceptron
11.81 KB
00:05:08.494
2.338
0.605
3.134
TrumpApproval
Robust | Linear Regression
23 KB
00:02:16.529
1.957
-8.249
5.202
Friedman7k
Robust | Linear Regression
35.57 KB
00:04:33.559
2.156
0.677
2.817
FriedmanLEA10k
Robust | Linear Regression
35.57 KB
00:13:47.812
2.418
0.632
3.241
FriedmanGSG10k
Robust | Linear Regression
35.57 KB
00:13:47.700
2.212
0.671
2.861
TrumpApproval
Robust | Linear Regression with l1 regularization
23.23 KB
00:02:20.917
1.856
-7.996
5.131
Friedman7k
Robust | Linear Regression with l1 regularization
35.81 KB
00:05:22.939
2.618
0.563
3.274
FriedmanLEA10k
Robust | Linear Regression with l1 regularization
35.81 KB
00:15:27.460
2.887
0.516
3.716
FriedmanGSG10k
Robust | Linear Regression with l1 regularization
35.81 KB
00:06:19.383
2.869
0.486
3.576
TrumpApproval
Robust | Linear Regression with l2 regularization
23.02 KB
00:01:24.170
2.219
-8.470
5.264
Friedman7k
Robust | Linear Regression with l2 regularization
35.59 KB
00:13:08.972
3.022
0.427
3.751
FriedmanLEA10k
Robust | Linear Regression with l2 regularization
35.59 KB
00:02:05.454
3.281
0.399
4.141
FriedmanGSG10k
Robust | Linear Regression with l2 regularization
35.59 KB
00:02:15.132
3.068
0.423
3.789
TrumpApproval
Robust | Passive-Aggressive Regressor, mode 1
22.42 KB
00:01:28.313
3.019
-8.745
5.340
Friedman7k
Robust | Passive-Aggressive Regressor, mode 1
35.12 KB
00:13:46.079
3.439
0.219
4.378
FriedmanLEA10k
Robust | Passive-Aggressive Regressor, mode 1
35.12 KB
00:02:50.182
3.679
0.215
4.733
FriedmanGSG10k
Robust | Passive-Aggressive Regressor, mode 1
35.12 KB
00:02:47.076
3.500
0.205
4.447
TrumpApproval
Robust | Passive-Aggressive Regressor, mode 2
22.45 KB
00:01:27.780
31.895
-445.230
36.134
Friedman7k
Robust | Passive-Aggressive Regressor, mode 2
35.12 KB
00:13:36.581
10.809
-6.464
13.534
FriedmanLEA10k
Robust | Passive-Aggressive Regressor, mode 2
35.12 KB
00:02:55.468
11.125
-5.809
13.939
FriedmanGSG10k
Robust | Passive-Aggressive Regressor, mode 2
35.12 KB
00:02:41.476
10.836
-6.394
13.559
TrumpApproval
Robust | k-Nearest Neighbors
85.41 KB
00:04:06.945
0.509
0.215
1.515
Friedman7k
Robust | k-Nearest Neighbors
106.81 KB
00:06:18.423
2.810
0.497
3.515
FriedmanLEA10k
Robust | k-Nearest Neighbors
106.81 KB
00:07:40.738
3.098
0.445
3.978
FriedmanGSG10k
Robust | k-Nearest Neighbors
106.81 KB
00:06:43.810
2.873
0.487
3.572
TrumpApproval
Robust | Hoeffding Tree
1.19 MB
00:04:18.042
1.723
-5.820
4.467
Friedman7k
Robust | Hoeffding Tree
9.64 MB
00:16:04.963
1.864
0.753
2.464
FriedmanLEA10k
Robust | Hoeffding Tree
11.17 MB
00:04:31.096
2.031
0.723
2.814
FriedmanGSG10k
Robust | Hoeffding Tree
11.37 MB
00:09:08.989
2.131
0.676
2.839
TrumpApproval
Robust | Hoeffding Adaptive Tree
443.51 KB
00:04:22.919
1.660
-6.803
4.778
Friedman7k
Robust | Hoeffding Adaptive Tree
8.9 MB
00:16:18.997
1.832
0.763
2.412
FriedmanLEA10k
Robust | Hoeffding Adaptive Tree
12.98 MB
00:04:27.390
2.057
0.715
2.850
FriedmanGSG10k
Robust | Hoeffding Adaptive Tree
13.22 MB
00:08:02.282
2.078
0.697
2.745
TrumpApproval
Robust | Adaptive Random Forest
1.8 MB
00:02:21.499
11.145
-1019.976
54.656
Friedman7k
Robust | Adaptive Random Forest
37.5 MB
00:05:22.568
1.874
0.695
2.737
FriedmanLEA10k
Robust | Adaptive Random Forest
53.63 MB
00:06:47.239
2.052
0.676
3.041
FriedmanGSG10k
Robust | Adaptive Random Forest
53.94 MB
00:09:28.237
2.323
0.592
3.187
TrumpApproval
Robust | Adaptive Model Rules
461.49 KB
00:05:05.298
0.999
-0.196
1.870
Friedman7k
Robust | Adaptive Model Rules
28.27 MB
00:10:15.677
2.173
0.677
2.817
FriedmanLEA10k
Robust | Adaptive Model Rules
10.17 MB
00:11:48.125
2.316
0.671
3.065
FriedmanGSG10k
Robust | Adaptive Model Rules
2.88 MB
00:16:01.134
2.322
0.635
3.013
TrumpApproval
Robust | Multi-layer Perceptron
29.17 KB
00:07:37.203
1.990
-10.338
5.760
Friedman7k
Robust | Multi-layer Perceptron
42.06 KB
00:14:00.053
2.277
0.606
3.111
FriedmanLEA10k
Robust | Multi-layer Perceptron
42.06 KB
00:07:59.136
2.510
0.586
3.435
FriedmanGSG10k
Robust | Multi-layer Perceptron
42.06 KB
00:08:02.696
2.300
0.620
3.073