Sample AutoML report¶
This section contains a sample AutoML report generated during CI.
The CI is set up as follows:
Environment: Github Actions
Task: Anomaly Detection
AutoML framework: Auto-PyTorch
Compiler framework:
TFLite,Platform: MAX32690 Evaluation Kit
AutoML statistics¶
Optimized metric: f1
The number of generated models: 43
The number of trained and evaluated models: 30
The number of successful training processes: 37
The number of models that caused a crash: 2
The number of models that failed due to the timeout: 1
The number of models that failed due to the too large size: 3
The number of models that failed due to incompatibility: 0
Training overview¶
Figure 12 Loss value during AutoML training process¶
Figure 13 Comparison of loss value across models¶
Summary of generated models¶
Figure 14 Metrics of models trained by AutoML flow¶
Model ID |
Number of layers |
Optimized model size [KB] |
Total parameters |
Trainable parameters |
|---|---|---|---|---|
3 |
7 |
15.5546875 |
2815 |
2814 |
4 |
10 |
49.73046875 |
11623 |
11622 |
5 |
17 |
33.08203125 |
7498 |
7497 |
6 |
21 |
33.4921875 |
7613 |
7612 |
7 |
27 |
61.02734375 |
14094 |
14093 |
8 |
14 |
50.16015625 |
11841 |
11840 |
9 |
21 |
35.60546875 |
7834 |
7833 |
10 |
17 |
37.4296875 |
8732 |
8731 |
11 |
23 |
54.3359375 |
11691 |
11690 |
12 |
21 |
30.37890625 |
7656 |
7655 |
13 |
17 |
33.13671875 |
7799 |
7798 |
14 |
12 |
37.5625 |
8227 |
8226 |
15 |
10 |
42.421875 |
10264 |
10263 |
16 |
13 |
45.5546875 |
10455 |
10454 |
17 |
8 |
19.8671875 |
4364 |
4363 |
18 |
27 |
47.5078125 |
10720 |
10719 |
19 |
25 |
49.37109375 |
13209 |
13208 |
20 |
19 |
45.875 |
10707 |
10706 |
21 |
12 |
44.40234375 |
10171 |
10170 |
22 |
14 |
58.640625 |
14009 |
14008 |
23 |
9 |
27.69921875 |
6301 |
6300 |
24 |
10 |
24.9453125 |
5151 |
5150 |
25 |
9 |
50.67578125 |
12130 |
12129 |
26 |
25 |
51.265625 |
11652 |
11651 |
27 |
11 |
30.75390625 |
8095 |
8094 |
28 |
10 |
36.19140625 |
8007 |
8006 |
29 |
21 |
24.62890625 |
4788 |
4787 |
30 |
23 |
30.2890625 |
6668 |
6667 |
31 |
13 |
26.79296875 |
6005 |
6004 |
32 |
19 |
41.4453125 |
8872 |
8871 |
33 |
19 |
42.16015625 |
9754 |
9753 |
34 |
15 |
31.8359375 |
6497 |
6496 |
35 |
11 |
42.99609375 |
9219 |
9218 |
36 |
13 |
20.0625 |
4112 |
4111 |
37 |
15 |
31.16796875 |
6868 |
6867 |
38 |
17 |
39.828125 |
9512 |
9511 |