Sample AutoML report

This section contains a sample AutoML report generated during CI.

The CI is set up as follows:

AutoML statistics

  • Optimized metric: f1

  • The number of generated models: 62

  • The number of trained and evaluated models: 43

  • The number of successful training processes: 53

  • The number of models that caused a crash: 0

  • The number of models that failed due to the timeout: 1

  • The number of models that failed due to the too large size: 8

  • The number of models that failed due to incompatibility: 0

Training overview

Bokeh Plot

Figure 12 Loss value during AutoML training process

Bokeh Plot

Figure 13 Comparison of loss value across models

Summary of generated models

Bokeh Plot

Figure 14 Metrics of models trained by AutoML flow

Table 5 Summary of generated models’ parameters

Model ID

Number of layers

Optimized model size [KB]

Total parameters

Trainable parameters

3

7

15.5546875

2815

2814

4

10

49.73046875

11623

11622

5

17

33.08203125

7498

7497

6

21

33.4921875

7613

7612

7

27

61.02734375

14094

14093

8

14

50.16015625

11841

11840

9

21

35.60546875

7834

7833

10

17

37.4296875

8732

8731

11

23

54.3359375

11691

11690

12

21

30.37890625

7656

7655

13

17

33.13671875

7799

7798

14

12

37.5625

8227

8226

15

10

42.421875

10264

10263

16

13

45.5546875

10455

10454

17

8

19.8671875

4364

4363

18

27

47.5078125

10720

10719

19

10

42.234375

10052

10051

20

19

45.875

10707

10706

21

11

33.0234375

7276

7275

22

21

33.0234375

8266

8265

23

23

44.55859375

10318

10317

24

17

31.94921875

6520

6519

25

10

36.109375

7850

7849

26

14

53.28125

12688

12687

27

13

57.70703125

14126

14125

28

21

24.35546875

4676

4675

29

11

26.8515625

5762

5761

30

9

41.14453125

9488

9487

31

11

47.01171875

10084

10083

32

10

40.78125

9333

9332

33

17

49.8125

13830

13829

34

7

28.078125

6002

6001

35

17

54.1328125

13244

13243

36

10

14.88671875

2302

2301

37

12

53.57421875

13471

13470

38

13

21.20703125

4534

4533

39

9

39.09765625

10783

10782

40

10

33.23046875

8566

8565

41

25

64.33203125

14531

14530

42

11

27.7578125

5542

5541

43

14

44.0546875

8630

8629

44

19

46.0546875

10194

10193

45

14

54.5

12633

12632

46

19

42.7578125

9670

9669

47

25

37.8671875

7278

7277

48

10

40.92578125

8541

8540

49

25

41.97265625

8491

8490

50

21

36.33984375

8069

8068

51

13

28.80859375

7269

7268

52

21

25.45703125

4973

4972

53

11

33.83203125

8420

8419

Classification comparison

Comparison of inference time, F1 score and model size

Bokeh Plot