ERT loss ratios
All functions in 5-D and 20-D
f1–f24 in 5-D, maxFE/D=200727
| #FEs/D
| best |
10 % |
25 % |
med |
75 % |
90 % |
| RLUS/D
| 6e4 |
7e4 |
1e5 |
1e5 |
2e5 |
2e5 |
| 2 |
0.56 |
0.85 |
1.1 |
1.6 |
2.5 |
3.5 |
| 10 |
0.69 |
1.2 |
1.7 |
2.3 |
3.3 |
5.1 |
| 100 |
0.47 |
1.1 |
2.2 |
3.7 |
6.9 |
18 |
| 1e3 |
0.48 |
0.73 |
1.0 |
3.5 |
9.9 |
30 |
| 1e4 |
0.61 |
0.74 |
0.95 |
3.2 |
27 |
61 |
| 1e5 |
0.61 |
0.74 |
0.87 |
2.0 |
11 |
1.4e2 |
f1–f24 in 20-D, maxFE/D=200298
| #FEs/D
| best |
10 % |
25 % |
med |
75 % |
90 % |
| RLUS/D
| 5e4 |
5e4 |
1e5 |
1e5 |
2e5 |
2e5 |
| 2 |
0.65 |
0.95 |
1.0 |
2.1 |
6.7 |
40 |
| 10 |
0.58 |
0.75 |
1.4 |
3.1 |
4.8 |
6.9 |
| 100 |
0.32 |
0.69 |
1.3 |
3.0 |
7.2 |
24 |
| 1e3 |
0.35 |
0.47 |
0.82 |
1.1 |
7.1 |
37 |
| 1e4 |
0.28 |
0.48 |
0.77 |
1.1 |
18 |
68 |
| 1e5 |
0.46 |
0.69 |
0.80 |
2.4 |
20 |
3.1e2 |
| 1e6 |
0.38 |
0.48 |
0.78 |
1.4 |
24 |
2.7e3 |
ERT loss ratio versus the budget in number of f-evaluations divided by dimension. For each given budget FEvals, the target value ft is computed as the best target f-value reached within the budget by the given algorithm. Shown is then the ERT to reach ft for the given algorithm or the budget, if the best algorithm from BBOB 2009 reached a better target within the budget, divided by the ERT of the best algorithm from BBOB 2009 to reach ft. Line: geometric mean. Box-Whisker error bar: 25-75%-ile with median (box), 10-90%-ile (caps), and minimum and maximum ERT loss ratio (points). The vertical line gives the maximal number of function evaluations in a single trial in this function subset. See also the following figure for results on each function subgroup.
Separable functions in 5-D and 20-D
Misc. moderate functions in 5-D and 20-D
Ill-conditioned functions in 5-D and 20-D
Multi-modal functions in 5-D and 20-D
Weak structure functions in 5-D and 20-D
ERT loss ratios (see the previous figure for details). Each cross (+) represents a single function, the line is the geometric mean.
