Overview page

ERT loss ratios

All functions in 5-D and 20-D

f1f24 in 5-D, maxFE/D=200803

#FEs/D best 10 % 25 % med 75 % 90 %
RLUS/D 7e4 7e4 1e5 2e5 2e5 2e5
2 0.55 0.91 1.1 1.6 2.2 3.5
10 0.56 0.96 1.6 2.4 3.3 5.1
100 0.46 0.89 2.0 4.4 7.0 18
1e3 0.57 0.68 1.2 3.9 12 35
1e4 0.62 0.91 1.2 4.4 23 67
1e5 0.62 0.91 1.2 2.3 27 2.6e2
1e6 0.62 0.91 1.2 2.3 27 7.5e2

f1f24 in 20-D, maxFE/D=200292

#FEs/D best 10 % 25 % med 75 % 90 %
RLUS/D 2e4 4e4 6e4 2e5 2e5 2e5
2 0.81 0.86 1.0 1.8 5.3 13
10 0.63 0.99 1.7 3.8 4.8 7.4
100 0.59 1.00 2.1 4.2 13 49
1e3 0.51 0.80 1.00 6.2 15 66
1e4 0.51 0.88 1.00 3.1 41 75
1e5 0.51 0.68 0.91 4.8 57 3.8e2
1e6 0.51 0.86 0.95 5.1 57 2.7e3

ERT loss ratio versus the budget in number of f-evaluations divided by dimension. For each given budget FEvals, the target value ft is computed as the best target f-value reached within the budget by the given algorithm. Shown is then the ERT to reach ft for the given algorithm or the budget, if the best algorithm from BBOB 2009 reached a better target within the budget, divided by the ERT of the best algorithm from BBOB 2009 to reach ft. Line: geometric mean. Box-Whisker error bar: 25-75%-ile with median (box), 10-90%-ile (caps), and minimum and maximum ERT loss ratio (points). The vertical line gives the maximal number of function evaluations in a single trial in this function subset. See also the following figure for results on each function subgroup.

Separable functions in 5-D and 20-D

Misc. moderate functions in 5-D and 20-D

Ill-conditioned functions in 5-D and 20-D

Multi-modal functions in 5-D and 20-D

Weak structure functions in 5-D and 20-D

ERT loss ratios (see the previous figure for details).

Each cross (+) represents a single function, the line is the geometric mean.