Supplementary material for ICCV submission 667:

Understanding deep features with computer generated imagery

Detailed quantitative results for the experiments of section 4.2

You can find in this table the details of the quantitative results summarized in the paper. Notice the consistency across categories of the observations made in the paper, as well as the differences in percentage across classes. Typically, the chairs category has a much higher relative variance associated to the style variable, corresponding to its greater diversity.

You can also see here the quantitative results for the light variation. They are not used in the paper but the corresponding embedding is presented in figure 4.

Results

Cars

Rotation
pool5 fc6 fc7
Factor
Places 34.9% 29.4% 30.0%
9 6 6
AlexNet 36.0% 27.2% 26.8%
9 6 6
VGG 29.1% 23.2% 21.8%
10 7 7
Style
Places 18.5% 26.8% 29.2%
119 42 42
AlexNet 19.7% 29.2% 32.3%
108 74 74
VGG 18.7% 30.4% 35.0%
174 80 80
Residual
Places 46.6% 43.8% 40.9%
1000 616 616
AlexNet 44.3% 43.6% 40.9%
1000 1000 1000
VGG 52.2% 46.3% 43.2%
1000 1000 1000

2D translation
pool5 fc6 fc7
Factor
Places 68.3% 58.1% 45.8%
16 10 10
AlexNet 69.6% 52.3% 35.1%
15 11 11
VGG 54.7% 39.6% 21.4%
19 12 12
Style
Places 5.0% 16.7% 32.9%
125 34 34
AlexNet 5.0% 18.4% 36.9%
104 60 60
VGG 5.5% 28.1% 55.1%
164 79 79
Residual
Places 26.6% 25.1% 21.2%
1000 967 967
AlexNet 25.4% 29.3% 28.0%
1000 1000 1000
VGG 39.8% 32.3% 23.6%
1000 1000 1000

Scale
pool5 fc6 fc7
Factor
Places 44.5% 40.7% 38.0%
3 2 2
AlexNet 41.4% 36.6% 37.4%
3 2 2
VGG 34.1% 31.5% 32.6%
3 2 2
Style
Places 25.4% 30.1% 34.4%
119 38 38
AlexNet 28.7% 33.3% 34.0%
110 69 69
VGG 30.5% 36.6% 38.2%
181 82 82
Residual
Places 30.1% 29.2% 27.5%
662 314 314
AlexNet 29.9% 30.1% 28.6%
630 554 554
VGG 35.4% 32.0% 29.3%
939 557 557

Foreground color
pool5 fc6 fc7
Factor
Places 48.0% 58.3% 63.7%
20 16 16
AlexNet 49.3% 52.0% 51.0%
17 20 20
VGG 33.3% 43.7% 45.3%
20 20 20
Style
Places 27.1% 18.2% 16.5%
167 51 51
AlexNet 32.9% 26.1% 26.5%
158 74 74
VGG 39.3% 30.0% 30.3%
219 76 76
Residual
Places 24.9% 23.6% 19.8%
1000 1000 1000
AlexNet 17.8% 21.9% 22.5%
1000 1000 1000
VGG 27.4% 26.2% 24.3%
1000 1000 1000

Background color
pool5 fc6 fc7
Factor
Places 42.3% 50.7% 55.6%
18 15 15
AlexNet 31.3% 30.6% 27.3%
20 20 20
VGG 16.2% 22.1% 21.9%
19 16 16
Style
Places 36.8% 26.0% 25.4%
194 55 55
AlexNet 50.6% 44.4% 47.4%
194 116 116
VGG 64.0% 54.9% 56.2%
263 127 127
Residual
Places 20.8% 23.3% 19.0%
1000 1000 1000
AlexNet 18.1% 25.1% 25.3%
1000 1000 1000
VGG 19.8% 23.0% 21.8%
1000 1000 1000

Chairs

Rotation
pool5 fc6 fc7
Factor
Places 8.2% 5.0% 4.8%
9 7 7
AlexNet 8.8% 4.2% 4.1%
9 7 7
VGG 5.7% 3.7% 3.4%
11 7 7
Style
Places 40.8% 54.8% 60.1%
271 101 101
AlexNet 42.9% 56.6% 60.9%
244 199 199
VGG 39.7% 57.0% 62.5%
380 168 168
Residual
Places 51.0% 40.1% 35.1%
1000 1000 1000
AlexNet 48.3% 39.2% 34.9%
1000 1000 1000
VGG 54.5% 39.3% 34.0%
1000 1000 1000

2D translation
pool5 fc6 fc7
Factor
Places 28.1% 21.1% 14.8%
11 6 6
AlexNet 30.1% 18.1% 11.3%
12 7 7
VGG 22.8% 16.2% 9.0%
14 7 7
Style
Places 13.8% 35.3% 55.4%
170 76 76
AlexNet 13.3% 34.4% 52.6%
142 165 165
VGG 11.3% 41.6% 64.3%
260 164 164
Residual
Places 58.1% 43.6% 29.8%
1000 1000 1000
AlexNet 56.6% 47.5% 36.1%
1000 1000 1000
VGG 65.9% 42.1% 26.7%
1000 1000 1000

Scale
pool5 fc6 fc7
Factor
Places 13.6% 10.4% 9.7%
2 2 2
AlexNet 14.0% 9.4% 9.1%
2 2 2
VGG 12.2% 10.4% 9.6%
3 2 2
Style
Places 47.0% 55.5% 61.4%
239 93 93
AlexNet 49.4% 56.2% 60.2%
207 195 195
VGG 45.8% 56.2% 62.4%
347 174 174
Residual
Places 39.5% 34.0% 28.9%
1000 882 882
AlexNet 36.5% 34.4% 30.7%
1000 1000 1000
VGG 42.1% 33.3% 28.0%
1000 1000 1000

Foreground color
pool5 fc6 fc7
Factor
Places 12.7% 16.5% 22.4%
15 12 12
AlexNet 12.2% 11.6% 13.2%
15 15 15
VGG 7.5% 13.3% 16.3%
14 13 13
Style
Places 59.6% 51.9% 50.8%
410 129 129
AlexNet 67.1% 62.8% 62.3%
386 263 263
VGG 67.6% 60.6% 60.3%
551 205 205
Residual
Places 27.7% 31.5% 26.8%
1000 1000 1000
AlexNet 20.7% 25.6% 24.5%
1000 1000 1000
VGG 24.9% 26.0% 23.3%
1000 1000 1000

Background color
pool5 fc6 fc7
Factor
Places 14.5% 17.9% 23.7%
16 13 13
AlexNet 10.3% 8.3% 7.7%
18 18 18
VGG 5.4% 8.8% 9.5%
17 15 15
Style
Places 58.9% 49.1% 49.5%
448 135 135
AlexNet 69.9% 66.6% 68.3%
416 303 303
VGG 73.5% 67.8% 69.2%
605 273 273
Residual
Places 26.6% 33.0% 26.8%
1000 1000 1000
AlexNet 19.8% 25.2% 24.0%
1000 1000 1000
VGG 21.1% 23.4% 21.3%
1000 1000 1000

Beds

Rotation
pool5 fc6 fc7
Factor
Places 10.5% 8.8% 9.0%
14 9 9
AlexNet 10.9% 7.7% 6.9%
13 10 10
VGG 8.0% 7.3% 6.5%
14 9 9
Style
Places 29.1% 39.9% 46.7%
114 59 59
AlexNet 30.9% 42.8% 49.3%
105 82 82
VGG 28.0% 45.0% 52.4%
131 76 76
Residual
Places 60.3% 51.3% 44.3%
1000 988 988
AlexNet 58.2% 49.5% 43.8%
1000 1000 1000
VGG 64.0% 47.8% 41.1%
1000 1000 1000

2D translation
pool5 fc6 fc7
Factor
Places 28.7% 21.5% 14.4%
10 7 7
AlexNet 29.6% 19.8% 11.8%
10 7 7
VGG 20.4% 15.2% 7.9%
13 7 7
Style
Places 12.9% 33.6% 56.3%
101 49 49
AlexNet 13.2% 32.7% 52.8%
89 78 78
VGG 11.2% 41.0% 65.4%
115 79 79
Residual
Places 58.4% 44.9% 29.3%
1000 946 946
AlexNet 57.2% 47.5% 35.5%
1000 1000 1000
VGG 68.4% 43.7% 26.7%
1000 1000 1000

Scale
pool5 fc6 fc7
Factor
Places 12.6% 9.7% 8.6%
2 2 2
AlexNet 12.1% 9.6% 9.7%
2 2 2
VGG 10.3% 8.4% 8.0%
2 2 2
Style
Places 46.4% 54.2% 60.7%
114 55 55
AlexNet 49.4% 54.5% 58.4%
103 84 84
VGG 46.0% 56.8% 62.1%
129 80 80
Residual
Places 41.0% 36.0% 30.7%
879 454 454
AlexNet 38.5% 35.9% 31.8%
695 595 595
VGG 43.7% 34.8% 29.9%
969 515 515

Foreground color
pool5 fc6 fc7
Factor
Places 14.3% 18.8% 24.9%
17 13 13
AlexNet 13.0% 13.9% 14.3%
16 15 15
VGG 7.7% 14.2% 16.8%
17 15 15
Style
Places 55.9% 48.2% 47.7%
147 68 68
AlexNet 64.8% 61.6% 62.0%
138 97 97
VGG 65.9% 59.2% 59.3%
165 93 93
Residual
Places 29.8% 33.0% 27.3%
1000 1000 1000
AlexNet 22.2% 24.5% 23.7%
1000 1000 1000
VGG 26.4% 26.6% 23.9%
1000 1000 1000

Background color
pool5 fc6 fc7
Factor
Places 17.5% 21.6% 27.7%
15 12 12
AlexNet 12.0% 11.1% 9.7%
18 17 17
VGG 6.1% 10.5% 11.5%
17 14 14
Style
Places 56.8% 45.3% 46.2%
158 75 75
AlexNet 67.8% 64.1% 66.3%
153 118 118
VGG 73.7% 66.9% 67.9%
177 115 115
Residual
Places 25.7% 33.1% 26.1%
1000 1000 1000
AlexNet 20.1% 24.8% 24.0%
1000 1000 1000
VGG 20.1% 22.6% 20.6%
1000 1000 1000

Sofas

Rotation
pool5 fc6 fc7
Factor
Places 14.2% 11.3% 9.2%
12 9 9
AlexNet 15.1% 10.9% 9.8%
11 7 7
VGG 12.5% 9.6% 8.2%
12 8 8
Style
Places 24.8% 35.3% 41.1%
162 58 58
AlexNet 26.3% 38.4% 44.7%
143 91 91
VGG 24.1% 40.0% 47.5%
208 82 82
Residual
Places 61.0% 53.4% 49.7%
1000 829 829
AlexNet 58.6% 50.7% 45.5%
1000 1000 1000
VGG 63.3% 50.4% 44.3%
1000 1000 1000

2D translation
pool5 fc6 fc7
Factor
Places 45.6% 35.2% 25.0%
14 8 8
AlexNet 47.8% 33.2% 21.7%
13 9 9
VGG 37.4% 26.2% 14.0%
17 10 10
Style
Places 9.7% 27.3% 48.3%
141 43 43
AlexNet 9.4% 26.7% 45.4%
119 84 84
VGG 8.4% 35.6% 60.9%
181 90 90
Residual
Places 44.7% 37.6% 26.7%
1000 1000 1000
AlexNet 42.7% 40.1% 32.8%
1000 1000 1000
VGG 54.2% 38.2% 25.1%
1000 1000 1000

Scale
pool5 fc6 fc7
Factor
Places 24.5% 18.5% 13.5%
2 2 2
AlexNet 24.7% 20.1% 19.2%
2 2 2
VGG 21.5% 16.8% 16.1%
3 2 2
Style
Places 38.9% 48.3% 57.2%
152 44 44
AlexNet 40.1% 45.8% 48.8%
135 93 93
VGG 39.0% 49.8% 53.7%
202 91 91
Residual
Places 36.6% 33.2% 29.4%
929 456 456
AlexNet 35.2% 34.0% 32.0%
789 651 651
VGG 39.5% 33.4% 30.2%
1000 580 580

Foreground color
pool5 fc6 fc7
Factor
Places 24.9% 30.8% 35.5%
18 14 14
AlexNet 25.6% 26.2% 24.6%
17 17 17
VGG 15.3% 22.7% 24.9%
18 16 16
Style
Places 44.3% 37.7% 37.8%
247 63 63
AlexNet 51.6% 47.8% 50.0%
234 110 110
VGG 57.0% 49.7% 50.0%
307 104 104
Residual
Places 30.7% 31.5% 26.7%
1000 1000 1000
AlexNet 22.8% 26.0% 25.4%
1000 1000 1000
VGG 27.7% 27.6% 25.1%
1000 1000 1000

Background color
pool5 fc6 fc7
Factor
Places 29.0% 33.0% 38.7%
17 13 13
AlexNet 20.9% 19.9% 17.1%
19 18 18
VGG 10.7% 16.2% 16.9%
17 14 14
Style
Places 44.8% 34.7% 36.0%
288 76 76
AlexNet 57.9% 53.3% 56.6%
274 153 153
VGG 68.3% 60.4% 61.5%
362 153 153
Residual
Places 26.2% 32.4% 25.3%
1000 1000 1000
AlexNet 21.2% 26.7% 26.3%
1000 1000 1000
VGG 20.9% 23.4% 21.5%
1000 1000 1000

Toilets

Rotation
pool5 fc6 fc7
Factor
Places 13.6% 10.0% 8.0%
9 9 9
AlexNet 13.7% 8.5% 6.9%
9 8 8
VGG 11.0% 8.2% 7.1%
10 7 7
Style
Places 33.1% 46.4% 51.6%
81 48 48
AlexNet 33.9% 48.6% 54.2%
79 63 63
VGG 31.5% 48.8% 54.6%
94 60 60
Residual
Places 53.3% 43.6% 40.4%
1000 734 734
AlexNet 52.4% 42.9% 38.9%
1000 851 851
VGG 57.5% 43.0% 38.3%
1000 811 811

2D translation
pool5 fc6 fc7
Factor
Places 33.1% 26.1% 18.3%
12 7 7
AlexNet 33.7% 22.4% 13.4%
13 8 8
VGG 26.1% 18.7% 9.1%
16 9 9
Style
Places 11.6% 31.1% 50.9%
64 38 38
AlexNet 10.9% 31.2% 50.9%
62 54 54
VGG 9.4% 40.1% 65.5%
80 54 54
Residual
Places 55.3% 42.8% 30.9%
1000 741 741
AlexNet 55.4% 46.4% 35.7%
1000 840 840
VGG 64.5% 41.2% 25.4%
1000 867 867

Scale
pool5 fc6 fc7
Factor
Places 15.3% 14.8% 17.4%
2 2 2
AlexNet 14.3% 11.2% 10.4%
2 2 2
VGG 12.0% 10.9% 10.2%
3 2 2
Style
Places 45.4% 51.1% 54.3%
72 42 42
AlexNet 49.7% 55.4% 60.2%
67 60 60
VGG 47.3% 57.3% 63.1%
83 55 55
Residual
Places 39.3% 34.0% 28.3%
566 340 340
AlexNet 36.0% 33.5% 29.4%
462 448 448
VGG 40.7% 31.8% 26.7%
664 379 379

Foreground color
pool5 fc6 fc7
Factor
Places 17.1% 22.8% 27.8%
17 13 13
AlexNet 15.4% 16.2% 16.7%
17 16 16
VGG 11.1% 19.0% 21.8%
17 16 16
Style
Places 57.5% 50.5% 48.8%
84 46 46
AlexNet 66.4% 62.1% 61.8%
82 67 67
VGG 65.2% 57.7% 56.7%
99 62 62
Residual
Places 25.4% 26.7% 23.3%
1000 968 968
AlexNet 18.1% 21.8% 21.5%
1000 1000 1000
VGG 23.7% 23.3% 21.5%
1000 1000 1000

Background color
pool5 fc6 fc7
Factor
Places 18.3% 24.8% 29.8%
16 13 13
AlexNet 12.2% 11.4% 9.9%
18 17 17
VGG 6.9% 11.2% 11.6%
17 13 13
Style
Places 60.1% 48.4% 47.6%
96 54 54
AlexNet 72.0% 68.5% 70.2%
93 80 80
VGG 77.5% 71.4% 71.9%
108 76 76
Residual
Places 21.6% 26.8% 22.6%
1000 1000 1000
AlexNet 15.8% 20.1% 19.9%
1000 1000 1000
VGG 15.6% 17.4% 16.5%
1000 1000 1000