running time of ResNets

[1292765944]

In resnet's paper, it claims that Resnet50/101/152 have lower FLOPS compared to VGG16/19. However, I get much longer forward running time in Resnets than VGG-nets, e.g., Resnet 152 is 4~5 times longer than VGG16). Does anyone encounter similar problem?

[aabobakr]

This is the running time of a forward pass for each of these models on a CPU and a TITAN-X GPU

                               CPU            TITAN-X GPU
        VGG16                648  ms             25 ms   
        ResNet-50            544  ms             18 ms
        ResNet-101           1072 ms             33 ms           
        ResNet-152           1584 ms             43 ms

[1292765944]

@aabobakr I have similar running time on ResNet-50/101/152. However, I run VGG16 using caffe(with cudnn 5.1, TITAN X GPU maxwell), it only costs me 12ms.
By the way, what do you think about the relationship between FLOPS and running time?

Best!

[408550969]

Hi,does anyone test the speed of resnet-18? Thanks!

[aabobakr]

This is the running time of a forward pass of different models a Core i-7 CPU and a TITAN-X GPU: the time is average over 1000 iterations.

                           Core-i7 CPU         TITAN-X GPU
        VGG11                155  ms             13 ms
        VGG16                280  ms             24 ms   
        ResNet-18            52   ms             4  ms
        ResNet-34            97   ms             8  ms
        ResNet-50            544  ms             18 ms
        ResNet-101           1072 ms             33 ms           
        ResNet-152           1584 ms             43 ms

[408550969]

Thanks!