When I used shufflenet to train models on my own dataset, I found shufflenet has high accuracy on two-class classification probelm while low accuracy on multi-class problem.
I used finetuning based on officially released pretrained model. Is it unproper to use pretrained model when training multi-class dataset?