dwmatrix = create_downsample_fn_matrix(self.num_branches, features, self.num_branches, output_channels) should be dwmatrix = create_downsample_fn_matrix(self.num_branches, features, self.num_outputs, output_channels)