I found that there is no moving_average_mean/var, which is necessary in BatchNorm. Is it ok?

[clks-wzz]

Hello, sir. I found that there is no moving_average_mean/var, which is necessary in BatchNorm. Is it ok for GroupNorm?

[Bingohong]

i found the same problem there is no moving_average process. how is to compute gn in test step?

[Bingohong]

@shenekeng853 i add the ema process, maybe you can try it https://github.com/Bingohong/GroupNormalization-tensorflow/blob/master/README.md