What is pad_mask?

[ian860505]

Sorry for bothering.
I can't understand where is the batch['pad_mask'] from?
Is its definition from results['pad_mask']?

or, does it have something to do with the 'mask' in the following image?

[guillembraso]

Hi,

Sorry for my late reply, I've been sick.

It's the second option: it's coming from results['pad_mask'], and it has nothing to do with the screenshot you sent. When images are resized, to fit a certain aspect ratio, some additional padding might be added on the left/right or top/bottom sides. 'pad_mask' indicates which regions of the image are just padding, and which ones are actual pixels.

Hope this made it clear!

Guillem

[ian860505]

Thank you for your reply! I hope you feel better soon.

Could you give an example?
What are the shapes and values of masks and pad_mask in a batch?

[aayushsingla]

Hi, I am facing this issue with masks too. Can someone explain what these masks are and where do they come from? are these segmentation masks or something else? I am confused as there is nothing mentioned in the paper about use or need of segmentation masks but DETR needs segmentation masks. Please correct me if I am wrong. @ian860505 @guillembraso

[ian860505]

@aayushsingla You can check the funtion _get_mask. These masks come from the definition of dataset in mmpose. The pad_mask is from the data augmentation pipeline results['pad_mask'](train pipeline) and pad_masks (test pipeline)

[aayushsingla]

@ian860505 Thanks! This was exactly what I needed.