Benchmarking GPUs for using MACE

[SeungJay]

Hi all,

Choosing the right GPUs for this model appears to be very important. While many recommend high-end NVIDIA GPUs, I haven't been able to find any benchmarks to support these claims.

Would anyone be able to share benchmarks for MACE using different GPUs? It would be incredibly helpful to compare speed, accuracy, and memory usage across inference steps with a pretrained model, as well as during training.

It seems NVIDIA chips fall into four main classes: GTX, RTX (e.g., RTX 3090, RTX 4090), Quadro (e.g., A6000), and data center GPUs (e.g., V100, A100, H100).

Thanks for your consideration.

Best,
Jay

[lucasdekam]

Ilyes shared an image here with an A100 benchmark, if that helps: #946
In my experience, H100 seems about 1.5 times as fast as A100.

[SeungJay]

Thanks @lucasdekam ! This information is so useful :D