Building wheels : manylinux1 or manylinux2010?

[pramodk]

This is not a bug but a placeholder ticket to track and discuss about which platform to use for building wheel : manylinux1 or manylinux2010.

I will start adding the relative links here. I will summarise the status later:

• A good read to start with : arrow and tensorflow historical issues: https://uwekorn.com/2019/09/15/how-we-build-apache-arrows-manylinux-wheels.html
• Introductory tutorial : https://developers.redhat.com/blog/2019/09/27/python-wheels-ai-ml-and-abi-compatibility/
• Recommendation for manylinux2010 or manylinux1 : Manylinux/GCC versions pypa/cibuildwheel#303
• PR in arrow package and how that is affected by pytorch/TF : ARROW-4025: [Python] Avoid pthread_once in ThreadPool apache/arrow#3177
• Discussion on google forum about handling TensorfFlow, PyTorch and manylinux1 compatibility : https://groups.google.com/a/tensorflow.org/forum/#!topic/build/WgtWKA4t_bs
• See the notes from conference call : https://docs.google.com/document/d/1uYZK2jQtDUPpo3AHe18ZCH1jS9be9s8zR3axLR1SOG0/edit#heading=h.7sjot6x53yvw
• Discussion about manylinux2010 support : CentOS 5 support ends soon pypa/manylinux#96
• manylinux2010 wheel will require users to upgrade pip : Tensorflow v2.0rc* is impossible to install with pip 18.1 tensorflow/tensorflow#32698
• Mixing C++17, C++14, and C++11 objects : https://stackoverflow.com/questions/46746878/is-it-safe-to-link-c17-c14-and-c11-objects/49119902#49119902
• C++14 on manylinux1 : mostly wrong / incompatible ideas : Cannot build C++14 in docker images pypa/manylinux#118
• An example of ABI issue with manylinux1: https://mail.python.org/pipermail/wheel-builders/2016-August/000202.html
• RAPIDS dropping pip, why? : https://medium.com/rapids-ai/rapids-0-7-release-drops-pip-packages-47fc966e9472
• Discussion about next manylinux spec and insightful discussion about compatibility aspects : https://discuss.python.org/t/the-next-manylinux-specification/1043/29
• GCC 4.8.2 bug with const_iterator for erase : https://stackoverflow.com/questions/19559235/missing-const-iterator-overload-of-stdvectorerase-with-g-4-8
• nlohmann/json was min 4.9 but it's changed to 4.8 support gcc 4.8.1 nlohmann/json#212

[pramodk]

This question was well understood - until 8.0 we will do manylinux1 compatible wheels. After that, in order to support CoreNEURON with GPU and other optimised builds, we will move to manylinux2010.