Skip to content

Conversation

@Flamefire
Copy link
Contributor

In TF 2.4 some new dependencies are used and SWIG was finally removed. As in 2.4+ the flatbuffers python package is required I generalized the handling of such split-dependencies (1 EB + 1 Python dependency) so that is handled correctly

For some dependencies the EB dependency AND the python package must be present.
Example: protobuf
@boegel boegel changed the title Update TF EasyBlock for TF 2.4 Update TensorFlow easyblock for TensorFlow 2.4 Nov 9, 2020
@boegel boegel added the update label Nov 9, 2020
@boegel boegel added this to the 4.3.2 milestone Nov 9, 2020
Copy link
Member

@boegel boegel left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

lgtm, test reports coming up...

system_libs.append(tf_name)
# If it is in deps_with_python_pkg we already added it
if tf_name not in deps_with_python_pkg:
system_libs.append(tf_name)
Copy link
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

FTR: Here a set could be used and the check removed. However this approach might be able to catch mistakes when a tf_name is added multiple times although it shouldn't

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

👍

@boegel
Copy link
Member

boegel commented Nov 9, 2020

Test report by @boegel

Overview of tested easyconfigs (in order)

  • SUCCESS TensorFlow-1.15.0-foss-2019b-Python-3.7.4.eb
  • SUCCESS TensorFlow-2.1.0-foss-2019b-Python-3.7.4.eb
  • SUCCESS TensorFlow-2.2.0-foss-2019b-Python-3.7.4.eb
  • SUCCESS TensorFlow-2.3.1-foss-2020a-Python-3.8.2.eb

Build succeeded for 4 out of 4 (4 easyconfigs in total)
node3414.kirlia.os - Linux centos linux 7.8.2003, x86_64, Intel(R) Xeon(R) Gold 6240 CPU @ 2.60GHz (cascadelake), Python 2.7.5
See https://gist.github.com/757e1c60b89ec7add14d4c642206c610 for a full test report.

@boegel
Copy link
Member

boegel commented Nov 9, 2020

Thanks @Flamefire!

@boegel boegel merged commit 8459c5c into easybuilders:develop Nov 9, 2020
@Flamefire Flamefire deleted the tf2.4 branch November 9, 2020 16:12
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants