GSK-2819 Pydantic models cannot be serialised with our code

[kevinmessiaen]

Description

Issue

By default we try to serialise models by value using cloudpickle in order to be able to execute them in ML Worker without having to install the referenced dependency. However cloudpickle is not able to serialise everything causing the serialisation to fail.

Solution

For complex code that aren't pickable, it's always possible to save the code in a module and install it into the ML worker. Therefore when cloudpickle fail to save objects by value, we fallback into saving by reference with a warning.

Related Issue

• GSK-2819 (Available on Linear)

Type of Change

• 📚 Examples / docs / tutorials / dependencies update
• 🔧 Bug fix (non-breaking change which fixes an issue)
• 🥂 Improvement (non-breaking change which improves an existing feature)
• 🚀 New feature (non-breaking change which adds functionality)
• 💥 Breaking change (fix or feature that would cause existing functionality to change)
• 🔐 Security fix

[linear]

GSK-2819 Pydantic models cannot be serialised with our code

[sonarqubecloud]

Quality Gate passed

Issues
0 New issues

Measures
0 Security Hotspots
100.0% Coverage on New Code
0.0% Duplication on New Code

See analysis details on SonarCloud