vdk-core: extend configuration to all hooks

[DeltaMichael]

Overview

Currently, we can add config options only in the vdk_configure hook. However, this doesn't fit all use cases. We might want to add configuration based on job-specific properties, e.g. secrets. This has lead to hacky solutions in the past #3125

Acceptance criteria

1. Suggest a way to extend adding configuration to other hooks
2. Create a design doc and sync it with the team + stakeholders

Also related

#3125 (comment)