Break down data layer and metrics changes into smaller PRs

[Mohamedma96]

This issue tracks the breakdown of a previously large PR into smaller, focused changes to improve review-ability and reduce risk.

Planned PRs:

• Automatically add Data section when data layer is enabled.
• Unit test fixes - Add missing test cases for new datalayer metrics.
• E2E improvements: CRD existence validation and cluster/context logging,
• Add Datalayer Integration tests and harness.go refactor.
• Enable data layer by default.

Each PR will be submitted and reviewed independently.

[Mohamedma96]

/assign