Allow resource allocation

[anwbtom]

Proposed changes

Problem: When using autoscaling kubernetes clusters based on resource requests (like Karpenter implemenations or fargate kind of setups), pods will get evicted when the request 0 cpu and memory whilst the node it landed on is strapped for one of those resources, this change will give use the capability to set resource requests & limits in a way users see fit.

Solution: Allow use to set resource values (https://kubernetes.io/docs/concepts/configuration/manage-resources-containers/#resource-requests-and-limits-of-pod-and-container)

Testing: Tested by overriding the default clusters and checking in k8s if resource settings where taken over.

Checklist

Before creating a PR, run through this checklist and mark each as complete.

• I have read the CONTRIBUTING doc
• I have added tests that prove my fix is effective or that my feature works
• I have checked that all unit tests pass after adding my changes
• I have updated necessary documentation
• I have rebased my branch onto main
• I will ensure my PR is targeting the main branch and pulling from my branch from my own fork

Release notes

If this PR introduces a change that affects users and needs to be mentioned in the release notes,
please add a brief note that summarizes the change.

 Add capability to set resource requests and limits on nginx-gateway deployment

[kate-osborn]

@anwbtom can you run make generate-helm-docs and commit the changes? That should fix the pipeline

[anwbtom]

Thanks for the tip @kate-osborn, just ran the command and it only made a change in the readme of the chart.
Hopefully that fixes stuff & things :)

[codecov]

Codecov Report

All modified and coverable lines are covered by tests ✅

Project coverage is 87.62%. Comparing base (25f2b89) to head (81d33d9).

Additional details and impacted files

@@           Coverage Diff           @@
##             main    #2216   +/-   ##
=======================================
  Coverage   87.62%   87.62%           
=======================================
  Files          96       96           
  Lines        6715     6715           
  Branches       50       50           
=======================================
  Hits         5884     5884           
  Misses        774      774           
  Partials       57       57           

☔ View full report in Codecov by Sentry.
📢 Have feedback on the report? Share it here.