misc: Pagerduty issue template change (#4796)

* misc: Pagerduty issue template change

Pagerduty issue template change to seek more information for validating the criticality of the issue.

* Update pager-duty.yaml

* Update pager-duty.yaml

* Update pager-duty.yaml

* feat: Adding script to calculate score for pagerduty issues (#4832)

* feat: active inactive user phase 3 (#4649)

* listing user and group changes

* default value chnage

* group listing optimisation

* wire_gen

* order by in group

* default values

* discard

* updated on

* case insensitive

* script number change

* specs

* review chnages

* sql update

* id for user

* script number chnage

* review comments-1

* review comments

* review comments

* rest handler remove methods

* validation for delete

* delete user handling

* review comments

* review comments

* bulk delete user and permission group

* legacy code fix from loop in query to bulk query

* export csv filters support

* Revert "export csv filters support"

This reverts commit 4448c9e.

* export csv filters

* bulk delete support with filters

* validation

* method break

* refactor the method

* condition

* open api  specs

* specs

* refactoring filters in bulk delete rolegroup

* comments

* comments

* script

* group listing

* review comments

* review comments

* review comments

* review comments

* user delete self-review

* error handling

* renaming helpers

* commets

* checks and renaming

* last login order

* script number change

* rolegroup migration

* name change

* backward compatibility handling

* self review name change

* chart-group -manager-fix

* userrolegroups

* change chnage operation

* specs update

* groups

* find by componet id

* job project id

* sql script chnage

* script number change

* fix: extra check added for mono-repo migraiton (#4764)

* extra check added for mono-repo migraiton

* comparison of repoNameWithoutPrefix and appstore name for mono repo condition

* refactor

* remove prefix

* fix

* remove-gitops-prefix-oss

* refactor

* refactor

* refactor

* added request method in audit logger (#4817)

* fix:  rolefilters correction with all applications and particular application selected. (#4820)

* merging issue resolved

* all namespace, cluster, kind remove as it is used in key

* removing unnecessary code

* fix: 5xx 4.0 iter (#4620)

* bugs revert

* 4th iter code changes

* delete dag exec

* initial poc (ongoing) of handling grpc errors

* grpc error handling at install helm chart and template services

* refactoring

* refactor

* code review changes with some refactoring

* removed unused files

* refactor

* chore: refactoring v4 (#4775)

* removed registerInArgo multiple impls

* extracted app metrics code

* migrated envLevel app metrics code to new service

* chore: Removed unused jira and migration  integration (#4498)

* removed unsued jira integration

* removed test-suite-code

* db migration conf removal

* chore: removed unused injection

* chore: removed dead code

* added: migration script

---------

Co-authored-by: Ash-exp <[email protected]>

* chore: App store dead code cleanup and restructuring  (#4497)

* moved chart-group in seperate code

* removed unused dependency

* removed dead code

* extracted resource tree

* moved notes

* resource movement

* removed unused code

* removed unused dependency

* commit methods

* extracted status update

* chore: clean up unused dead code

* updated: EA mode docker file

* updated: migration number

---------

Co-authored-by: Ash-exp <[email protected]>

* chart ref refactoring

* removed infra metrics db calls

* moved app metrics repositories from /internal to /pkg

* moved: const and types to bean

* removed: unused const

* review comments

* migrated some methods from chartService to chartRefService

* added dt validation service interface

* minor refactoring

* moved validation method - 1

* wip

* removed redundant appMetrics req obj

* moved app metrics bindings  to wireset

* removed multiple dead code

* remove redundant dependency

* moved ChartGroup router and rest handler to respective folder

* stage 1

* gitOps refactoring

* moved gitClient code to a common wrapper service

* chore: AppStoreDeployment Install flow refactoring

* review changes

* wip

* fix for unsupported charts

* refactoring: App Store deployment services

* minor cleanup

* renamed remote package to git

* renamed gitOpsRemoteOpService If and impl

* migrated usages of gitService to gitOperationService

* shifted git service and all gitOps clients to pkg

* gitops repository usages refactor

* refactored gitOpsRepository usages

* gitlab client creation refactoring

* renamed util/ChartService

* reverted renaming changes

* reverted renaming changes

* reverted renaming changes

* wip

* wip

* removed typo

* changes

* changes

* extracted trigger cd, nats subscriptions from wfDAGExec service

* removed gitOpsRepoName fetch logic duplicacy

* minor change for cd trigger method

* removed redundant imports

* extracted deployment bulk trigger publish event logic from workflowDag

* extracted manifest creation code from WorkflowDagExecutor

* moved WorkflowStatusUpdateHandler

* removed old refactored code

* wip - extracted k8s op method from workflowDAG part 1

* extracted artifact logic from workflowDAG

* extracted artifact logic from workflowDAG

* refactoring

* replaced slices -> k8s.io/utils/strings/slices import

* replaced slices -> k8s.io/utils/strings/slices import

* fix prod bug

* renamed PrePostStageTriggerService -> preStageTriggerService

* fix for rollback

* wip

* refactoring pre & post stage service

* updated PreCdTriggerService

* migrated AsyncTrigger consumer to eventProcessor

* review comments

* removed whitespaces

* migrated ci material topic to processor service

* migrated argo app status subsciption to common processor pkg

* migrated argo type pipeline publish and process to common pkg

* migrated appstore bulk deploy topic

* migrated cd bulk deploy topic

* migrated appstore helm install status topic

* migrated git webhook event publish

* minor changes in manifest creation service

* minor changes in cd trigger service

* minor changes in cd trigger service

* wip

* minor change in async helm install req handling

* wip

* updated common lib version(synced with main)

* safety check for concurrency in pipeline delete and asyn trigger

* updated common-lib version

* updated common-lib version to main 5807b130153800727ace993e98b24cb27b8fc1fa

---------

Co-authored-by: Nishant <[email protected]>
Co-authored-by: Ash-exp <[email protected]>
Co-authored-by: nishant <[email protected]>

* fix: hide ldap creds in in get req (#4788)

* hide ldap creds in in get req

* removed unnecessary code

* refactor

* revert

* refactor

* pointer binding (#4826)

* Adding script to calculate score for pagerduty issues

* Update github_pagerduty_issue_score_calculation.py

* feat: Branch Divergence Checker Plugin (#4806)

* Branch Divergence Checker Plugin

* Delete scripts/sql/229_GitHub_branch_divergence_checker_v1.0.down.sql

* Delete assets/GitHubBranchDivergenceCheckerlogo.png

* Adding assets

* Changing asset name

* Removing asset

* Update 229_github_branch_divergence_checker.up.sql

* feat: Added Apply job in k8s plugin (#4828)

* feat: Added Devtron CI Trigger Plugin v1.0.0

* feat: Added Apply JOB in k8s Plugin

* modified structure

* Added error handelling

* Removed CI trigger plugin

* Migration number changed

* logo changed

* feat: Information of Linked CI Pipelines on Parent CI Pipeline (#4786)

* Refactor ArgoUserService.go by adding a TODO

* wip

* updated API spec

* Update repo and service

* Add logging of errors

* modified API spec

* added total count in query

* updated service and rest handler layer

* Update router and resthandler

* set default req params at rest handler

* moved generics to global util

* Update resthandler

* added tracing for new queries

* fixed undefined ctx

* Update handler's rbac

* update error logs

* Update cipipeline repo

* added: comments for changes

* Change handler

* fixed typo and imports

* fixed adapter and constants

* updated test file errors and mock files

* updated API specs

* fixed API specs end points

* fixed: query errors

* fixed: linked cd condition

* fixed: typo

* fixed: search

* fixed nil check for runner query

* fixed: append in adapter

* fix searchkey to lowercase

* Fix duplicated env names

* fix pass env array as empty

* Fix error logs

* fix error

* fixed import

---------

Co-authored-by: komalreddy3 <[email protected]>

* Update github_pagerduty_issue_score_calculation.py

* Update github_pagerduty_score_calculation.yml

* Update github_pagerduty_score_calculation.yml

* Update github_pagerduty_issue_score_calculation.py

* Update github_pagerduty_issue_score_calculation.py

* Update github_pagerduty_score_calculation.yml

* feat:Github Pull Request Closer (#4833)

* PR plugin script

* Update 230_Github_Pull_Request_Closer.up.sql

* Update 230_Github_Pull_Request_Closer.up.sql

* Update 230_Github_Pull_Request_Closer.up.sql

* Rename 230_Github_Pull_Request_Closer.down.sql to 231_Github_Pull_Request_Closer.down.sql

* Rename 230_Github_Pull_Request_Closer.up.sql to 231_Github_Pull_Request_Closer.up.sql

* Rename GithubReleasePR.png to GithubPullRequest-Plugin-logo.png

* Update 231_Github_Pull_Request_Closer.up.sql

---------

Co-authored-by: Prakarsh <[email protected]>

* chore: Image scanning refactoring (#4802)

* added sql

* updated event type for job in workflow request

* added comments, handling for global cm/cs

* fixed json string global cmcs

* updated global cm/cs spec

* wip

* updated sql script number

* updated sql script number

* Update github_pagerduty_score_calculation.yml

* Update github_pagerduty_issue_score_calculation.py

* Update github_pagerduty_score_calculation.yml

* Update github_pagerduty_issue_score_calculation.py

* fix: helm deployements stucked in queued for devtron apps (#4842)

* ns not found in case ips is being injected in cluster (#4844)

* Delete .github/github_pagerduty_issue_score_calculation.py

---------

Co-authored-by: Shivam Nagar <[email protected]>
Co-authored-by: Prakash <[email protected]>
Co-authored-by: Raunit Verma <[email protected]>
Co-authored-by: kartik-579 <[email protected]>
Co-authored-by: Nishant <[email protected]>
Co-authored-by: Ash-exp <[email protected]>
Co-authored-by: nishant <[email protected]>
Co-authored-by: Kiran <[email protected]>
Co-authored-by: komalreddy3 <[email protected]>
Co-authored-by: Prakarsh <[email protected]>

* Adding scritps to calculate score (#4848)

* Adding scritps to calculate score

* Update github_pagerduty_score_calculation.yml

---------

Co-authored-by: Prakarsh <[email protected]>

---------

Co-authored-by: Yashasvi17 <[email protected]>
Co-authored-by: Shivam Nagar <[email protected]>
Co-authored-by: Prakash <[email protected]>
Co-authored-by: Raunit Verma <[email protected]>
Co-authored-by: kartik-579 <[email protected]>
Co-authored-by: Nishant <[email protected]>
Co-authored-by: Ash-exp <[email protected]>
Co-authored-by: nishant <[email protected]>
Co-authored-by: Kiran <[email protected]>
Co-authored-by: komalreddy3 <[email protected]>

Author: 11 people

.github/ISSUE_TEMPLATE/pager-duty.yaml

@@ -18,15 +18,66 @@ body:
       description: "A clear and concise description of what the bug is."
       placeholder: "It bugs out when ..."
   - type: dropdown
-    id: criticality
+    id: affected-areas
     attributes:
-      label: "Criticality"
-      description: "How critical is the issue? Please include the impact in the  "
+      label: "Affected areas"
+      description: "What areas of Devtron are impacted by the issue?"
       options:
-        - P0 - Critical/Blocking
-        - P1 - High
-        - P2 - Medium
-        - P3 - Low
+        - Devtron dashboard completely down 
+        - Login issues 
+        - RBAC Issues 
+        - CI 
+        - CD 
+        - App creation 
+        - Deployment from Chart store 
+        - Security features 
+        - CI/CD Plugins 
+        - Other CRITICAL functionality 
+        - Other NON-CRITICAL functionality
+  - type: dropdown
+    id: additional-affected-areas
+    attributes:
+      label: "Additional affected areas"
+      description: "Are there any additional affected areas?"
+      options:
+        - Devtron dashboard completely down 
+        - Login issues 
+        - RBAC Issues 
+        - CI 
+        - CD 
+        - App creation 
+        - Deployment from Chart store 
+        - Security features
+        - CI/CD Plugins 
+        - Other CRITICAL functionality 
+        - Other NON-CRITICAL functionality 
+  - type: dropdown
+    id: prod-environment
+    attributes:
+      label: "Prod/Non-prod environments?"
+      description: "Is the issue affecting Prod environments?"
+      options:
+        - Prod 
+        - Non-prod 
+  - type: dropdown
+    id: user-unblocked
+    attributes:
+      label: "Is User unblocked?"
+      description: "Is the User unblocked?"
+      options:
+        - Yes 
+        - No 
+  - type: dropdown
+    id: user-unblocked-reason
+    attributes:
+      label: "How was the user un-blocked?"
+      description: "If the user was unblocked. How was the user un-blocked?"
+      options:
+        - TEMPORARILY - By disabling a CRITICAL functionality 
+        - TEMPORARILY - By disabling a NON-CRITICAL functionality 
+        - TEMPORARILY - By doing some changes from the backend/DB 
+        - PERMANENTLY - By giving a workaround (From outside Devtron) 
+        - PERMANENTLY - By giving a workaround (Within Devtron) 
   - type: textarea
     id: impact
     validations:
@@ -91,14 +142,6 @@ body:
         - Something Else
     validations:
       required: true
-  - type: textarea
-    id: environment
-    validations:
-      required: false
-    attributes:
-      label: "🧱 Your Environment"
-      description: "Is your environment customized in any way? Provide your Browser version as well."
-      placeholder: "I use XYZ for ..."
   - type: textarea
     id: solution
     validations:

.github/workflows/github_pagerduty_score_calculation.yml

@@ -0,0 +1,27 @@
+name: Issue Created
+on:
+  issues:
+    types: [opened]
+
+jobs:
+  extract-issue-body:
+    runs-on: ubuntu-latest
+    steps:
+      - name: Checkout repository
+        uses: actions/checkout@v2
+        
+      - name: Set up Python
+        uses: actions/setup-python@v2
+        with:
+          python-version: '3.x' 
+
+      - name: Check if pager-duty template is used
+        if: ${{ contains(github.event.issue.labels.*.name, 'pager-duty') && contains(github.event.issue.labels.*.name, 'bug') }}
+        run: |
+          echo "Issue was created using pager-duty template"
+          python3 scripts/utilities/github_pagerduty_issue_score_calculation.py
+        env:
+          ISSUE_NUMBER: ${{ github.event.issue.number }}
+          ISSUE_BODY: ${{ github.event.issue.body }}
+          GITHUB_TOKEN: ${{ secrets.GH_TOKEN }}
+          PAGERDUTY_SCORE_THRESHOLD: ${{ vars.PAGERDUTY_SCORE_THRESHOLD }}

scripts/utilities/github_pagerduty_issue_score_calculation.py

@@ -0,0 +1,139 @@
+import os
+import sys
+import re
+import subprocess
+
+# Dictionaries to store different options
+affected_areas = {
+    "Devtron dashboard completely down": 100,
+    "Login issues": 50,
+    "RBAC Issues": 40,
+    "CI": 50,
+    "CD": 50,
+    "App creation": 30,
+    "Deployment from Chart store": 40,
+    "Security features": 50,
+    "CI/CD Plugins": 30,
+    "Other CRITICAL functionality": 30,
+    "Other NON-CRITICAL functionality": 20,
+    "None": 0
+}
+
+additional_affected_areas = {
+    "Devtron dashboard completely down": 100,
+    "Login issues": 50,
+    "RBAC Issues": 40,
+    "CI": 50,
+    "CD": 50,
+    "App creation": 30,
+    "Deployment from Chart store": 40,
+    "Security features": 50,
+    "CI/CD Plugins": 30,
+    "Other CRITICAL functionality": 30,
+    "Other NON-CRITICAL functionality": 20,
+    "None": 0
+}
+
+prod_environment = {
+    "Prod": 2,
+    "Non-prod": 1,
+    "None": 1
+}
+
+user_unblocked = {
+    "Yes": 1,
+    "No": 2,
+    "None": 1
+}
+
+user_unblocked_reason = {
+    "TEMPORARILY - By disabling a CRITICAL functionality": 3,
+    "TEMPORARILY - By disabling a NON-CRITICAL functionality": 1.2,
+    "TEMPORARILY - By doing some changes from the backend/DB": 1,
+    "PERMANENTLY - By giving a workaround (From outside Devtron)": 2,
+    "PERMANENTLY - By giving a workaround (Within Devtron)": 1,
+    "None": 1
+}
+# Function to extract and process information from the issue body
+def process_issue_body(issue_body):
+     # Regular expressions to extract specific sections from the issue body
+    affected_areas_pattern = r'###\s*Affected\s*areas\s*\n\n(.*?)\n\n###'
+    additional_affected_areas_pattern = r'###\s*Additional\s*affected\s*areas\s*\n\n(.*?)\n\n###'
+    prod_non_prod_pattern = r'###\s*Prod/Non-prod\s*environments\?\s*\n\n(.*?)\n\n###'
+    user_unblocked_pattern = r'###\s*Is\s*User\s*unblocked\?\s*\n\n(.*?)\n\n###'
+    user_unblocked_reason_pattern = r'###\s*How\s*was\s*the\s*user\s*un-blocked\?\s*\n\n(.*?)\n\n###'
+
+    # Matching patterns in the issue body
+    affected_areas_match = re.search(affected_areas_pattern, issue_body)
+    additional_affected_areas_match = re.search(additional_affected_areas_pattern, issue_body)
+    prod_non_prod_match = re.search(prod_non_prod_pattern, issue_body)
+    user_unblocked_match = re.search(user_unblocked_pattern, issue_body)
+    user_unblocked_reason_match = re.search(user_unblocked_reason_pattern, issue_body)
+
+    # Extracting values from matches or setting default value to "None" if match not found
+    affected_area_value = affected_areas_match.group(1).strip() if affected_areas_match else "None"
+    additional_affected_area_value = additional_affected_areas_match.group(1).strip() if additional_affected_areas_match else "None"
+    prod_non_prod_value = prod_non_prod_match.group(1).strip() if prod_non_prod_match else "None"
+    user_unblocked_value = user_unblocked_match.group(1).strip() if user_unblocked_match else "None"
+    user_unblocked_reason_value = user_unblocked_reason_match.group(1).strip() if user_unblocked_reason_match else "None"
+
+    # Retrieving values from dictionaries
+    affected_areas_score = affected_areas.get(affected_area_value, 0)
+    additional_affected_areas_score = additional_affected_areas.get(additional_affected_area_value, 0)
+    prod_non_prod_score = prod_environment.get(prod_non_prod_value, 1)
+    user_unblocked_score = user_unblocked.get(user_unblocked_value, 1)
+    user_unblocked_reason_score = user_unblocked_reason.get(user_unblocked_reason_value, 1)
+
+    print("Affected areas:", affected_area_value)
+    print("Additional affected areas:", additional_affected_area_value)
+    print("Prod/Non-prod environments?:", prod_non_prod_value)
+    print("Is User unblocked?:", user_unblocked_value)
+    print("How was the user un-blocked?:", user_unblocked_reason_value)
+
+    # Checking for required values and skipping execution of script, if not found
+    if affected_areas_score == 0 or prod_non_prod_score == 0 or user_unblocked_score == 0:
+        print("One or more required values are missing. Exiting...")
+        sys.exit(0)
+
+    if user_unblocked_reason_score == 0:
+        user_unblocked_reason_score = 1
+
+    # Adding 'urgent' label to the issue if user_unblocked_reason is 'TEMPORARILY - By disabling a CRITICAL functionality' or affected_areas is 'Devtron dashboard completely down'
+    if user_unblocked_reason_score == 3 or affected_areas_score == 100:
+        try:
+           
+            result = subprocess.run(['gh', 'issue', 'edit', str(issue_number), '--add-label', 'urgent'], capture_output=True, check=True, text=True)
+            print("urgent label added to issue", issue_number)
+        except subprocess.CalledProcessError as e:
+            print(e.stderr)
+    #calculating final score
+    final_score = affected_areas_score + additional_affected_areas_score * prod_non_prod_score * user_unblocked_score * user_unblocked_reason_score
+    print("Final Score:", final_score)
+
+    # Commenting the final score in the issue
+    comment = f"Final Score: {final_score}"
+    try:
+        result1 = subprocess.run(['gh', 'issue', 'comment', str(issue_number), '--body', comment], capture_output=True, check=True, text=True) 
+        print("Final score commented on issue", issue_number)
+    except subprocess.CalledProcessError as e:
+        print(e.stderr)
+    return final_score
+
+token = os.environ.get('GITHUB_TOKEN')
+subprocess.run(['gh', 'auth', 'login', '--with-token'], input=token, text=True, capture_output=True)
+
+# Retrieving environment variables
+issue_body = os.environ.get('ISSUE_BODY')
+issue_number = os.environ.get('ISSUE_NUMBER')
+pagerduty_score_threshold = os.environ.get('PAGERDUTY_SCORE_THRESHOLD')
+
+final_score = process_issue_body(issue_body)
+
+
+# Removing 'pager-duty' label from issue if final score is below the threshold
+if final_score <= int(pagerduty_score_threshold):
+    try:
+        result = subprocess.run(['gh', 'issue', 'edit', str(issue_number), '--remove-label', 'pager-duty'])
+        print("pager-duty label removed from issue", issue_number)
+    except subprocess.CalledProcessError as e:
+        print(e)