Skip to content

Conversation

@ArneTR
Copy link
Member

@ArneTR ArneTR commented Dec 22, 2023

Metric providers can be left behind on the system in case of an unclean shutdown.

This PR introduces a system check to look for running providers in different GMT instance and also adds a test case to test the guard clause to trigger.

* main:
  Switched from cmd to command (#615)
  Hotfix for check on frequency provider
  Tests run_until must be guard-claused with cleanup routine (#616)
* main:
  Text change
  Value formatting on status page
  Normalized URL for machines endpoint
  Less confusing error messages
  Status has now a waiting time (#599)
  Run ID is now accessible even after fail and thus can be sent via ema… (#601)
@github-actions
Copy link

github-actions bot commented Dec 23, 2023

Old Energy Estimation

Eco-CI Output:

Label 🖥 avg. CPU utilization [%] 🔋 Total Energy [Joules] 🔌 avg. Power [Watts] Duration [Seconds]
Total Run 10.5937 1682.52 2.56482 664
Measurement #1 10.6233 1682.52 2.56482 658

📈 Energy graph:

 
 7.74 ┤                                     ╭╮                ╭╮
 7.14 ┤                                     ││                ││
 6.55 ┤                                     ││                ││
 5.95 ┤          ╭╮                         ││           ╭─╮  │╰─╮
 5.35 ┤        ╭╮││                         │╰╮         ╭╯ ╰╮ │  ╰╮
 4.75 ┤      ╭╮││││                        ╭╯ ╰╮╭─╮╭╮   │   │ │   │
 4.16 ┤     ╭╯╰╯╰╯╰╮  ╭─╮ ╭╮   ╭─╮   ╭─╮  ╭╯   ╰╯ ╰╯╰╮ ╭╯   ╰─╯   │        ╭╮╭╮╭╮                          ╭╮╭╮ ╭╮    ╭╮ ╭╮            ╭╮           ╭╮                                         ╭╮  ╭────╮       ╭╮               ╭╮                                                 ╭╮            ╭─╮                        ╭─╮                        ╭╮                        ╭─╮                          ╭╮                          ╭╮                           ╭╮                                                   ╭╮                                                  ╭╮                                                                     ╭─╮
 3.56 ┤     │      ╰──╯ ╰─╯╰───╯ ╰───╯ ╰─╮│          ╰╮│          │       ╭╯╰╯╰╯╰╮         ╭╮╭╮        ╭╮ ╭╯╰╯╰─╯╰────╯╰─╯╰──╮         │╰─╮         │╰─╮         ╭──╮         ╭──╮         ╭───╯╰──╯    ╰───────╯╰─────╮         │╰─╮         ╭──╮         ╭─╮         ╭──╮         │╰─╮         ╭╯ ╰╮         ╭╮        ╭╮ ╭╯ ╰╮                   ╭╮ ╭╯╰─╮                  ╭╮ ╭╯ ╰╮         ╭╮╭╮        ╭╮ ╭╯╰─╮        ╭─╮         ╭╮ ╭╯╰─╮        ╭─╮╭╮        ╭╮╭─╯╰─╮        ╭─╮         ╭╮ ╭──╮          ╭─╮         │╰─╮          ╭─╮         ╭─╮         ╭───╮         │╰─╮           ╭───╮        ╭─╮           ╭──╮        ╭─╮           ╭──╯ ╰─╮        ╭─╮         ╭╮ ╭─
 2.96 ┤    ╭╯                            ││           ││          │       │      ╰╮        │╰╯│        ││ │                  │         │  │         │  ╰╮        │  │         │  │         │                           │         │  │         │  │         │ ╰╮        │  │         │  ╰╮        │   │         ││        ││ │   │         ╭╮        ││ │   │                  ││ │   │        ╭╯│││        ││ │   │        │ │         ││ │   │        │ │││       ╭╯││    │        │ ╰╮        ││ │  ╰╮        ╭╯ │         │  │         ╭╯ │         │ │         │   │        ╭╯  ╰╮          │   │        │ ╰╮          │  │        │ │╭╮         │      │        │ │         │╰╮│
 2.37 ┤    │                             ╰╯           ││          │       │       │       ╭╯  │        ││ │                  │         │  ╰╮        │   │        │  │         │  │         │                           │        ╭╯  │         │  │        ╭╯  │        │  ╰╮        │   │        │   ╰╮        ││        ││ │   ╰╮        ││       ╭╯│╭╯   │        ╭╮        ││ │   │        │ │││       ╭╯│ │   │        │ ╰╮        ││ │   │        │ │││       │ ││    │       ╭╯  │        ││ │   │        │  │         │  │         │  │         │ │         │   │        │    ╰╮       ╭╮│   │       ╭╯  │          │  │        │ ╰╯│         │      │        │ │╭╮       │ ││
 1.77 ┼────╯                                          ╰╯          ╰───────╯       ╰───────╯   ╰────────╯╰─╯                  ╰─────────╯   ╰────────╯   ╰────────╯  ╰─────────╯  ╰─────────╯                           ╰────────╯   ╰─────────╯  ╰────────╯   ╰────────╯   ╰────────╯   ╰────────╯    ╰────────╯╰────────╯╰─╯    ╰────────╯╰───────╯ ╰╯    ╰────────╯╰────────╯╰─╯   ╰────────╯ ╰╯╰───────╯ ╰─╯   ╰────────╯  ╰────────╯╰─╯   ╰────────╯ ╰╯╰───────╯ ╰╯    ╰───────╯   ╰────────╯╰─╯   ╰────────╯  ╰─────────╯  ╰─────────╯  ╰─────────╯ ╰─────────╯   ╰────────╯     ╰───────╯╰╯   ╰───────╯   ╰──────────╯  ╰────────╯   ╰─────────╯      ╰────────╯ ╰╯╰───────╯ ╰╯
                                                                                                                                                                                                                                                                                                                                       Watts over time

@ArneTR ArneTR requested a review from ribalba December 28, 2023 09:57
ArneTR added 2 commits January 1, 2024 08:07
* main:
  Stderr is now by default UTF-8 (#624)
  Refactored kill/killpg mechanism to be unified and actually fail on n… (#625)
  Command fix. Must be list append
  Refactorings
  Moved tinyproxy out of if clause
  Refactoring for error messages and security fix for path echoing (#636)
  GMT color via own commit hash (#634)
  Hotfix for branch not main
  Non-Blocking starlette body read (#633)
  Bump fastapi from 0.105.0 to 0.108.0 (#632)
  Updated XGBoost submodule
  Bump pydantic from 2.5.2 to 2.5.3 (#628)
  Added stddev to timeline (#627)
  Disable tinyproxy systemd service (#623)
@github-actions
Copy link

github-actions bot commented Jan 1, 2024

Eco-CI Output:

Label 🖥 avg. CPU utilization [%] 🔋 Total Energy [Joules] 🔌 avg. Power [Watts] Duration [Seconds]
Total Run 10.8203 1796.98 2.60055 699
Measurement #1 10.897 1796.98 2.60055 693

📈 Energy graph:

 
 7.70 ┤                                                             ╭╮                 ╭╮
 7.11 ┤                                                             ││                 ││
 6.51 ┤         ╭╮                                                  ││            ╭╮   ││
 5.92 ┤         ││                                                  ││            ││   ││╭╮
 5.33 ┤       ╭─╯│                                                 ╭╯╰╮          ╭╯╰─╮ │╰╯│
 4.73 ┤       │  │                                       ╭╮        │  │╭──╮╭─╮   │   │╭╯  ╰╮            ╭╮
 4.14 ┤      ╭╯  ╰─╮  ╭─╮    ╭──╮ ╭──╮        ╭─╮╭─╮   ╭─╯╰──╮     │  ││  ╰╯ │  ╭╯   ╰╯    │        ╭╮╭╮││                            ╭╮  ╭╮╭─╮ ╭╮ ╭─╮                                                                  ╭╮╭╮  ╭─────╮        ╭╮                 ╭╮                                                               ╭╮                         ╭╮                         ╭╮                        ╭─╮                          ╭─╮                          ╭╮                           ╭╮                                                                  ╭╮                                    ╭╮╭╮            ╭╮                                                    ╭───╮                          ╭─
 3.55 ┤     ╭╯     ╰──╯ ╰────╯  ╰─╯  ╰──╮     │ ╰╯ ╰───╯     ╰──╮ ╭╯  ╰╯     ╰╮ │          │       ╭╯╰╯││╰─╮         ╭╮         ╭╮ ╭──╯╰──╯││ ╰─╯╰─╯ ╰─╮         ╭───╮         ╭──╮         ╭──╮         ╭──╮         ╭─╯││╰──╯     ╰────────╯╰──╮ ╭╮         ╭─╯╰╮         ╭──╮        ╭───╮        ╭──╮         ╭───╮         ╭╯╰─╮         ╭╮        ╭╮╭─╯╰─╮                   ╭╮╭─╯╰─╮                  ╭╮ ╭╯ ╰╮          ╭╮         ╭╮ ╭╯ ╰╮         ╭╮          ╭╮╭─╯╰─╮         ╭╮╭╮        ╭╮╭─╯╰─╮         ╭╮         ╭╮ ╭───╮         ╭─╮         ╭───╮         ╭╯│          ╭─╮         ╭───╮        ╭╯╰╯│╭╮          │╰─╮         ╭╮           ╭───╮        ╭─╮           ╭╯   ╰─╮         ╭╮          ╭╮ │
 2.95 ┤     │                           ╰╮    │                 │╭╯           │ │          │       │   ││  │        ╭╯│╭╮       ││ │       ╰╯          │         │   │         │  │         │  │         │  │         │  ╰╯                      │ ││         │   │         │  │        │   │        │  ╰╮        │   │         │   │         ││       ╭╯││    │         ╭╮       ╭╯││    │                  ││ │   ╰╮        ╭╯╰╮        ││ │   ╰╮        │╰─╮        │││    │         ││││       ╭╯││    │        ╭╯│╭╮       │╰╮│   │         │ ╰╮        │   │         │ ╰╮         │ │         │   │        │   │││          │  │        ╭╯│╭╮         │   │        │ ╰╮          │      ╰╮        │╰─╮        ││ │
 2.36 ┤    ╭╯                            │    │                 ││            │╭╯          │       │   ││  │       ╭╯ ╰╯│       │╰╮│                   ╰╮        │   │ ╭╮     ╭╯  │         │  │         │  │         │                          │╭╯╰╮        │   │        ╭╯  │        │   │        │   │        │   │        ╭╯   │         ││       │ ││    │         ││       │ ││    │        ╭╮        ││ │    │       ╭╯  ╰╮       │╰╮│    │       ╭╯  │       ╭╯││    │       ╭─╯│││       │ ││    │       ╭╯ ╰╯│       │ ││   │         │  │        │   │         │  │        ╭╯ │         │   │        │   │││       ╭╮ │  │        │ ╰╯│         │   │       ╭╯  │          │       │       ╭╯  │        ││ │
 1.77 ┼────╯                             ╰────╯                 ╰╯            ╰╯           ╰───────╯   ╰╯  ╰───────╯    ╰───────╯ ╰╯                    ╰────────╯   ╰─╯╰─────╯   ╰─────────╯  ╰─────────╯  ╰─────────╯                          ╰╯  ╰────────╯   ╰────────╯   ╰────────╯   ╰────────╯   ╰────────╯   ╰────────╯    ╰─────────╯╰───────╯ ╰╯    ╰─────────╯╰───────╯ ╰╯    ╰────────╯╰────────╯╰─╯    ╰───────╯    ╰───────╯ ╰╯    ╰───────╯   ╰───────╯ ╰╯    ╰───────╯  ╰╯╰───────╯ ╰╯    ╰───────╯    ╰───────╯ ╰╯   ╰─────────╯  ╰────────╯   ╰─────────╯  ╰────────╯  ╰─────────╯   ╰────────╯   ╰╯╰───────╯╰─╯  ╰────────╯   ╰─────────╯   ╰───────╯   ╰──────────╯       ╰───────╯   ╰────────╯╰─╯
                                                                                                                                                                                                                                                                                                                                                         Watts over time

@ArneTR ArneTR merged commit 5413d50 into main Jan 1, 2024
@ArneTR ArneTR deleted the system-check-providers-running branch January 1, 2024 07:27
ArneTR added a commit that referenced this pull request Jan 1, 2024
* main: (23 commits)
  System check providers running (#619)
  Stderr is now by default UTF-8 (#624)
  Refactored kill/killpg mechanism to be unified and actually fail on n… (#625)
  Command fix. Must be list append
  Refactorings
  Moved tinyproxy out of if clause
  Refactoring for error messages and security fix for path echoing (#636)
  GMT color via own commit hash (#634)
  Hotfix for branch not main
  Non-Blocking starlette body read (#633)
  Bump fastapi from 0.105.0 to 0.108.0 (#632)
  Updated XGBoost submodule
  Bump pydantic from 2.5.2 to 2.5.3 (#628)
  Added stddev to timeline (#627)
  Disable tinyproxy systemd service (#623)
  Text change
  Value formatting on status page
  Normalized URL for machines endpoint
  Less confusing error messages
  Status has now a waiting time (#599)
  ...
ArneTR added a commit that referenced this pull request Jan 1, 2024
* main:
  Adds skip_checks to providers (#566)
  Bump pytest from 7.4.3 to 7.4.4 (#639)
  Disabled second PSU provider for VM tests
  System check providers running (#619)
  Stderr is now by default UTF-8 (#624)
  Refactored kill/killpg mechanism to be unified and actually fail on n… (#625)
  Command fix. Must be list append
  Refactorings
  Moved tinyproxy out of if clause
  Refactoring for error messages and security fix for path echoing (#636)
ArneTR added a commit that referenced this pull request Jan 1, 2024
* main:
  Dev mode (#637)
  Hotfix: resolutions -> resolution
  Adds skip_checks to providers (#566)
  Bump pytest from 7.4.3 to 7.4.4 (#639)
  Disabled second PSU provider for VM tests
  System check providers running (#619)
  Stderr is now by default UTF-8 (#624)
  Refactored kill/killpg mechanism to be unified and actually fail on n… (#625)
  Command fix. Must be list append
  Refactorings
  Moved tinyproxy out of if clause
  Refactoring for error messages and security fix for path echoing (#636)
ArneTR added a commit that referenced this pull request Jan 2, 2024
* main:
  Dev mode (#637)
  Hotfix: resolutions -> resolution
  Adds skip_checks to providers (#566)
  Bump pytest from 7.4.3 to 7.4.4 (#639)
  Disabled second PSU provider for VM tests
  System check providers running (#619)
  Stderr is now by default UTF-8 (#624)
  Refactored kill/killpg mechanism to be unified and actually fail on n… (#625)
  Command fix. Must be list append
  Refactorings
  Moved tinyproxy out of if clause
  Refactoring for error messages and security fix for path echoing (#636)
  GMT color via own commit hash (#634)
  Hotfix for branch not main
  Non-Blocking starlette body read (#633)
  Bump fastapi from 0.105.0 to 0.108.0 (#632)
  Updated XGBoost submodule
  Bump pydantic from 2.5.2 to 2.5.3 (#628)
  Added stddev to timeline (#627)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants