[Telemetry] Apply shared logging module

[jessicadaugherty]

Objective

Use the foundations to unify and standardize the logging approach across the entire codebase created in #164 and apply to a subset of files to use this framework.

Origin Document

See the github discussion for full details: #214

The implementation of this was started by @derrandz here: #162.

This ticket can either build on top of the existing WIP or use those learnings and apply them to a different approach.

Goals / Deliverables

• Select subset of files to use the same logging framework
• Add support for multiple log levels
• Add support for attaching labels to logs
• Build a log panel in Grafana where logs can be toggled based on level or label (covered in [Telemetry] Dashboard for LocalNet logs viewing & filtering #189)

General issue checklist

• Update the appropriate CHANGELOG
• Update the appropriate README on how to use and test this feature
• Update any relevant global documentation & references
• Add a video and/or gif on how to use feature
• Document small issues / TODOs along the way

Non-goals

• Add new logs throughout the codebase
• Improve the explicitness or correctness of existing logs
• Add new business logic functionality

Testing Methodology

• All tests: make test_all
• LocalNet: verify a LocalNet is still functioning correctly by following the instructions at docs/development/README.md
  Remove

---

Creator: @Olshansk

[Olshansk]

@jessicadaugherty I've udpated the milestone + labels

[jessicadaugherty]

Note to self/team: revisit #301 after completing #288

[Olshansk]

@Gustavobelfort As you go into this work and integrate it with Grafana (or other), I wanted to share what my dream feature here would be:

• Being able to filter by level WARN, DEBUG, etc..
• Filtering / toglging by stuff like node1.consensus, node2.consensus, etc...
• Filtering / toggling by REPLICA / LEADER
• Aggregating across event_*

I'm sure we'll have all of these over time, but wanted to drop my thoughts in case you have better ideas :)

[jessicadaugherty]

Hey @Gustavobelfort! I left a note for myself above to revisit #301 after this was completed in the event of any TODOs or NITs coming out of applying the logger throughout the codebase. Can you lmk if you saw anything that fits that category along the way so we can document it for the future? Ty!