Grafana Agent with OSS Stack

[brngates98]

Hey all,
We have a local Grafana Stack implementation and we are moving away from telegraf/influxdb on machines collecting windows metrics to the Grafana Agent, with Mimir, and Loki.

I borrowed the integration dashboards from cloud for agent health and windows overview and logs. it works.

But i want to gather even more information, specifically data on running processes so we can then do some pattern matching when we have a process that crashes to find the root cause., how can i begin watching the windows processes with the agent?
Brand new to the agent so all ears on anything

This is my current Grafana Agent Configuration

`integrations:
prometheus_remote_write:

• url: http://loki:9009/api/v1/push

Add here any snippet that belongs to the integrations section.

For a correct indentation, paste snippets copied from Grafana Cloud at the beginning of the line.

windows_exporter:
enabled: true
instance: palmtest # must match instance used in logs
relabel_configs:
- target_label: job
replacement: 'integrations/windows_exporter' # must match job used in logs
metric_relabel_configs:
- action: keep
regex: windows_cpu_time_total|windows_cs_hostname|windows_cs_logical_processors|windows_cs_physical_memory_bytes|windows_iis_current_connections|windows_logical_disk_free_bytes|windows_logical_disk_read_bytes_total|windows_logical_disk_size_bytes|windows_logical_disk_write_bytes_total|windows_net_bytes_total|windows_net_current_bandwidth|windows_os_info|windows_os_physical_memory_free_bytes|windows_service_status|windows_system_system_up_time
source_labels:
- name
agent:
enabled: true
relabel_configs:
- action: replace
source_labels:
- agent_hostname
target_label: instance
logs:
configs:

• clients:
  • url: http://loki:3100/loki/api/v1/push
    name: integrations
    positions:
    filename: ./positions.yaml
    scrape_configs:

    Add here any snippet that belongs to the logs.configs.scrape_configs section.

    For a correct indentation, paste snippets copied from Grafana Cloud at the beginning of the line.

  • job_name: integrations/windows-exporter-application
    windows_events:
    use_incoming_timestamp: true
    bookmark_path: "./bookmarks-app.xml"
    eventlog_name: "Application"
    labels:
    job: integrations/windows_exporter
    instance: palmtest # must match instance used in windows_exporter
    relabel_configs:
    • source_labels: ['computer']
      target_label: 'agent_hostname'
      pipeline_stages:
    • json:
      expressions:
      source: source
    • labels:
      source:
  • job_name: integrations/windows-exporter-system
    windows_events:
    use_incoming_timestamp: true
    bookmark_path: "./bookmarks-app.xml"
    eventlog_name: "System"
    labels:
    job: integrations/windows_exporter
    instance: palmtest # must match instance used in windows_exporter
    relabel_configs:
    • source_labels: ['computer']
      target_label: 'agent_hostname'
      pipeline_stages:
    • json:
      expressions:
      source: source
    • labels:
      source:
  • job_name: integrations/agent
    journal:
    max_age: 24h
    labels:
    instance: test
    job: integrations/agent
    pipeline_stages:
    • match:
      selector: '{unit!="grafana-agent.service"}'
      action: drop
      drop_counter_reason: only_keep_grafana_agent_logs
    • regex:
      expression: "(level=(?P<log_level>[\s]*debug|warn|info|error))"
    • labels:
      level: log_level
      relabel_configs:
    • source_labels: ['__journal__systemd_unit']
      target_label: 'unit'
  • job_name: integrations/agent
    windows_events:
    use_incoming_timestamp: true
    bookmark_path: "./bookmarks-app.xml"
    eventlog_name: "Application"
    xpath_query: "*[System[Provider[@name='Grafana Agent']]]"
    labels:
    job: integrations/agent
    relabel_configs:
    • source_labels: ['computer']
      target_label: 'instance'
    • replacement: grafana-agent.service
      target_label: unit
      pipeline_stages:
    • json:
      expressions:
      message: message
    • regex:
      expression: "(level=(?P<log_level>[\s]*debug|warn|info|error))"
    • labels:
      level: log_level
    • output:
      source: message
      metrics:
      configs:
• name: integrations
  remote_write:
  • url: http://loki:9009/api/v1/push
    scrape_configs:

    Add here any snippet that belongs to the metrics.configs.scrape_configs section.

    For a correct indentation, paste snippets copied from Grafana Cloud at the beginning of the line.

global:
scrape_interval: 60s
wal_directory: /tmp/grafana-agent-wal
`