Skip to content

Commit ab0055e

Browse files
dmitryaxdmitryax
authored
Enable groupbyattrs processor (open-telemetry#744)
The processor is needed for grouping flat logs attributes coming from fluentd to reduce the logs payload and be able to apply k8s metadata enrichment based on "k8s.pod.uid" resource attribute
1 parent ef72973 commit ab0055e

File tree

5 files changed

+21
-15
lines changed

5 files changed

+21
-15
lines changed

‎docs/components.md‎

Lines changed: 15 additions & 15 deletions
Original file line numberDiff line numberDiff line change
@@ -10,21 +10,21 @@ These components are considered stable. While in beta, breaking changes may be
1010
introduced in a new release. In addition, any of these components may be
1111
removed prior to the 1.0 release.
1212

13-
| Receivers | Processors | Exporters | Extensions |
14-
| :--------------: | :--------: | :-------: | :--------: |
15-
| [fluentforward](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/fluentforwardreceiver) | [attributes](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/attributesprocessor) | [file](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/exporter/fileexporter) | [ecs_observer](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/extension/observer/ecsobserver) |
16-
| [hostmetrics](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/hostmetricsreceiver) | [batch](https://github.com/open-telemetry/opentelemetry-collector/tree/main/processor/batchprocessor) | [logging](https://github.com/open-telemetry/opentelemetry-collector/tree/main/exporter/loggingexporter) | [healthcheck](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/extension/healthcheckextension) |
17-
| [jaeger](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/jaegerreceiver) | [filter](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/filterprocessor) | [otlp](https://github.com/open-telemetry/opentelemetry-collector/tree/main/exporter/otlpexporter) | [httpforwarder](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/extension/httpforwarder) |
18-
| [k8s_cluster](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/k8sclusterreceiver) | [k8s_tagger](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/k8sprocessor) | [otlphttp](https://github.com/open-telemetry/opentelemetry-collector/tree/main/exporter/otlphttpexporter) | [host_observer](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/extension/observer/hostobserver) |
19-
| [kubeletstats](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/kubeletstatsreceiver) | [memorylimiter](https://github.com/open-telemetry/opentelemetry-collector/tree/main/processor/memorylimiter) | [sapm](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/exporter/sapmexporter) | [k8s_observer](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/extension/observer/k8sobserver) |
20-
| [otlp](https://github.com/open-telemetry/opentelemetry-collector/tree/main/receiver/otlpreceiver) | [metricstransform](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/metricstransformprocessor) | [signalfx](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/exporter/signalfxexporter) | [pprof](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/extension/pprofextension) |
21-
| [receiver_creator](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/receivercreator) | [probabilisticsampler](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/probabilisticsamplerprocessor) | [splunk_hec](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/exporter/splunkhecexporter) | [smartagent](../internal/extension/smartagentextension) |
22-
| [sapm](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/sapmreceiver) | [resource](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/resourceprocessor) | | [zpages](https://github.com/open-telemetry/opentelemetry-collector/tree/main/extension/zpagesextension) |
23-
| [signalfx](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/signalfxreceiver) | [resourcedetection](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/resourcedetectionprocessor) | | |
24-
| [simpleprometheus](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/simpleprometheusreceiver) | [span](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/spanprocessor) | | |
25-
| [smartagent](../internal/receiver/smartagentreceiver) | | | |
26-
| [splunk_hec](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/splunkhecreceiver) | | | |
27-
| [zipkin](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/zipkinreceiver) | | | |
13+
| Receivers | Processors | Exporters | Extensions |
14+
| :--------------: | :--------: | :-------: | :--------: |
15+
| [fluentforward](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/fluentforwardreceiver) | [attributes](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/attributesprocessor) | [file](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/exporter/fileexporter) | [ecs_observer](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/extension/observer/ecsobserver) |
16+
| [hostmetrics](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/hostmetricsreceiver) | [batch](https://github.com/open-telemetry/opentelemetry-collector/tree/main/processor/batchprocessor) | [logging](https://github.com/open-telemetry/opentelemetry-collector/tree/main/exporter/loggingexporter) | [healthcheck](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/extension/healthcheckextension) |
17+
| [jaeger](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/jaegerreceiver) | [groupbyattrs](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/groupbyattrsprocessor) | [otlp](https://github.com/open-telemetry/opentelemetry-collector/tree/main/exporter/otlpexporter) | [httpforwarder](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/extension/httpforwarder) |
18+
| [k8s_cluster](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/k8sclusterreceiver) | [filter](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/filterprocessor) | [otlphttp](https://github.com/open-telemetry/opentelemetry-collector/tree/main/exporter/otlphttpexporter) | [host_observer](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/extension/observer/hostobserver) |
19+
| [kubeletstats](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/kubeletstatsreceiver) | [k8s_tagger](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/k8sprocessor) | [sapm](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/exporter/sapmexporter) | [k8s_observer](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/extension/observer/k8sobserver) |
20+
| [otlp](https://github.com/open-telemetry/opentelemetry-collector/tree/main/receiver/otlpreceiver) | [memorylimiter](https://github.com/open-telemetry/opentelemetry-collector/tree/main/processor/memorylimiter) | [signalfx](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/exporter/signalfxexporter) | [pprof](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/extension/pprofextension) |
21+
| [receiver_creator](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/receivercreator) | [metricstransform](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/metricstransformprocessor) | [splunk_hec](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/exporter/splunkhecexporter) | [smartagent](../internal/extension/smartagentextension) |
22+
| [sapm](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/sapmreceiver) | [probabilisticsampler](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/probabilisticsamplerprocessor) | | [zpages](https://github.com/open-telemetry/opentelemetry-collector/tree/main/extension/zpagesextension) |
23+
| [signalfx](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/signalfxreceiver) | [resource](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/resourceprocessor) | | |
24+
| [simpleprometheus](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/simpleprometheusreceiver) | [resourcedetection](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/resourcedetectionprocessor) | | |
25+
| [smartagent](../internal/receiver/smartagentreceiver) | [span](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/processor/spanprocessor) | | |
26+
| [splunk_hec](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/splunkhecreceiver) | | | |
27+
| [zipkin](https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/main/receiver/zipkinreceiver) | | | |
2828

2929
## Alpha
3030

‎go.mod‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -31,6 +31,7 @@ require (
3131
github.com/open-telemetry/opentelemetry-collector-contrib/pkg/translator/zipkin v0.34.0
3232
github.com/open-telemetry/opentelemetry-collector-contrib/processor/attributesprocessor v0.34.0
3333
github.com/open-telemetry/opentelemetry-collector-contrib/processor/filterprocessor v0.34.0
34+
github.com/open-telemetry/opentelemetry-collector-contrib/processor/groupbyattrsprocessor v0.34.0
3435
github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sprocessor v0.34.0
3536
github.com/open-telemetry/opentelemetry-collector-contrib/processor/metricstransformprocessor v0.34.0
3637
github.com/open-telemetry/opentelemetry-collector-contrib/processor/probabilisticsamplerprocessor v0.34.0

‎go.sum‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1883,6 +1883,8 @@ github.com/open-telemetry/opentelemetry-collector-contrib/processor/attributespr
18831883
github.com/open-telemetry/opentelemetry-collector-contrib/processor/attributesprocessor v0.34.0/go.mod h1:5+8raCB9xK8hGlQXZGpyBfEVon+Wj8pIcf6rfc7XbRY=
18841884
github.com/open-telemetry/opentelemetry-collector-contrib/processor/filterprocessor v0.34.0 h1:Ccwtu52VKzeUgVfqh+hHJiTLYTEMkeG97JD8vc+AVJ8=
18851885
github.com/open-telemetry/opentelemetry-collector-contrib/processor/filterprocessor v0.34.0/go.mod h1:1p6uTkRRkHc6MFaxN15rBrfX6fV4zCJ8cRlD7GdRr6c=
1886+
github.com/open-telemetry/opentelemetry-collector-contrib/processor/groupbyattrsprocessor v0.34.0 h1:JO0MbcBOxZtZNNIK5ltxROu3ljZzX8GM8/wIwVEs+TM=
1887+
github.com/open-telemetry/opentelemetry-collector-contrib/processor/groupbyattrsprocessor v0.34.0/go.mod h1:jvEuBg+glWTI0U8zFL54cvVzvykMBl9RDJbMavTbK1I=
18861888
github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sprocessor v0.34.0 h1:YQvtmUBWMqHQcg4QvZLxMmnFpb1BLfE20Jb9ZVS0vIs=
18871889
github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sprocessor v0.34.0/go.mod h1:8nMPf/2qKV4hXf0JnZvqaOIPWKqMdRS7I4d5ySH0PS0=
18881890
github.com/open-telemetry/opentelemetry-collector-contrib/processor/metricstransformprocessor v0.34.0 h1:ZSDEcft/FMiNxQ/a45csqV6snvRr7NVilfEQysb3HYQ=

‎internal/components/components.go‎

Lines changed: 2 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -30,6 +30,7 @@ import (
3030
"github.com/open-telemetry/opentelemetry-collector-contrib/extension/storage/filestorage"
3131
"github.com/open-telemetry/opentelemetry-collector-contrib/processor/attributesprocessor"
3232
"github.com/open-telemetry/opentelemetry-collector-contrib/processor/filterprocessor"
33+
"github.com/open-telemetry/opentelemetry-collector-contrib/processor/groupbyattrsprocessor"
3334
"github.com/open-telemetry/opentelemetry-collector-contrib/processor/k8sprocessor"
3435
"github.com/open-telemetry/opentelemetry-collector-contrib/processor/metricstransformprocessor"
3536
"github.com/open-telemetry/opentelemetry-collector-contrib/processor/probabilisticsamplerprocessor"
@@ -133,6 +134,7 @@ func Get() (component.Factories, error) {
133134
attributesprocessor.NewFactory(),
134135
batchprocessor.NewFactory(),
135136
filterprocessor.NewFactory(),
137+
groupbyattrsprocessor.NewFactory(),
136138
k8sprocessor.NewFactory(),
137139
memorylimiter.NewFactory(),
138140
metricstransformprocessor.NewFactory(),

‎internal/components/components_test.go‎

Lines changed: 1 addition & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -63,6 +63,7 @@ func TestDefaultComponents(t *testing.T) {
6363
"attributes",
6464
"batch",
6565
"filter",
66+
"groupbyattrs",
6667
"k8s_tagger",
6768
"memory_limiter",
6869
"metricstransform",

0 commit comments

Comments
 (0)