i forgot this channel was associated with the https://github.com/open-telemetry/opentelemetry-collector repo, so i’ve neglected to post relevant info here related to collector. instead, i’ve been posting my collector comments to the https://gitter.im/open-telemetry/opentelemetry-specification gitter channel instead over the past few days. (just issue triage logistics comments)
any chance this channel can be renamed to open-telemetry/opentelemetry-collector?
3 replies
apiVersion: v1
data:
otel-collector-config: |-
"exporters":
"jaeger":
"endpoint": "jaeger-collector.observability:14250"
"insecure": true
"prometheus":
"endpoint": ":8889"
"namespace": "monitoring"
"extensions":
"health_check": {}
"zpages": {}
"processors":
"batch": null
"memory_limiter":
"ballast_size_mib": 683
"check_interval": "5s"
"limit_mib": 1500
"spike_limit_mib": 512
"queued_retry": null
"receivers":
"jaeger":
"protocols":
"grpc": null
"thrift_http": null
"opencensus": null
"otlp":
"protocols":
"grpc": null
"http": null
"service":
"extensions":
- "health_check"
- "zpages"
"pipelines":
"metrics":
"exporters":
- "prometheus"
"receivers":
- "opencensus"
"traces":
"exporters":
- "jaeger"
"processors":
- "memory_limiter"
- "batch"
- "queued_retry"
"receivers":
- "otlp"
- "jaeger"
- "opencensus"
kind: ConfigMap
metadata:
labels:
app: otel-collector-conf
name: otel-collector-conf
namespace: observability
Ideas?
Hello friends, is there any processor that allows users to add attributes to a span based on span events? If i understand things correctly, Some vendor exporters drop span events, so i was hoping to able to append details of span events as span attributes within a processor
2 replies
Hi Team , trying to understand the routing processor . https://github.com/open-telemetry/opentelemetry-collector-contrib/tree/master/processor/routingprocessor. the name that we need to give in from_attribute , is that span attribute name ..?
hello all
I'm trying to deliver traces into two systems (jaeger / grafana tempo) in order to play with them in parallel, so I use opentelemetry-collector as a receiver
when I send traces directly to collector - I see them in logs but downstream services don't have them (if I send directly to jaeger everything is ok)
could you point the way how can I debug it and see where I failed? config and commands I use: https://gist.github.com/afoninsky/7496c4bb89cc461aa33ffeb64318a634
thank you
I'm trying to deliver traces into two systems (jaeger / grafana tempo) in order to play with them in parallel, so I use opentelemetry-collector as a receiver
when I send traces directly to collector - I see them in logs but downstream services don't have them (if I send directly to jaeger everything is ok)
could you point the way how can I debug it and see where I failed? config and commands I use: https://gist.github.com/afoninsky/7496c4bb89cc461aa33ffeb64318a634
thank you
7 replies
Hi all, I am trying to export traces to Splunk using Splunk HEC exporter and Zipkin receiver for OpenTelemetry Collector.
Problem: I am not able to see the traces in Splunk. However, logging exporter does show the logs for the traces.
Could you please help me out with this? Thank you.
Following is the content of otel-collector-config.yaml file:
3 replies
Hi everyone, I cannot build the
opentelemetry-collector-contrib. Something wrong with DataDog dependency. Is it a known issue? I just pulled the latest code. make otelcontribcol
GO111MODULE=on CGO_ENABLED=0 go build -o ./bin/otelcontribcol_darwin_amd64 \
-ldflags "-X github.com/open-telemetry/opentelemetry-collector-contrib/internal/version.GitHash=c01d3b00 -X go.opentelemetry.io/collector/internal/version.BuildType=release" ./cmd/otelcontribcol
go: finding module for package github.com/DataDog/datadog-agent/pkg/collector/corechecks/cluster
go: found github.com/DataDog/datadog-agent/pkg/collector/corechecks/cluster in github.com/DataDog/datadog-agent v0.0.0-20201117210934-a3cba9a8cfd2
go: github.com/DataDog/datadog-agent@v0.0.0-20201117210934-a3cba9a8cfd2 requires
github.com/benesch/cgosymbolizer@v0.0.0: reading github.com/benesch/cgosymbolizer/go.mod at revision v0.0.0: unknown revision v0.0.0
make: *** [otelcontribcol] Error 1
@/all ^^^
Hi @bogdandrutu @tigrannajaryan can we get this merged please. A small bug fix & readme update. Code was reviewed and approved.
open-telemetry/opentelemetry-collector-contrib#1626
open-telemetry/opentelemetry-collector-contrib#1626
Primarely when using the PRometheus receiver
@jpkrohling @flands How much memory is typically needed for a "small" deployment? I've only setup the OTEL collectors as a DaemonSet and limited the Targets to target only what runs on the Node it is running on basically in my Kubernetes SD config which is / should be very few pods
4 replies
Steve ^
Hi there! Question about doing validations: I'm thinking of doing payload validations within the metrics/spans in a processor and if a metric/span does not have specific attributes, I want to reject them and propagate that error to the client with a 400. Currently, I think if the data has gone thru the receiver and the first processor rejects them, the client will only receive a 500. Are there any thoughts on supporting something like synchronous validations as a processor or is it not part of the intended design within the collector?
6 replies
@bogdandrutu @tigrannajaryan can any of you please help me to get this reviewed and merged today. Its a one line bug fix which replaces
open-telemetry/opentelemetry-collector-contrib#1661
{{ }} with { }. Will highly appreciate. Thanks.open-telemetry/opentelemetry-collector-contrib#1661
Anybody who has the power- please help me out. Can any of you please help me to get this reviewed and merged today. Its a one line bug fix which replaces {{ }} with { }. Will highly appreciate. Thanks. @bogdandrutu @tigrannajaryan @andrewhsu
open-telemetry/opentelemetry-collector-contrib#1661
open-telemetry/opentelemetry-collector-contrib#1661
2 replies
To the person that fixed the open-telemetry/opentelemetry-collector#2121 this fixed my issue with vanished metrics and dirty workaround to continously restart OTEL Collectors! thnx @kohrapha
2 replies
Could I get a quick overview of the changes that were made here? https://github.com/open-telemetry/opentelemetry-collector-contrib/pull/1489/files I think due to some timing issues the vendor exporter i'm maintaining got missed in this PR, and starting to see some bug reports now (open-telemetry/opentelemetry-collector-contrib#1684). Is the idea that, for vendor exporters, instead of attempting to match statusCode against a range (400/500 errors), you just see if
status.Code() == pdata.StatusCodeError? I'd be happy to update the datadog exporter to match whatever the current spec is
1 reply
Hi all, the hostmetrics receiver from the OpenTelemetry Collector reports metrics namespaced under
system.swap. (see here) that are similar in meaning but different in naming to the system.paging. metrics that feature in the spec (see here). Is this expected? If not, what should be changed (spec/implementation)? Should I open an issue for this?
1 reply
Hi All, In custom processors/receivers/exporters is there a provision to send custom app metrics via the stats or obsrreport package or any other means?
For ex> in my custom processor, there is a cache of metadata which gets refreshed periodically.. if there is any problem reloading the cache I would like to emit a metric, so that i can set up the necessary monitoring..
For ex> in my custom processor, there is a cache of metadata which gets refreshed periodically.. if there is any problem reloading the cache I would like to emit a metric, so that i can set up the necessary monitoring..
@tannaga yes, see this example: https://github.com/open-telemetry/opentelemetry-collector-contrib/blob/master/processor/groupbytraceprocessor/metrics.go
1 reply
make otelcol;
go generate ./...
receiver/hostmetricsreceiver/codegen.go:17: running "mdatagen": exec: "mdatagen": executable file not found in $PATH
service/internal/gen.go:18: running "addlicense": exec: "addlicense": executable file not found in $PATH
make: * [otelcol] Error 1
go generate ./...
receiver/hostmetricsreceiver/codegen.go:17: running "mdatagen": exec: "mdatagen": executable file not found in $PATH
service/internal/gen.go:18: running "addlicense": exec: "addlicense": executable file not found in $PATH
make: * [otelcol] Error 1
I tried sunning ''go get -u github.com/mjibson/esc'' making sure $GOPATH and PATH are set
I installed go via homebrew
This is how my zshrc looks like - cat ~/.zshrc
export GOPATH=/usr/local/Cellar/go/1.15.5
export PATH=$PATH:$(go env GOPATH)/bin
export GOPATH=/usr/local/Cellar/go/1.15.5
export PATH=$PATH:$(go env GOPATH)/bin
I opened an issue in opentelemetry-collector core that is a continuation of a discussion i was having in contrib, it involves a number of vendors, clients, and formats, and input from maintainers is appreciated open-telemetry/opentelemetry-collector#2214 . I will try to attend mtg today to sync on this as well. cheers
cross-posting from opentelemetry-specification
Friendly reminder we have
otel spec issue scrub 🧽mtg tomorrow, Friday morning 8:30a PST.
Not many spec issues to triage, so if we have quorum with collector maintainers, we’ll also continue triaging collector and collector-contrib issues.
Hi all, would love a review on these PRs:
