openzipkin/zipkin

Zipkin is a distributed tracing system

Bas van Beek

@basvanbeek

@chuwuu there is various instrumentation for gRPC clients and servers. It would help to know what you are trying to instrument (which language/framework/etc)

Tugay Ersoy

@Admiralkheir

got it,if i dont use this job for 2 days. After that run this job is it linking all of them? or only this day?

Bas van Beek

@basvanbeek

as described in the repo, if you run it just before midnight you will have a topology view from the previous day. Each day needs a new one

Ben Iofel

@benwaffle

If i have two trees of spans in one file, with two SERVER spans whose parentId is not in the tree, Zipkin only shows one of them. That's not a bug in zipkin, right? It's a bug in the tracing library?

https://gist.github.com/benwaffle/30d64099f94dae70a02d9c687199d525

Bas van Beek

@basvanbeek

So it seems you're missing the root span then. so you have 2 fragments of the same trace where the originating span is missing.

Ben Iofel

@benwaffle

oh interesting, does the root span look different? or do you know just because I have 2 trees?

Bas van Beek

@basvanbeek

Typically not a bug, more likely a config issue where the ingress / originating service is starting the span but not sending it to Zipkin.

root span comes without parentId as it has no parent

that's the start of your trace

Ben Iofel

@benwaffle

good to know

Bas van Beek

@basvanbeek

so do you have another service where the request originates that starts the trace?

it might not be sending its span data to Zipkin which would account for it missing

Why it doesn't send typically is because one of the following reasons:

Ben Iofel

@benwaffle

yeah

Bas van Beek

@basvanbeek

it's reporter (to send to Zipkin) is not configured properly

2 it never closed the span (probably a bug)

Ben Iofel

@benwaffle

the request originates in a previous service that isn't reporting to zipkin

Bas van Beek

@basvanbeek

tada :)

Ben Iofel

@benwaffle

Shouldn't the second SERVER span be a child of the CLIENT span that represents that inter-service call?

Bas van Beek

@basvanbeek

so you probably are missing 3 spans...

1 SERVER span (the root)

2 CLIENT spans (for each of those SERVER spans you do have)

as I vaguely remember both server spans had different parent id's

Ben Iofel

@benwaffle

yeah, I understand that the missing root is incorrect here, but I'm wondering if all of the SERVER spans are supposed to be children of the root, instead of SERVER -> CLIENT -> SERVER

SERVER -> CLIENT -> SERVER seems right to me, but you are suggesting that it is ROOT -> CHILDx2 -> SERVERx2

Bas van Beek

@basvanbeek

They are not in the scenario I described

Let’s say service a gets a request and based on it needs to call service b and service c

The incoming originating request is a missing server span and is also the root spa

The two outgoing calls to downstream services are two client spans both having the root span as their parent

Both client spans would connect to your existing server spans which are missing their upstream data at the moment

Ben Iofel

@benwaffle

In my scenario, service A calls service B, which calls service C. I'm missing the spans from A, but I would have expected that C's parentId is a part of B. Instead I'm seeing B & C have different, unknown parentIds, so zipkin only renders B.

chuwuu

@chuwuu

7 replies

@basvanbeek i use brave-instrument-grpc in pom,and this is my grpc configure.

Adrian Cole

@adriancole

thanks for helping with support @basvanbeek! I will be out again today, so appreciate your helping others

Arun Gopalpuri

@arun0009

Has anyone done event driven micro services system tracing? We have async services (http with kafka) so how does propagation work in this case?

17 replies

mug3n451

@mug3n451

hi someone can help me with this problem with dependencies pods on zipkin?
Unable to load JDK7 types (java.nio.file.Path): no Java7 type support added
Exception in thread "main" java.io.IOException: Failed to open native connection to Cassandra at {cassandra:9042} :: Can't find class DropwizardMetricsFactory (specified by advanced.metrics.factory.class)

2 replies

xutao

@xutao42376347_twitter

This is empty. Do I have any configuration

10 replies

But this traceid has a value

There is no error reported in the background log

Tugay Ersoy

@Admiralkheir

guys is it possible to use zipkin-dependencies with kubernetes cronjob

Tugay Ersoy

@Admiralkheir

apiVersion: batch/v1beta1
kind: CronJob 
metadata:
  name:
    zipkin-dependencies-cronjob
  labels:
    app: zipkin-dependencies
spec:
  schedule: "00 20 * * *"
  concurrencyPolicy: Forbid
  jobTemplate:
    spec:
      template:
        spec:
          restartPolicy: Never
          containers:
          - name: zipkin-dependencies
            image: openzipkin/zipkin-dependencies 
            env:
              - name: STORAGE_TYPE
                value: "elasticsearch"
              - name: ES_HOSTS
                value: "value"

it worked if someone needs this.

teenaBuchade

@teenaBuchade

Hi i am using zipkin zipkin-server-2.22.2-exec.jar jar to run zipkin server and using in-memory db , i am having problem creating dependency graph

Arun Gopalpuri

@arun0009

is there a way to set brave tracing globally? I see that open tracing util has a GlobalTracer (https://github.com/opentracing/opentracing-java/blob/master/opentracing-util/src/main/java/io/opentracing/util/GlobalTracer.java) but there’s no way to extract Tracing from this GlobalTracer?

3 replies

PARESH BHAVSAR

@pbhavsar9_twitter

HI I have rabbitmq server running and trace data are sent to zipkin queue. How can I communicate rabbitmq username / password / host information to zipkin depoyment file? I would like to deploy zipkin on kubernetes

1 reply

DFazeli

@DFazeli

Hi. I have problem with with zipkin docker with SSL elasticsearch.

version: '3.8'
services:
  zipkin-sit:
     image: openzipkin/zipkin
     container_name: zipkin-sit
     hostname: zipkin-sit
     environment:
      - KAFKA_BOOTSTRAP_SERVERS=x.x.x.x:9092
      - KAFKA_GROUP_ID=zipkin-sit
      - KAFKA_TOPIC=zipkin-sit
      - STORAGE_TYPE=elasticsearch
      - ES_HOSTS=https://x.x.x.x:9200
      - ES_USERNAME=zip
      - ES_PASSWORD=zipkinpassword
      - ES_INDEX=index-zipkin
      - ES_javax.net.ssl.trustStoreType=PKCS12
      - ES_javax.net.ssl.trustStore=/opt/elastic-certificates.p12
      - ES_javax.net.ssl.keyStore=/opt/elasticsearch.keystore
     ports:
      - 9411:9411
     volumes:
      - /etc/localtime:/etc/localtime:ro
      - zipkin_ssl:/opt/
volumes:
    zipkin_ssl:
       name: zipkin_ssl

And ES config is:

xpack.security.enabled: true
xpack.security.transport.ssl.enabled: true
xpack.security.transport.ssl.verification_mode: certificate
xpack.security.transport.ssl.keystore.path: /etc/elasticsearch/elastic-certificates.p12
xpack.security.transport.ssl.truststore.path: /etc/elasticsearch/elastic-certificates.p12
xpack.security.http.ssl.enabled: true
xpack.security.http.ssl.keystore.path: "http.p12"

I have this Error:

zipkin-sit    | 2020-12-15 07:03:01.811  INFO [/] 1 --- [oss-http-*:9411] c.l.a.s.Server                           : Serving HTTP at /0.0.0.0:9411 - http://127.0.0.1:9411/
zipkin-sit    | 2020-12-15 07:03:37.537  WARN [/] 1 --- [cking-tasks-1-7] z.s.i.BodyIsExceptionMessage             : Unexpected error handling request.
zipkin-sit    |
zipkin-sit    | java.util.concurrent.RejectedExecutionException: General OpenSslEngine problem
zipkin-sit    |         at zipkin2.elasticsearch.internal.client.HttpCall.lambda$sendRequest$3(HttpCall.java:227) ~[zipkin-storage-elasticsearch-2.23.0.jar:?]
zipkin-sit    |         at java.util.concurrent.CompletableFuture.uniExceptionally(Unknown Source) ~[?:?]
zipkin-sit    |         at java.util.concurrent.CompletableFuture$UniExceptionally.tryFire(Unknown Source) ~[?:?]
zipkin-sit    |         at java.util.concurrent.CompletableFuture.postComplete(Unknown Source) ~[?:?]
zipkin-sit    |         at java.util.concurrent.CompletableFuture.completeExceptionally(Unknown Source) ~[?:?]
zipkin-sit    |         at com.linecorp.armeria.common.HttpMessageAggregator.fail(HttpMessageAggregator.java:140) ~[armeria-1.2.0.jar:?]
zipkin-sit    |         at com.linecorp.armeria.common.HttpMessageAggregator.onError(HttpMessageAggregator.java:56) ~[armeria-1.2.0.jar:?]
zipkin-sit    |         at com.linecorp.armeria.common.stream.FilteredStreamMessage$FilteringSubscriber.onError(FilteredStreamMessage.java:198) ~[armeria-1.2.0.jar:?]
zipkin-sit    |         at com.linecorp.armeria.common.stream.AbstractStreamMessage$CloseEvent.notifySubscriber(AbstractStreamMessage.java:280) ~[armeria-1.2.0.jar:?]
zipkin-sit    |         at com.linecorp.armeria.common.stream.DefaultStreamMessage.notifySubscriberOfCloseEvent0(DefaultStreamMessage.java:264) ~[armeria-1.2.0.jar:?]
zipkin-sit    |         at com.linecorp.armeria.common.stream.DefaultStreamMessage.notifySubscriberOfCloseEvent(DefaultStreamMessage.java:256) ~[armeria-1.2.0.jar:?]
zipkin-sit    |         at com.linecorp.armeria.common.stream.DefaultStreamMessage.handleCloseEvent(DefaultStreamMessage.java:436) ~[armeria-1.2.0.jar:?]
zipkin-sit    |         at com.linecorp.armeria.common.stream.DefaultStreamMessage.notifySubscriber0(DefaultStreamMessage.java:368) ~[armeria-1.2.0.jar:?]
zipkin-sit    |         at com.linecorp.armeria.common.RequestContext.lambda$makeContextAware$3(RequestContext.java:502) ~[armeria-1.2.0.jar:?]
zipkin-sit    |         at io.netty.util.concurrent.AbstractEventExecutor.safeExecute(AbstractEventExecutor.java:164) ~[netty-common-4.1.53.Final.jar:4.1.53.Final]
zipkin-sit    |         at io.netty.util.concurrent.SingleThreadEventExecutor.runAllTasks(SingleThreadEventExecutor.java:472) ~[netty-common-4.1.53.Final.jar:4.1.53.Final]
zipkin-sit    |         at io.netty.channel.epoll.EpollEv

2 replies

Where communities thrive

People

Repo info

Activity