Hi. I'm tracing the processing of a request along an asynchronous pipeline (connected by message queues). All spans along the pipeline for a single request have the same traceId. I'm sending the data to a local zipkin for testing and to lightstep.com for production. Traces are displayed very differently in both systems. In particular, I'm surprised zipkin shows a span that covers the whole pipeline with a duration that is the sum of all spans. I'm not reporting this span (not at least with this duration) and I'm guessing this is due to the traceId, but I haven't been able to confirm this behavior.
The same processing in lightstep only shows the individual spans, but not a summary of the processing for the traceId.
Hello everybody, I am new to zipkin. I would like to send traces and spans to Zipkin throutgh ActiveMQ (JMS). Is there some example code? I work with Java and I would create a simple console program that publish message to queue (named 'zipkin') and view traces and spans on Zipkin'UI. Thanks.
I think a lot of us are having issues with how to capture individual trace id's per message, when dealing with a messaging queue. I am using Kafka and all of my messages that are getting processed have the same traceId. How do I configure this so I have different traceId per message?
okay, I checked and my spring application is producing the topic in kafka and consuming it. zipkin is somehow not consuming it though. is that a faulty configuration? I gave it the same broker adress as I gave neo4j, which can consume its topics. In environment variables I only give zipkin the kafka.bootstrap.servers:
@dsimonow that is correct (see please slightly old but still relevant issue openzipkin/zipkin#1630), so basically the way to go about it is to run Spark job regularly (fe schedule daily run), it will crunch over all traces and reconstruct the dependency graph
I need to send out traces from apollo-server integrated with express using zipkin. Not able to get it done. Any pointers/ help
Hi all,
I'm having a general question, as I understand I can use zipkin as a sidecar to add a trace_id to my logs and then forwared them to a siem => this is for container level logging. What about logging on node level, is it possible to have a traces on node level ?
I'm having a general question, as I understand I can use zipkin as a sidecar to add a trace_id to my logs and then forwared them to a siem => this is for container level logging. What about logging on node level, is it possible to have a traces on node level ?
please let me know if somebody created ILM for zipkin index in ES
I was getting this error after index got deleted using ILM - java.lang.RuntimeException: Text fields are not optimised for operations that require per-document field data like aggregations and sorting, so these operations are disabled by default. Please use a keyword field instead. Alternatively, set fielddata=true on [traceId] in order to load field data by uninverting the inverted index. Note that this can use significant memory
Hello Team , i am exploring zipkin server and UI. Current Dependency UI is good but it is lacking to show Realtime data . is there an UI which can pull just dependencies links from dependency tables but the data (success count and failure) can be realtime from trace table ?
Hi all,
Is it ok to collect traces without zipkin-server? We already have all infrastructure for gathering logs from our services. First logs are sent to kafka topic, then logstash get them ftom the topic and push into elastic. Can we gather traces the same way? Maybe you have some recommendations or advices about this architecture.
Is it ok to collect traces without zipkin-server? We already have all infrastructure for gathering logs from our services. First logs are sent to kafka topic, then logstash get them ftom the topic and push into elastic. Can we gather traces the same way? Maybe you have some recommendations or advices about this architecture.
Zipkin version: 2.23.2 , ES Version: AWS ES 7.9
I have setup zipkin to write spans to our AWS managed ES instance. But I am unable to search tags object in ES. They have been marked as unknown datatype and are not enabled in the template.
How can I resolve this?
The zipkin template is:
{
"zipkin-span-2021-08-11" : {
"aliases" : { },
"mappings" : {
"_source" : {
"excludes" : [ "_q" ]
},
"dynamic_templates" : [ {
"strings" : {
"match" : "*",
"match_mapping_type" : "string",
"mapping" : {
"ignore_above" : 256,
"norms" : false,
"type" : "keyword"
}
}
} ],
"properties" : {
"_q" : {
"type" : "keyword"
},
"annotations" : {
"type" : "object",
"enabled" : false
},
"duration" : {
"type" : "long"
},
"id" : {
"type" : "keyword",
"ignore_above" : 256
},
"kind" : {
"type" : "keyword",
"ignore_above" : 256
},
"localEndpoint" : {
"dynamic" : "false",
"properties" : {
"serviceName" : {
"type" : "keyword"
}
}
},
"name" : {
"type" : "keyword"
},
"parentId" : {
"type" : "keyword",
"ignore_above" : 256
},
"remoteEndpoint" : {
"dynamic" : "false",
"properties" : {
"serviceName" : {
"type" : "keyword"
}
}
},
"shared" : {
"type" : "boolean"
},
"tags" : {
"type" : "object",
"enabled" : false
},
"timestamp" : {
"type" : "long"
},
"timestamp_millis" : {
"type" : "date",
"format" : "epoch_millis"
},
"traceId" : {
"type" : "keyword"
}
}
},
"settings" : {
"index" : {
"number_of_shards" : "5",
"provided_name" : "zipkin-span-2021-08-11",
"creation_date" : "1628640006251",
"requests" : {
"cache" : {
"enable" : "true"
}
},
"number_of_replicas" : "1",
"uuid" : "-BYja4VdRb6PdKOd5nFxRg",
"version" : {
"created" : "7090199"
}
}
}
}
}
2 replies
zipkin.ui.basepath not work
1 reply
Hi, has anyone here used ZipkinJS with a web framework like Express and thread workers? My goal is to capture a trace from start (incoming req) to finish (worker task processed), when work is delegated to a node thread. My issue right now is that context is lost, since threads don't share variables and the context is not serializable. anyone have ideas/examples?
1 reply
Hi guys. Need to inject span context or something into my kafka messages (using sarama/golang) does this lib helps with this situation? I imagine something like: inject spanContext at kafka's message Header and extract it from the header in the other microservice. Thanks (in short, I need to follow the span along all the microservices that communicates using kafka).
2 replies
I notice there's not a lot of activity on Brave. Is there anyone available to review openzipkin/brave#1306
This fixes openzipkin/brave#1295 and spring-cloud/spring-cloud-sleuth#1814
This fixes openzipkin/brave#1295 and spring-cloud/spring-cloud-sleuth#1814
1 reply
elasticsearch-7.12.1, elasticsearch-7.14.1
ERROR: cannot load service names: Request processing failed; nested exception is java.lang.IllegalStateException: response for update-template failed: {"error":{"root_cause":[{"type":"invalid_index_template_exception","reason":"index_template [zipkin:span_template] invalid, cause [Validation Failed: 1: index_pattern [zipkin:span-] must not contain a ':';]"}],"type":"invalid_index_template_exception","reason":"index_template [zipkin:span_template] invalid, cause [Validation Failed: 1: index_pattern [zipkin:span-] must not contain a ':';]"},"status":400}
elasticsearch-7.0.0, elasticsearch-7.7.1
ERROR: cannot load service names: Request processing failed; nested exception is java.lang.IllegalStateException: response for update-template failed: {"error":{"root_cause":[{"type":"illegal_argument_exception","reason":"Setting index.mapper.dynamic was removed after version 6.0.0"}],"type":"illegal_argument_exception","reason":"Setting index.mapper.dynamic was removed after version 6.0.0"},"status":400}
any guidance would be appreciated
I' using zipkin 2.11.7
Hi Team
I am new to ZipKin. I installed the ZipKin server. When i tried to run these commands. java -jar zipkin. curl -SSL https://zipkin.io/quickstart.sh | bash -s
java -jar zipkin.jar i get unable to access jar file. I have installed java 8.Can you please advice.
Hi Team,
I am new to Zipkin, I have deployed zipkin pod in my k8s environment, I am getting traces from istio-ingressgateway but not from kafka. Getting below error in the logs
2021-09-15 16:35:52.476 %clr(DEBUG) %clr([/]){yellow} 1 --- [pool-2-thread-1] z.c.k.KafkaCollectorWorker : Kafka polling returned batch of 0 messages.
2021-09-15 16:35:53.478 %clr(DEBUG) %clr([/]){yellow} 1 --- [pool-2-thread-1] z.c.k.KafkaCollectorWorker : Kafka polling returned batch of 0 messages.
2021-09-15 16:35:54.480 %clr(DEBUG) %clr([/]){yellow} 1 --- [pool-2-thread-1] z.c.k.KafkaCollectorWorker : Kafka polling returned batch of 0 messages.
2021-09-15 16:35:55.481 %clr(DEBUG) %clr([/]){yellow} 1 --- [pool-2-thread-1] z.c.k.KafkaCollectorWorker : Kafka polling returned batch of 0
I am new to Zipkin, I have deployed zipkin pod in my k8s environment, I am getting traces from istio-ingressgateway but not from kafka. Getting below error in the logs
2021-09-15 16:35:52.476 %clr(DEBUG) %clr([/]){yellow} 1 --- [pool-2-thread-1] z.c.k.KafkaCollectorWorker : Kafka polling returned batch of 0 messages.
2021-09-15 16:35:53.478 %clr(DEBUG) %clr([/]){yellow} 1 --- [pool-2-thread-1] z.c.k.KafkaCollectorWorker : Kafka polling returned batch of 0 messages.
2021-09-15 16:35:54.480 %clr(DEBUG) %clr([/]){yellow} 1 --- [pool-2-thread-1] z.c.k.KafkaCollectorWorker : Kafka polling returned batch of 0 messages.
2021-09-15 16:35:55.481 %clr(DEBUG) %clr([/]){yellow} 1 --- [pool-2-thread-1] z.c.k.KafkaCollectorWorker : Kafka polling returned batch of 0
This is my zipkin manifest file
apiVersion: v1
kind: Service
metadata:
name: zipkin
labels:
app: zipkin
spec:
type: NodePort #Specify as NodePort way to expose the exit
type: ClusterIP
ports:
- name: server
port: 9411
targetPort: 9411nodePort: 30190 #Specify the Nodeport port
protocol: TCP
selector:
app: zipkin
apiVersion: apps/v1
kind: Deployment
metadata:
name: zipkin
labels:
name: zipkin
spec:
replicas: 1
selector:
matchLabels:
app: zipkin
template:
metadata:
labels:
app: zipkin
spec:
containers:
- name: zipkin
image: openzipkin/zipkin:2.22
ports:
- containerPort: 9411
env:
- name: JAVA_OPTS
value: "
-Xms512m -Xmx512m
-Dlogging.level.zipkin=DEBUG
-Dlogging.level.zipkin2=DEBUG
-Duser.timezone=Asia/Shanghai
"
- name: STORAGE_TYPE
value: "elasticsearch" #Set the data to be stored in ES
- name: ES_HOSTS
value: "elasticsearch-master:9200" #ES address
- name: ES_INDEX #Set the zipkin index name stored in ES
value: "zipkin"
- name: ES_INDEX_REPLICAS #ES index copy number
value: "1"
- name: ES_INDEX_SHARDS #ES fragment number
value: "3"
- name: ES_USERNAME #If ES enables x-pack, you need to set a user name and password
value: "elastic"
- name: ES_PASSWORD
value: "CXExcDB4qGvRBDzei2Bj"
- name: KAFKA_BOOTSTRAP_SERVERS #Kafka address
value: "kafka:9092"
- name: KAFKA_TOPIC #Kafka Topic name, default is "zipkin"
value: "zipkin"
- name: KAFKA_GROUP_ID #Kafka group name, default is "zipkin"
value: "zipkin"
- name: KAFKA_STREAMS #The number of threads that consume Topic, the default is 1
value: "1"
resources:
limits:
cpu: 1000m
memory: 512Mi
requests:
cpu: 500m
memory: 256Mi
Hi Guys, I need help in setting up Zipkin with Casandra or MySQL. So far I have tested with Zipkin docker. I could not find any proper documentation on setting up Zipkin with Casandra or MySQL. I have no Java knowledge to build Jar from the source. Is there any readily available Jar which can work with Casadra using some YML config file?