by

Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • Sep 11 00:10
  • Sep 02 06:49
    dependabot-preview[bot] labeled #24
  • Sep 02 06:49
    dependabot-preview[bot] review_requested #24
  • Sep 02 06:49
    dependabot-preview[bot] opened #24
  • Sep 02 06:49

    dependabot-preview[bot] on maven

    Bump credentials from 2.3.12 to… (compare)

  • Sep 02 06:39
    dependabot-preview[bot] labeled #60
  • Sep 02 06:39
    dependabot-preview[bot] review_requested #60
  • Sep 02 06:39
    dependabot-preview[bot] opened #60
  • Sep 02 06:39

    dependabot-preview[bot] on maven

    Bump credentials from 2.3.12 to… (compare)

  • Sep 01 06:53
    dependabot-preview[bot] labeled #23
  • Sep 01 06:53
    dependabot-preview[bot] review_requested #23
  • Sep 01 06:53
    dependabot-preview[bot] opened #23
  • Sep 01 06:53

    dependabot-preview[bot] on maven

    Bump plugin from 4.6 to 4.7 Bu… (compare)

  • Sep 01 06:42
    dependabot-preview[bot] labeled #59
  • Sep 01 06:42
    dependabot-preview[bot] review_requested #59
  • Sep 01 06:42
    dependabot-preview[bot] opened #59
  • Sep 01 06:42

    dependabot-preview[bot] on maven

    Bump plugin from 4.6 to 4.7 Bu… (compare)

  • Aug 24 15:50

    dependabot-preview[bot] on maven

    (compare)

  • Aug 24 15:50

    stellargo on master

    Bump jenkins-test-harness from … (compare)

Oleg Nenashev
@oleg-nenashev
stellargo
@stellargo
Woah!
I just went down the path of history of Redis after reading this :P
stellargo
@stellargo
stellargo
@stellargo
Also jenkinsci/redis-fingerprint-storage-plugin#23 (but this depends on 4817 to actually get merged)
Oleg Nenashev
@oleg-nenashev
Looks like both me and @afalko are quite exhausted after vacation :)
2 replies
stellargo
@stellargo
Created jenkinsci/jenkins#4834 for new way of configuring fingerprints
Oleg Nenashev
@oleg-nenashev
:+1: will try to review today
stellargo
@stellargo
So I am using hetero-radio (why? only one fingerprint storage should be allowed to be able to configured at a given time) to configure the fingerprint configuration using descriptors. Does this persist the data? because it seems like it doesn't
6 replies
stellargo
@stellargo
(what I am trying to do -> every storage now has a descriptor. Using the descriptor, we should be able to configure a storage)
Oleg Nenashev
@oleg-nenashev
I will have to drop after 30 min today. Got an unexpected meeting at CDF I need to attend. Sorry for the late notice
stellargo
@stellargo
No worries :)
michael cirioli
@mikecirioli
currently in another meeting, but i expect it to end in 10-15 minutes and will join then
stellargo
@stellargo
Is it possible to decouple the DescriptorImpl from the class it describes into another file? I don't want file sizes to become huge
Oleg Nenashev
@oleg-nenashev
@stellargo yes, it is possible
stellargo
@stellargo

Subject: Ideas Discussion: Tracing fingerprints (artifacts, credentials, docker images, etc.) across Jenkins Instances!

Hi Everyone!

I would like to start this thread to discuss some opinions and new ideas with the community regarding fingerprints and tracing.

We have been working on the Jenkins link:[fingerprint] engine, and we have made great progress so far. We have been able to make the Jenkins fingerprinting engine 'pluggable', which basically means that now the fingerprints created by Jenkins can be stored in the cloud, away from the local disk storage of Jenkins master. Currently we only have one link:[plugin] which can support this, which is powered by Redis.

One of the advantages we got out of this project was the ability to track fingerprints across instances. What this can help in achieving is tracking usage of artifacts, credentials, docker images, etc. across instances of Jenkins. We can leverage our current project to provide such functionalities. But doing so only makes sense if there is some need for it. Also, there can be other potential use cases that we may have missed. We would love to discuss ideas around this, which can benefit the Jenkins community.

More information about the project can be found on the link:[project page] and link:[blog].

We would deeply appreciate suggestions and comments on this topic from the developer community, and potential areas where you think this project can help you or other Jenkins users.

Best Regards,
Sumit

@oleg-nenashev @afalko @mikecirioli I will post this on the dev mailing list tomorrow evening to get more reach on a Monday. If there are any suggestions do let me know :)
Oleg Nenashev
@oleg-nenashev
@stellargo looks great!
Oleg Nenashev
@oleg-nenashev
@stellargo Hm? According to my calendar, we have 36 minutes before the meeting starts :)
stellargo
@stellargo
Oh! I am so sorry :P I got confused with Thursday timings
Updated :P
stellargo
@stellargo
In today's meeting we discussed the PostgreSQL plugin and it's implementation. There are two aspects that are important from a design perspective:
  • We need ORM to convert the fingerprints into JSON and not XML. Why? This will help us save the data as jsonb inside postgres and allow querying it directly from the database based on the use case. Example: searching for container ids from docker traceability plugin across jenkins instances. XStream seems to have a driver for JSON, but I am not aware about any other plugin that may have tried this so we can have a precedent.
  • Whilst postgres would allow query this jsonb documents, does it make sense to define a partial schema for the fingerprints? Whilst we can do that for some part of fingerprint data, we cannot do that for FingerprintFacet as facet is unstructured, schemaless and depends on the plugin that created it. So do we store the entire fingerprint as a blob of JSON, or we just store the facets as blobs. In the latter approach, we can index the other fields of fingerprint like md5, but I am not sure how much of an advantage that offers.
8 replies
@oleg-nenashev @afalko @mikecirioli ^
stellargo
@stellargo
@oleg-nenashev Would you say jenkinsci/jenkins#4834 is merge ready?
stellargo
@stellargo
Oleg Nenashev
@oleg-nenashev
@stellargo w.r.t the core PR, let's wait a bit. Next regular weekly release will be on Jul 21, so no hurry
1 reply
Oleg Nenashev
@oleg-nenashev
Hi @stellargo . What is the key area for me to focus on w.r.t the feedback?
stellargo
@stellargo
Hi @oleg-nenashev! I am sorry, which feedback is being referred to here?
Oleg Nenashev
@oleg-nenashev
I mean, what reviews/answers/comments are needed from me? Trying to catch up with things
stellargo
@stellargo

In today's meeting we discussed the PostgreSQL plugin and it's implementation. There are two aspects that are important from a design perspective:

  • We need ORM to convert the fingerprints into JSON and not XML. Why? This will help us save the data as jsonb inside postgres and allow querying it directly from the database based on the use case. Example: searching for container ids from docker traceability plugin across jenkins instances. XStream seems to have a driver for JSON, but I am not aware about any other plugin that may have tried this so we can have a precedent.
  • Whilst postgres would allow query this jsonb documents, does it make sense to define a partial schema for the fingerprints? Whilst we can do that for some part of fingerprint data, we cannot do that for FingerprintFacet as facet is unstructured, schemaless and depends on the plugin that created it. So do we store the entire fingerprint as a blob of JSON, or we just store the facets as blobs. In the latter approach, we can index the other fields of fingerprint like md5, but I am not sure how much of an advantage that offers.

One would be this ^

Migration PR: jenkinsci/jenkins#4825
Oleg Nenashev
@oleg-nenashev
Thanks! Will do my best to review/comment today
stellargo
@stellargo
Thanks Oleg! As you feel comfortable, no hurry :)
stellargo
@stellargo
It seems like ci.jenkins.io is down
Oleg Nenashev
@oleg-nenashev
It is upgrading now - security release rollout
stellargo
@stellargo
@oleg-nenashev I am little confused about what is happening at jenkinsci/redis-fingerprint-storage-plugin#36. Did you by chance review an old commit?
Your comments are appearing on old commits (outdated code)
I have not pushed any code since
Oleg Nenashev
@oleg-nenashev
@stellargo yes, looks like my review had some cached comments
stellargo
@stellargo
No problem :)
Oleg Nenashev
@oleg-nenashev
I can start a session in CDF Zoom @stellargo
stellargo
@stellargo
@oleg-nenashev jenkinsci/jenkins#4834 merge ready?