by

Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Michael Menousek
    @michaelmenousek
    Just got this
    Dear Michael,
    We are contacting you regarding a potential loss in data that may have occurred on your JIRA/Confluence/Bamboo Cloud instance. On Friday 1st April (UTC) we recognized a storage node failed and did not recover due to a hardware failure. The failed node caused a service outage of approximately 4.5 hours and up to 4 hours of data loss.
    We became aware of this at 7:50PM UTC and rolled out full fixes by 12:10AM UTC. The fix included restoring your data to the last point of replication recorded. This means any action performed up to 4 hours before the service outage has potentially been lost. We are contacting you because we identified your instance was affected by this service outage. If you want to know the exact time of the last replication we restored to, please raise a support ticket via support.atlassian.com.
    We take the trust you place in us with your data very seriously. We sincerely apologize for any data loss you may have experienced. Our team is working hard so that you can build great things with your team. Atlassian needs to be there anytime you need it, and that’s our goal.
    Cheers,
    The Atlassian team
    Brad Hards
    @bradh
    Ouch. That wouldn't explain why its still out though (a couple of hours later), unless there is something bad in the restore.
    Brad Hards
    @bradh
    Is there an example of an input transformer that listens on a network port?
    I'm thinking about the CoT pubsub approach, but anything similar might stop me making (more) mistakes.
    William Miller
    @millerw8
    There is some work being done for ftp, not sure if that is published yet though
    and that is handling content, not metadata. I think typically the transformer would be invoked by a service endpoint, whether that be on its own port or just another path
    it seems maybe you would want a pub-sub capability separate from the CoT input transformer, but use them together to achieve the capability
    or, seperate whatever the input mechanism from whatever the transformer mechanism
    Brad Hards
    @bradh
    I don't want to publish yet. I just want to send a subscription request, then get sent UDP packets.
    William Miller
    @millerw8
    similar to how the CSW endpoint has a related csw input transformer
    William Miller
    @millerw8
    so, essentially a source, which could use a camel route ( netty ?) to go from a udp to your transformer ?
    the spell correct on this thing is killing me
    Brad Hards
    @bradh
    Maybe go back a step. So the goal is to turn UDP (or perhaps TCP) packets containing some XML (CoT format) into metacard entries.
    William Miller
    @millerw8
    right, so that is the transformer right? so the question is how to capture those packets and route them to the transformer...
    Brad Hards
    @bradh
    Are you just confirming that the "some XML (CoT format) into metacard entries" part is the transformer?
    William Miller
    @millerw8
    yeah
    Brad Hards
    @bradh
    So I can decouple the transformer from the source.
    That'll obviously make testing easier...
    William Miller
    @millerw8
    yeah, and that is typically the model seen in other sources
    there is a CSW input transformer, and there is a CSW Source, and CSW endpoint
    and this decoupling allows additional capabilities, like serializing your database out to CSW Records through the CLI
    Brad Hards
    @bradh
    OK, clearer.
    In the CSW case (or more generally), does the input transformer handle conversion of CSW format to metacards, or is it bidirectional? Equivalently, is there an output transformer to service the CSW endpoint?
    William Miller
    @millerw8
    The inputTransformer handles both directions
    I say that but am lying
    Brad Hards
    @bradh
    simplifications are inherent in chat...
    I'm just trying to get enough of the big picture for the code samples to make sense.
    but it implements the InputTransformer for the one, and MetacardTransformer for the other
    Brad Hards
    @bradh
    So the flow would look like Source > InputTransformer > (store) > MetacardTransformer > Endpoint
    In the CoT case, the endpoint might just send UDP packets instead of being a HTTP server that you connect to.
    Jason Smith
    @jlcsmith
    Brad - on my phone now, but there is work going on currently that might be close to what you want. We are creating a udp endpoint that will subscribe to a video stream.
    Chunk video and create metacards
    Brad Hards
    @bradh
    OK, from the KLV.
    William Miller
    @millerw8
    the flow sounds correct
    Jason Smith
    @jlcsmith
    Yes
    Brad Hards
    @bradh
    Given the decoupling, I'm OK with the InputTransformer bit for now. I'll just throw files at it for test.
    François St-Arnaud
    @fstarnaud
    Hello, quick (an perhaps stupid) question... Can DDF be used as a SAML-based Identity Provider (IdP)? I'm just starting to think about options to setup a lab to simulate interactions with external partners based on NATO's FMN SAML-based Federated Web Auth approach. On my side, I will be using AD FS. On the partern's side, I was thinking of using OpenAM or Shibboleth. But, it just dawned on me... perhaps I simply use DDF?
    Scott Tustison
    @stustison
    Yes it can be used as an IdP. The features to use it like that aren’t installed by default.
    This message was deleted
    it supports redirect and post, which are the most common ways of interacting with an IdP so as long as you’re using SPs that handle one of those two methods, you should be good to go
    François St-Arnaud
    @fstarnaud
    Cool! Sounds good! I'll try it out.
    Michael Menousek
    @michaelmenousek
    Francois are you still researching Kerberos in ddf? Any progress? Anything to contribute? 😉
    François St-Arnaud
    @fstarnaud
    Not currently, no. Yes, we managed to accomplish our objectives. Unfortunately no, since the work has been done under contract for my client who has not yet signed Codice contributing agreements. Also, done as a POC, the code is not up to the quality standards of this group.
    Scott Tustison
    @stustison
    Even not up to the quality standards, it could be something that is worth putting into our SDK to show others how to integrate with Kerberos. Assuming you ever get the go-ahead from your client.
    François St-Arnaud
    @fstarnaud
    It's bean stuck in their legal department for a year now...
    Brad Hards
    @bradh
    If whoever is working the country code translation wants the NTB TEM presentation on country codes from yesterday, ping me at bradh@frogmouth.net
    sastryvdhara
    @sastryvdhara
    I am new to this room. I am wondering if multi-threaded support for DDF is available under Windows. If not. are there plans for it?