by

Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Michael Menousek
    @michaelmenousek
    Yes
    4559
    Jason Smith
    @jlcsmith
    Exactly. Likely STANAG 4609 as well
    Brad Hards
    @bradh
    OK (4545 == NATO NITF)
    MISB KLV metadata?
    Michael Menousek
    @michaelmenousek
    Yes and yes.
    All those open standards 👍
    Brad Hards
    @bradh
    Is anyone else having trouble with https://codice.atlassian.net/ ?
    Known outage?
    Michael Menousek
    @michaelmenousek
    Yep. Atlassian issues.
    It's been reported
    Brad Hards
    @bradh
    Thanks. Won't dupe.
    Michael Menousek
    @michaelmenousek
    Just got this
    Dear Michael,
    We are contacting you regarding a potential loss in data that may have occurred on your JIRA/Confluence/Bamboo Cloud instance. On Friday 1st April (UTC) we recognized a storage node failed and did not recover due to a hardware failure. The failed node caused a service outage of approximately 4.5 hours and up to 4 hours of data loss.
    We became aware of this at 7:50PM UTC and rolled out full fixes by 12:10AM UTC. The fix included restoring your data to the last point of replication recorded. This means any action performed up to 4 hours before the service outage has potentially been lost. We are contacting you because we identified your instance was affected by this service outage. If you want to know the exact time of the last replication we restored to, please raise a support ticket via support.atlassian.com.
    We take the trust you place in us with your data very seriously. We sincerely apologize for any data loss you may have experienced. Our team is working hard so that you can build great things with your team. Atlassian needs to be there anytime you need it, and that’s our goal.
    Cheers,
    The Atlassian team
    Brad Hards
    @bradh
    Ouch. That wouldn't explain why its still out though (a couple of hours later), unless there is something bad in the restore.
    Brad Hards
    @bradh
    Is there an example of an input transformer that listens on a network port?
    I'm thinking about the CoT pubsub approach, but anything similar might stop me making (more) mistakes.
    William Miller
    @millerw8
    There is some work being done for ftp, not sure if that is published yet though
    and that is handling content, not metadata. I think typically the transformer would be invoked by a service endpoint, whether that be on its own port or just another path
    it seems maybe you would want a pub-sub capability separate from the CoT input transformer, but use them together to achieve the capability
    or, seperate whatever the input mechanism from whatever the transformer mechanism
    Brad Hards
    @bradh
    I don't want to publish yet. I just want to send a subscription request, then get sent UDP packets.
    William Miller
    @millerw8
    similar to how the CSW endpoint has a related csw input transformer
    William Miller
    @millerw8
    so, essentially a source, which could use a camel route ( netty ?) to go from a udp to your transformer ?
    the spell correct on this thing is killing me
    Brad Hards
    @bradh
    Maybe go back a step. So the goal is to turn UDP (or perhaps TCP) packets containing some XML (CoT format) into metacard entries.
    William Miller
    @millerw8
    right, so that is the transformer right? so the question is how to capture those packets and route them to the transformer...
    Brad Hards
    @bradh
    Are you just confirming that the "some XML (CoT format) into metacard entries" part is the transformer?
    William Miller
    @millerw8
    yeah
    Brad Hards
    @bradh
    So I can decouple the transformer from the source.
    That'll obviously make testing easier...
    William Miller
    @millerw8
    yeah, and that is typically the model seen in other sources
    there is a CSW input transformer, and there is a CSW Source, and CSW endpoint
    and this decoupling allows additional capabilities, like serializing your database out to CSW Records through the CLI
    Brad Hards
    @bradh
    OK, clearer.
    In the CSW case (or more generally), does the input transformer handle conversion of CSW format to metacards, or is it bidirectional? Equivalently, is there an output transformer to service the CSW endpoint?
    William Miller
    @millerw8
    The inputTransformer handles both directions
    I say that but am lying
    Brad Hards
    @bradh
    simplifications are inherent in chat...
    I'm just trying to get enough of the big picture for the code samples to make sense.
    but it implements the InputTransformer for the one, and MetacardTransformer for the other
    Brad Hards
    @bradh
    So the flow would look like Source > InputTransformer > (store) > MetacardTransformer > Endpoint
    In the CoT case, the endpoint might just send UDP packets instead of being a HTTP server that you connect to.
    Jason Smith
    @jlcsmith
    Brad - on my phone now, but there is work going on currently that might be close to what you want. We are creating a udp endpoint that will subscribe to a video stream.
    Chunk video and create metacards
    Brad Hards
    @bradh
    OK, from the KLV.
    William Miller
    @millerw8
    the flow sounds correct
    Jason Smith
    @jlcsmith
    Yes
    Brad Hards
    @bradh
    Given the decoupling, I'm OK with the InputTransformer bit for now. I'll just throw files at it for test.