Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
    Jozsef Bartok
    @jbartok
    Hi Ajinkya. Here is the design document we have written for the Portable Runner: https://docs.google.com/document/d/1Zss2WkwknLgWMXZSwjUXS-mFSkIynsulTiiLW6zQYvs/edit?usp=sharing
    send me your email address and I'll put you on our candidate list, and send you the email we have so far sent out
    skalogerakis
    @skalogerakis
    Hi, I am interested in contributing to Implement Apache Beam Portable Jet Runner or RocksDB as a state backend for Jet from proposals list. I would like anyone to give some guidelines to get started!
    Nicolas Frankel
    @nfrankel
    to all students wanting to join the gsoc 2020
    please check available proposals:
    https://docs.google.com/document/d/1w-84eTO8GGQEMg6Okv_B1UFxfpNPoqJQ1SZi9ECGWDY/edit?usp=sharing
    then send me privately:
    • your name
    • your email
    • the proposal(s) you'd like to work on
    reading the guidelines is part of the evaluation ;-)
    tall15421542
    @tall15421542

    I am working on the RocksDB as a state backend for Jet. For the detailed proposal, I have two questions.

    • What’s the use case expectation in JET? Ideally, I would tune the RocksDB for the general case in the default setting, and let it be configurable for different applications and provide a tuning guideline for different scenarios (for example when data is skewed, or the workload is fluctuating). Because I am new to stream processing, I would like to know which use case is the JET team most care about and which use case is expected to introduce tuning guidelines.
    • The detailed proposal mentions the leak's robustness. I think if a job is done, the complete method in com.hazelcast.jet.core.Processor would be called and that’s the time we can remove states in the state backend. My question is that where is the logic when a job failure occurs? When would a job fail and drop instead of using snapshots to recover it? Can anyone provide the reference or source code for that? thank you very much!

    I know the snapshot persistence is out of the GSoC scope this time, but I still curious about two things.

    • Why the new proposal does not involve a snapshot as the window aggregation case? In my understanding, group by key + join + aggregate are stateful operator so their states are also recorded in the global snapshot. I am just curious about the difference and specialty in the window aggregation operation!
    • Why use IMap instead of other distributed file systems to store the global snapshot? After reading the doc of JET, my understanding is that the snapshot is needed mainly in two cases. One is node failure, the other is the topology change, both of them involves stalling the operators and restart them after the state is redistributed. Are these two cases happen frequently? Is it worthy to use memory resources (IMap) instead of storage(like HDFS) to avoid potential memory resource contention?

    This is my first time participating in the open-source project, please guide me on how to ask great questions if my question is inappropriate, like I should ask the second part of the question in other channels. Any feedback is appreciated, thank you very much!

    Jozsef Bartok
    @jbartok
    @skalogerakis pls. see the link above, that I've sent to Ajinkya; also pls. contact Nicolas Frankel so that we can register you properly
    Nicolas Frankel
    @nfrankel
    @tall15421542 please send your question in an email to your mentor(s)
    let's keep this channel for non-project related questions
    thanks
    Ajinkya
    @ajinkyajawale14_gitlab
    @jbartok Hi Thanks for replying. here is my email, ajinkyajawale14499@gmail.com it is my pleasure to work under your guidance, Thanks :)
    tall15421542
    @tall15421542
    @nfrankel OK! Sorry for interrupting the channel!
    Nicolas Frankel
    @nfrankel
    @tall15421542 no worries!
    just advice
    Can Gencer
    @cangencer
    @tall15421542 let's discuss on the jet gitter channel https://gitter.im/hazelcast/hazelcast-jet
    you can repost the questions there, most of jet development team is on that channel
    tall15421542
    @tall15421542
    @cangencer Ok! Thank you very much!
    Sahil Jha
    @sjha2048
    Hello everyone, I have shared my proposal's draft on the gsoc organisation dashboard so requesting the mentors to please review it once and suggest the changes.
    Nicolas Frankel
    @nfrankel
    @sjha2048 please contact your mentor for each proposal directly
    this channel is for general questions
    Sahil Jha
    @sjha2048
    Thank you for information.
    Nicolas Frankel
    @nfrankel
    hello everybody
    please avoid contacting me on my private email address
    it's no use using it, and you might end up in the spam folder
    i try to be reactive on this channel
    it might take time, but i'll get back to you
    thanks for your understanding
    akash
    @akash85207889_twitter
    Hello everyone
    I've registered for gsoc 2020 and interested in improve telemetry
    Arun Prakash
    @arunprakashpj
    Sure and Thanks for the clarification @nfrankel
    Nicolas Frankel
    @nfrankel
    you're welcome @arunprakashpj
    Firnas Aleem
    @AMFIRNAS
    Hi..
    I am new to here
    I would like to contribute and participate gsoc
    Nicolas Frankel
    @nfrankel
    hello and welcome @AMFIRNAS
    please read the instructions at the top of the messages' list
    Firnas Aleem
    @AMFIRNAS
    yes, sure
    Nicolas Frankel
    @nfrankel
    dear students
    due to exceptional circumstances
    please note the timeline has been slightly changed
    https://summerofcode.withgoogle.com/how-it-works/#timeline
    however, the deadline to send your proposal is still by march 31st
    you still have one week left
    good luck!
    Mohamed Mandouh
    @MohamedMandouh
    hmm. What if my exams collide with this date? Am I allowed to ask for gsoc project being postponed like 2 weeks?
    @nfrankel
    Nicolas Frankel
    @nfrankel
    sorry @MohamedMandouh
    i make neither the rules nor the timeline
    google does
    for better or worse
    Mohamed Mandouh
    @MohamedMandouh
    okay. I'll consult gsoc support.
    thanks
    Nicolas Frankel
    @nfrankel
    good luck
    Nathan Getachew
    @Nathan-G1
    Hello, This is Nathan, would like to contribute to hazelcast on proposal 1(improving telemetry).
    Nicolas Frankel
    @nfrankel
    to all students wanting to join the gsoc 2020
    please check available proposals:
    https://docs.google.com/document/d/1w-84eTO8GGQEMg6Okv_B1UFxfpNPoqJQ1SZi9ECGWDY/edit?usp=sharing
    then send me privately:
    • your name
    • your email
    • the proposal(s) you'd like to work on
    Nicolas Frankel
    @nfrankel
    dear @/all
    thanks for your interest in google summer of code
    i still receive messages of interest
    the deadline is tomorrow
    to be honest, it's a bit late to read through all the documentation
    and send the proposal before that time
    Marko Topolnik
    @mtopolnik
    I will make this general comment: the biggest concern for a mentor is gaining a preview into how the interaction between you and the mentor is going to work out. Those who contacted a mentor early on, implicitly provided that insight to us. Those who submitted the proposal at the last minute, we can't even distinguish whether it was you who wrote it, let alone how the interaction is going to look like. So your proposal hasn't helped to reduce the risk of taking up mentoring with a student that will turn out to be a waste of time or maybe even an uncomfortable experience.
    Abhinav Talari
    @AbhinavTalari
    Hello, I am new to hazelcast, i wanna learn , contribute and take part in GSOC'2021 , I hope someone could walk me through it , in order to be better.
    vk-2501
    @vk-2501
    Hi, I am Vaishnavi pursuing engineering in Info Tech . I am passionate to learn new tech stack and want to contribute to organisations in order to enhance my skills and gain real world exposure! I also want to take part in GSOC'21 .I am a newbie. Please guide me through this!
    Nicolas Frankel
    @nfrankel
    hello @vk-2501
    thanks for your interest in hazelcast
    1. it's a bit early for gsoc 2021
    2. however, you can already start getting familiar with the codebase
    3. please join our slack channel https://slack.hazelcast.com/ and introduce yourself on #introduction :-)
    Anish Rao Kotha
    @Anish528
    Hello, I am Anish pursuing engineering in computer science. I am new to the world of open source and woud like to start my journey by contributing to hazelcast, I also want to take part in Gsoc 2021. please help me in this.
    Nicolas Frankel
    @nfrankel
    hello anish
    please join our slack https://slack.hazelcast.com/
    and wait until i'm back from vacations
    mi-january
    happy christmas
    Mohamed Mandouh
    @MohamedMandouh
    organization's apply phase didn't even start yet :)
    projects will be announced on 9 Mar.
    you should follow the timeline here
    @Anish528 @vk-2501
    Anish Rao Kotha
    @Anish528
    @nfrankel Thank you
    Nicolas Frankel
    @nfrankel
    thanks for your help @MohamedMandouh
    kamal
    @kamal23317596_twitter
    Hello everyone I'm kamal
    I wanted to know whether hazelcast will be participating in gsoc this summer.
    Nicolas Frankel
    @nfrankel

    hello @kamal23317596_twitter

    please join our slack https://slack.hazelcast.com/
    and wait until i'm back from vacations
    mi-january
    happy christmas