Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Eirik Tsarpalis
    @eiriktsarpalis
    hello, world!
    Kostas Rontogiannis
    @krontogiannis
    yo
    Eirik Tsarpalis
    @eiriktsarpalis
    'sup?
    Kostas Rontogiannis
    @krontogiannis
    This message was deleted
    Aggelos Biboudis
    @biboudis
    runtime.Run <@ cloud { return 42 } @>
    Nick Palladinos
    @palladin
    hi
    Nikos Baxevanis
    @moodmosaic
    heλλο worλd :bowtie:
    Nick Palladinos
    @palladin
    Hi Nick
    Lena
    @lenadroid
    Hi guys ) hope weekend is going fine. I have a question - is it possible to create a job with updatable input parameter, e.g. list or seq which is updated in real time and data is continuously received, like in observable. And then, we should continuously get results from the cloud computation as they become ready... it's like when the connection between the cloud runtime and client is open, so client is able to add input data and clouds can return updated results
    Kostas Rontogiannis
    @krontogiannis
    @lenadroid Hi, I think you might want to look into our CloudChannel primitive. Although it's lacking documentation it's fairly simple. Here is an example:
    let ch = runtime.DefaultStoreClient.Channel
    
    let spA, rpA = ch.Create<int>()
    let spB, rpB = ch.Create<int>()
    
    let workflow (rpA : IReceivePort<int>) (spB : ISendPort<int>) = 
        cloud {
            while true do
                printfn "Waiting"
                let! result = Cloud.Catch <| rpA.Receive(timeout = 1000)
                match result with
                | Choice1Of2 x -> do! spB.Send(x * x)
                | Choice2Of2 _ -> () 
        }
    
    let job = runtime.CreateProcess(workflow rpA spB)
    
    // Send from client
    ch.Send(spA, 3)
    
    // Receive in client
    ch.Receive(rpB)
    
    
    // Kill and dispose
    job.Kill()
    ch.Delete(rpA)
    ch.Delete(rpB)
    Lena
    @lenadroid
    @krontogiannis Hi! yes, thank you for example )
    Lena
    @lenadroid
    Hey, sorry for the question, how to get the CloudDirectory object from string?
    Eirik Tsarpalis
    @eiriktsarpalis
    you can use the constructor. I think it is public
    Lucas V. F. Ventura
    @lucasvfventura
    Hey guys, I'm getting started with F# and MBrace and I saw that you are looking for contributors to build a machine learning platform on top of MBrace, I would love participate in this project. Who should I contact? I have experience using R, Python, h2o and Spark, they all lack in some point and I think F# + MBrace could really be THE distributed ML platform. I have some ideas regarding model factory as well. Thanks
    Jon Wood
    @jwood803
    That would be really interesting @lucasvfventura!
    Eirik Tsarpalis
    @eiriktsarpalis
    Hi @lucasvfventura, that'd be awesome! There's no MBrace.ML library as of yet, but we'd be keen to get it started. I've worked on a couple of simple ML applications in MBrace together with @brandewinder, so we could obviously help in that direction.
    /cc @mathias-brandewinder
    Nick Palladinos
    @palladin
    Hi @lucasvfventura it would be great to have something like Spark.ML
    If you have mbrace related questions feel free to ask us.
    Lucas V. F. Ventura
    @lucasvfventura
    Hey guys have you hear of Prajna? Also I'm just starting with MBrace, do you have something close to a distributed data frame?
    Nick Palladinos
    @palladin
    Yes we are aware of Prajna. I think the main difference is that our main primitive is the cloud { ... } builder
    and we build everything on top of it.
    About the dataframe... we don't have something similar but I know that Tomas did some similar work with deedle and mbrace https://github.com/BlueMountainCapital/Deedle.BigDemo
    but I'm not familiar with the details of his work.
    Eirik Tsarpalis
    @eiriktsarpalis
    I should add that the MBrace.Flow library defines distributed data structures similar to data frames. But they are part of the library, not baked into the runtime.
    Similarly, a distributed data frame could be defined as part of an ML library
    or perhaps deedle could be integrated with MBrace
    Lucas V. F. Ventura
    @lucasvfventura
    For sure... I'm just taking the time to look deeper into F#, Scala and Spark. I'l try to make a demo combining the R TypeProvider and MBrace to build multiple machine learning models in a distributed way. I think doing this I'll get a sense of the MBrace.
    Eirik Tsarpalis
    @eiriktsarpalis
    Ok, great
    let us know if you have any questions
    afaik some work on mbrace/deedle has already been done by Tomas Petricek, see https://github.com/BlueMountainCapital/Deedle.BigDemo
    Lucas V. F. Ventura
    @lucasvfventura
    Unfortunately I have limited time to work on this =/.. only after work
    I'll take a look at that
    Eirik Tsarpalis
    @eiriktsarpalis
    Sure, no worries :-)