Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Gauthier Segay
    @smoothdeveloper
    I'm slowly figuring things out on all the bits I need to use and the azure development story is a bumpy ride (took me very long to find what is most recent SDK bits, but almost no documentation for it), departing from "complete azure newbie" involves lots of tedious searches in a jungle of APIs, outdated blog posts, msdn doc lagging a lot in showing the current SDK, and frustrating trial/errors to setup authorizations (need to setup classic AD for using most of that azure-sdk-for-net stuff)
    also adding all references I need to F# is getting me closer and closer to Microsoft/visualfsharp#838
    Gauthier Segay
    @smoothdeveloper
    I'm using mbrace to run few processes (.exe that are deployed from a computation), I'd like to know a recommended (or easy) approach to capture console output (that I know how to do) and stream all output to the main mbrace script as it comes out from each machine
    Gauthier Segay
    @smoothdeveloper
    created mbrace channel on https://azured.slack.com/archives/mbrace
    Gauthier Segay
    @smoothdeveloper
    is there a way to provision a mbrace cluster with heterogenous machine sizes? I'm trying to optimize for workload where I know total number of cores that I need, if I need 100 cores, it will provision 3 machines with 32 cores and one with 4 cores
    Eirik Tsarpalis
    @eiriktsarpalis
    You mean targetting WindowsAzure.Storage packages above version 4?
    Eirik Tsarpalis
    @eiriktsarpalis
    Regarding the heterogenous cluster, it's really what the azure cloud service allows you. But you could still make two cloud services of different sizes be part of the same azure cluster. Just specify the same storage/service bus connections strings for both
    and they will be seeing eachother
    Gauthier Segay
    @smoothdeveloper
    Hi @eiriktsarpalis regarding Azure SDK versions, I believe all "WindowsAzure" dependencies are going to be deprecated by new bits (https://github.com/Azure/azure-sdk-for-net), I believe for all the aspects which are exposed under new assemblies (probably storage / Service bus as you mention, but maybe other as well) we should try to favor those.
    thanks for explaination about connection strings / making heterogenous cluster, it makes sense, I'm not yet acquainted with the underlying machinery MBrace uses to "make it happen" :)
    Eirik Tsarpalis
    @eiriktsarpalis
    ok, are those found in nuget?
    Gauthier Segay
    @smoothdeveloper
    yes, Microsoft.Azure.Management.Compute
    Microsoft.Azure.Management.Sql are some I'm using, but there are others for servicebus etc.
    I'm currently working with pre-release packages because stuff is being added actively just to make sure I don't go and implement my own rest client if something is being handled in their new SDK
    right now (not mbrace related) I can't manage classic VM with the new SDK (and with old SDK, there is nothing too, I need to send handcrafted HTTP Requests)
    if MBrace can migrate away from azure "classic" services wherever it is possible, I think it will now be possible to leverage their better SDK
    Gauthier Segay
    @smoothdeveloper
    Eirik Tsarpalis
    @eiriktsarpalis
    Microsoft.Azure.Management libraries I think are restricted to administration of connection strings and other cloud resources
    which is separate to the function of WindowsAzure.* libraries
    MBrace.Azure uses WindowsAzure.* libraries
    MBrace.Azure.Management uses the latter
    Gauthier Segay
    @smoothdeveloper
    I'm still trying to make the virtualnetwork configuration work from my custom .cspkg, I noticed that when I create a cloud service from classic azure portal, it would ask for both .cspkg and .cscfg files, so I suspect that somehow mbrace should accept both those files instead of just .cspkg
    Gauthier Segay
    @smoothdeveloper
    https://github.com/mbraceproject/MBrace.Azure/blob/master/src/MBrace.Azure.Management/Compute.fs#L202 This is called even when I give a cspkg, and it would conflict with the custom configuration I intend to pass (which has a NetworkConfiguration section)
    the service definition is honored (since it ends in the .cspkg) but my custom configuration can't be passed
    Gauthier Segay
    @smoothdeveloper
    should I add a optional parameter to SubscriptionManager.ProvisionAsync which looks like buildMBraceConfig signature? I could pass my own function instead
    Gauthier Segay
    @smoothdeveloper

    bingo, with a patched version of MBrace.Azure.Management, I succeeded setting up the cloud service in my virtual network:

    smoothdeveloper/MBrace.Azure@084e5db

    Gauthier Segay
    @smoothdeveloper
    mbraceproject/MBrace.Azure#155
    Viktor Schepik
    @vschep
    Hi! I really like the demos of MBrace.Azure but I need some help to get it running. I got some exceptions when running the StarterKit and created an issue. Perhaps somebody could help? mbraceproject/MBrace.StarterKit#89
    Gauthier Segay
    @smoothdeveloper
    @vschep just added attempt at troubleshooting your issue
    Viktor Schepik
    @vschep
    @smoothdeveloper just saw it. Awesome! I will try what you recommended right now.
    Gauthier Segay
    @smoothdeveloper
    Viktor Schepik
    @vschep
    Thanks. I have been working with paket a little bit. So I know the usual workflow of paket.dependencies, paket.references and paket install.
    I still get an exception. Shall I post it at the github issue or here?
    Gauthier Segay
    @smoothdeveloper
    please share here I guess
    Viktor Schepik
    @vschep
    I created a new project with paket.dependencies as you recommended. I ran paket install Executing
    #load @"packages/MBrace.Azure/MBrace.Azure.fsx"
    gives
    error FS0084: Assembly reference 'tools/Microsoft.WindowsAzure.Configuration.dll' was not found or is invalid.
    Gauthier Segay
    @smoothdeveloper
    could you open that .fsx and check which contents "highlights red"?
    in my case it contains
    #I __SOURCE_DIRECTORY__
    #r "tools/Newtonsoft.Json.dll"
    #r "tools/FsPickler.Json.dll"
    #r "tools/FsPickler.dll"
    #r "tools/System.Spatial.dll"
    #r "tools/Mono.Cecil.dll"
    #r "tools/Vagabond.AssemblyParser.dll"
    #r "tools/Vagabond.dll"
    #r "tools/Argu.dll"
    #r "tools/Microsoft.Data.Edm.dll"
    #r "tools/Microsoft.Data.OData.dll"
    #r "tools/Microsoft.Data.Services.Client.dll"
    #r "tools/Microsoft.ServiceBus.dll"
    #r "tools/Microsoft.WindowsAzure.Configuration.dll"
    #r "tools/Microsoft.WindowsAzure.Storage.dll"
    #r "tools/MBrace.Core.dll"
    #r "tools/MBrace.Runtime.dll"
    #r "tools/MBrace.Azure.dll"
    
    open System.IO
    open MBrace.Azure
    
    AzureWorker.LocalExecutable <- Path.Combine(__SOURCE_DIRECTORY__, "tools/mbrace.azureworker.exe")
    I also do see the assemblies under tools folder, are you running on windows?
    Viktor Schepik
    @vschep
    Yes, I am running on windows.
    Red lines:
    Gauthier Segay
    @smoothdeveloper
    you could try to just reference that "Microsoft.WindowsAzure.Configuration.dll" assembly to make sure it does work on it's own
    Viktor Schepik
    @vschep

    load @"packages/MBrace.Azure/MBrace.Azure.fsx"

    sorry
    #load @"packages/MBrace.Azure/MBrace.Azure.fsx"
    #r "tools/Microsoft.WindowsAzure.Configuration.dll"
    Gauthier Segay
    @smoothdeveloper
    blob
    I can run this in FSI and it works, currently the version in my working copy is 1.3
    so the #r "tools/Microsoft.WindowsAzure.Configuration.dll"line is red in your case?
    Viktor Schepik
    @vschep
    red.png
    I can't find the tools directory