Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Sabby Anandan
    @sabbyanandan

    Yes, you can. You'd separate each application-specific properties by: , (comma is the delimiter). Alternatively, you can also use the --propertiesFile option to supply a file with "n" number of properties for each application.

    See: http://docs.spring.io/spring-cloud-dataflow/docs/2.0.1.RELEASE/reference/htmlsingle/#getting-started-local-spring-cloud-dataflow-streams-upgrading

    Lastly, for SCDF questions, please use https://gitter.im/spring-cloud/spring-cloud-dataflow channel going forward.

    cezannetx03
    @cezannetx03_twitter
    Thanks Sabby
    Srinivas
    @Sriniva63328880_twitter
    Hi all
    cezannetx03
    @cezannetx03_twitter
    How does stream update work internally? Support I want to update a stream with this command "stream update --name ORDER --properties version.CREDIT_CARD_VALIDATION=1.0.2-RELEASE". I do see that update will start the credit card app with new version and then stop and remove the old version of credit card app. My question is how does Skipper determine when the old version of credit card can be stopped and removed?
    Sabby Anandan
    @sabbyanandan

    Hi, @cezannetx03_twitter. Here's some relevant info (for k8s) as to how the decision is made.

    Skipper is looking to see if the health endpoint of the Boot application is OK. The spring.cloud.skipper.server.strategies.healthcheck.timeoutInMillis property sets the maximum time the upgrade process waits for a healthy app. The default value is 5 minutes. Skipper fails the deployment if it is not healthy within that time. The spring.cloud.skipper.server.strategies.healthcheck.sleepInMillis property sets how long to sleep between health checks.

    More details is in the ref. guide. A similar strategy is also applied for CF and Local implementations as well.

    cezannetx03
    @cezannetx03_twitter
    If the app with older version was stopped premature, the message being processed could be lost. Is there an ack for confirming message delivery ?
    Sabby Anandan
    @sabbyanandan
    All the messaging semantics are baked in Spring Cloud Stream. If the message is not acknowledged by the streaming app, yes, it will be persistent and available in the message broker, so when a new application starts spawning it will consume from where the previous version got cut-off.
    satheesh-subramani
    @satheesh-subramani
    Hi All

    0

    I am getting "No release manager available for 'null'" error when i try to install the manually created page using skipper shell with the following command

    package install --package-name demo --package-version 1.0.0 --release-name demo

    I am using local repo, i have created the package demo and uploaded it.0

    can someone assist to solve this
    satheesh-subramani
    @satheesh-subramani

    started org.springframework.statemachine.support.DefaultStateMachineExecutor@3c0e79bb
    2019-09-27 10:35:21.379 INFO 832 --- [nio-7577-exec-4] o.s.s.support.LifecycleObjectSupport : started INSTALL INSTALL_INSTALL INSTALL_EXIT INITIAL DELETE DELETE_DELETE DELETE_EXIT ERROR ROLLBACK ROLLBACK_START ROLLBACK_EXIT_INSTALL ROLLBACK_EXIT ROLLBACK_CHOICE ROLLBACK_EXIT_UPGRADE UPGRADE UPGRADE_CANCEL UPGRADE_DEPLOY_TARGET_APPS UPGRADE_CHECK_TARGET_APPS UPGRADE_WAIT_TARGET_APPS UPGRADE_DEPLOY_TARGET_APPS_SUCCEED UPGRADE_DEPLOY_TARGET_APPS_FAILED UPGRADE_START UPGRADE_DELETE_SOURCE_APPS UPGRADE_CHECK_CHOICE UPGRADE_EXIT ERROR_JUNCTION / / uuid=8168f913-2cb0-4399-978a-fb247bf5dae9 / id=demo
    WARNING: An illegal reflective access operation has occurred
    WARNING: Illegal reflective access by com.esotericsoftware.kryo.util.UnsafeUtil (jar:file:/Users/eigenaar/Workspace/spring-cloud-skipper-server-2.1.1.RELEASE.jar!/BOOT-INF/lib/kryo-shaded-4.0.2.jar!/) to constructor java.nio.DirectByteBuffer(long,int,java.lang.Object)
    WARNING: Please consider reporting this to the maintainers of com.esotericsoftware.kryo.util.UnsafeUtil
    WARNING: Use --illegal-access=warn to enable warnings of further illegal reflective access operations
    WARNING: All illegal access operations will be denied in a future release
    2019-09-27 10:35:21.435 INFO 832 --- [eTaskExecutor-1] o.s.c.s.s.s.StateMachineConfiguration : Entering state ObjectState [getIds()=[INITIAL], getClass()=class org.springframework.statemachine.state.ObjectState, hashCode()=202613345, toString()=AbstractState [id=INITIAL, pseudoState=org.springframework.statemachine.state.DefaultPseudoState@5aeb6e2d, deferred=[], entryActions=[], exitActions=[org.springframework.cloud.skipper.server.statemachine.ResetVariablesAction@312f3050], stateActions=[], regions=[], submachine=null]]
    2019-09-27 10:35:21.451 INFO 832 --- [eTaskExecutor-3] o.s.c.s.s.s.StateMachineConfiguration : Entering state StateMachineState [getIds()=[INSTALL], toString()=AbstractState [id=INSTALL, pseudoState=null, deferred=[], entryActions=[], exitActions=[], stateActions=[], regions=[], submachine=INSTALL_INSTALL INSTALL_EXIT / / uuid=97f8a63d-ade3-4783-89db-68c0c89efc2e / id=demo], getClass()=class org.springframework.statemachine.state.StateMachineState]
    2019-09-27 10:35:21.466 INFO 832 --- [eTaskExecutor-3] o.s.c.s.s.s.StateMachineConfiguration : Entering state ObjectState [getIds()=[INSTALL_INSTALL], getClass()=class org.springframework.statemachine.state.ObjectState, hashCode()=128166963, toString()=AbstractState [id=INSTALL_INSTALL, pseudoState=org.springframework.statemachine.state.DefaultPseudoState@11277a82, deferred=[], entryActions=[org.springframework.cloud.skipper.server.statemachine.InstallInstallAction@33f349ae], exitActions=[], stateActions=[], regions=[], submachine=null]]
    2019-09-27 10:35:21.579 ERROR 832 --- [eTaskExecutor-3] o.s.c.s.s.statemachine.AbstractAction : Action execution failed class=[class org.springframework.cloud.skipper.server.statemachine.InstallInstallAction]

    org.springframework.cloud.skipper.SkipperException: No release manager available for 'null'
    at org.springframework.cloud.skipper.server.deployer.DefaultReleaseManagerFactory.getReleaseManager(DefaultReleaseManagerFactory.java:51) ~[spring-cloud-skipper-server-core-2.1.1.RELEASE.jar!/:2.1.1.RELEASE]
    at org.springframework.cloud.skipper.server.service.ReleaseService.install(ReleaseService.java:196) ~[spring-cloud-skipper-server-core-2.1.1.RELEASE.jar!/:2.1.1.RELEASE]

    Sabby Anandan
    @sabbyanandan
    Hi, @satheesh-subramani. It is not clear what your Skipper setup is. Perhaps you could describe the steps clearly as to what you tried, and where it is breaking. We can review it then.
    satheesh-subramani
    @satheesh-subramani
    @sabbyanandan i followed the steps given in this doc link to create own package in skipper - https://docs.spring.io/spring-cloud-skipper/docs/current/reference/htmlsingle/#using-package-create . i am trying to create my own package following the steps given in above doc link. untill package upload step, its fine i am able to upload the package but then when i try to install the package -(package install --package-name demo --package-version 1.0.0 --release-name demo ) - i am getting error "No release manager available for 'null'"
    satheesh-subramani
    @satheesh-subramani
    @sabbyanandan i found the rootcause.,its simple mistake, created folder with name "template" instead of "templates" :-)
    thank you
    satheesh-subramani
    @satheesh-subramani
    @sabbyanandan can you guide me how to add the accounts to skipper platform , i mean by default we have "default" account in kubernetes platform, i want to add more accounts to kubernetes platform and customize it
    Sabby Anandan
    @sabbyanandan

    Hi, @satheesh-subramani. A PR on this topic was recently merged. See docs.

    Though it includes both SCDF and Skipper in the recipe, if you're using Skipper standalone, you would still be able to get an idea on how to configure multiple platform accounts.

    satheesh-subramani
    @satheesh-subramani
    @sabbyanandan actually we use SCDF only. i will check, thank you
    satheesh-subramani
    @satheesh-subramani
    @sabbyanandan ., from doc i see we have to add platform accounts under kubernetes in skipper-config-kafka.yaml ..but i dont know where to find or add this yaml file., could be basic question.. this is what i have now - registered 2 apps in SCDF & created a stream pipelining 2 apps registered and ready for deployment. in the platform drop down, i have only default account now.
    i am not clear where to find/add skipper-config-kafka.yaml and how to make the added platform accounts available during SCDF deplpoyment. I use kafka & minikube kubernetes.
    Sabby Anandan
    @sabbyanandan
    The recipe I shared pertains to SCDF + Skipper deployment. To use Skipper standalone, you'd create the deployment YAMLs similar to what you see in SCDF repo, and customize it with platform accounts. The Skipper docs briefly describes the K8s-specific steps.
    satheesh-subramani
    @satheesh-subramani
    @sabbyanandan i am not using skipper standalone, i am deploying apps through SCDF ,which is running on top of minikube kubernetes. so i registered the source and sink apps and created stream in SCDF GUI and deplying the stream. SCDF server,skipper server ,kafka, source and sink pods are running minikube kubernetes.
    satheesh-subramani
    @satheesh-subramani
    in this setup, i am not sure how to access and customize the yaml created by SCDF
    satheesh-subramani
    @satheesh-subramani
    i used helmchat to create scdf server and required services in kubernetes cluster
    Sabby Anandan
    @sabbyanandan

    You'd manually edit the deployment YAMLs that we ship to include all the desired platform accounts and then kubectl create apply ... to provision things on K8s. And, that procedure is described in length in this receipe.

    You cannot do this when using the helm-chart, however. You could fork the chart to make the necessary customizations also.

    mexicapita
    @mexicapita
    Anyone knows anything about "Could not find a free random port range " skipper error? I have 100 ports, and 3 aplications ... thanks!
    Did you set a range so narrow that there's no free ports anymore?
    mexicapita
    @mexicapita
    The range is from 20000 to 20100. Is it possible that if I create and destroy an application it will not release the port?
    Pablo Barredo
    @dragonAstur
    I have a similar problem with the ports not releasing correctly, any news on this topic?
    mexicapita
    @mexicapita
    • Create a stream app (time | log)
    • deploy it
    • destroy it
      And repeat it some times. Usually gets the port range error at loop 30 (more or less)
    pradeepkarnam
    @pradeepkarnam
    Hello All,
    I have deployed spring cloud data flow and skipper in the same pod but with different port... But when the scdf tries to access skipper, i am seeing the below error
    Caused by: org.apache.http.conn.HttpHostConnectException: Connect to localhost:7577 [localhost/127.0.0.1, localhost/0:0:0:0:0:0:0:1] failed: Connection refused (Connection refused)
    Chris Schaefer
    @chrisjs
    how are you deploying it?
    Saket Puranik
    @saket88
    Hello guys
    I am using SCDF 2.0
    I have observed that after configuring maven local repo in scdf-server in docker-compose.yaml
    spring cloud skipper server is not starting . Anyone has idea
    Sabby Anandan
    @sabbyanandan

    @saket88: The most likely cause would be that you don't have enough memory/CPU allocated in your Docker daemon. Check Docker preferences in your machine, and bump it up to at least 8G memory and 6 CPU. If you're using Prometheus + Grafna, they both alone require at least 3G memory.

    If you continue to see issues, post the logs at spring-cloud-dataflow channel, and please also include more details about what you did, and where you are trying to run etc.

    alogayar
    @alogayar
    Hey, I need some help, I'm starting with Spring Cloud Skipper. I've got a little batch jar made up and I've got the jar on my premises. How do I get it installed on the skipper?
    Do I have to tell you where the .jar is in the package intall or can it be done from my project with some properties?
    thanks
    praneeth1989
    @praneeth1989
    hi Guys,
    Is there any way in spring cloud config server using skipper to rollback properties which are externalized in github?
    MJ
    @MJ11367095_twitter
    hey, I need help and I am trying to delpoy scdf and skipper to kubernetes. I am looking for steps to deploy skipper to kubernetes. Also when I deploy SCDF server i have an application which has @EnableDataFlowServer and i use the jar and create & upload the image. how do i do that for skipper?
    @sabbyanandan could you pls help by answering
    Sabby Anandan
    @sabbyanandan
    @MJ11367095_twitter: Everything you need to know to deploy SCDF/Skipper to K8s is documented here: https://dataflow.spring.io/docs/installation/kubernetes/
    If you need to create a customer Skipper-server, like SCDF, you can build your own Boot app with EnableSkipperServer and pretty much follow the same steps.

    There's a sample to generate a custom SCDF build also: https://github.com/spring-cloud/spring-cloud-dataflow-samples/tree/master/custom-dataflow-builds — this should give you some ideas.

    Curious why you're creating your own custom builds, though. DB driver perhaps?