gocd/gocd

GoCD (https://gocd.org) - Chat room for Contributors. See http://bit.ly/1mAA3RV Q&As.

FrdAlex

@FrdAlex

Hello everyone, i am considering implementing GoCD for our organization, however i have one question of interest. As part of a pipeline, i would need to restart an agent during the middle of the pipeline, after the agent is back online, would the build resume from where it left off, or is there a way to make such a scenario work with GoCD ?

1 reply

i would rather not have the pipeline trigger another job to do the second part of the pipeline

Finley Lee

@finleylee

Hello all. I'm getting a 404 error when calling the get maintenance mode API https://go.example.com/go/api/maintenance_mode/info. I can call other APIs successfully, such as https://go.example.com/go/api/jobs/scheduled.xml. Is that API still available?

7 replies

Murilo

@murilodag

Anyone using S3 artifact plugin?

Kristupas Stumbrys

@Kristonitas

Hello all. This is not exactly GoCD specific, but I was wondering if there is any guide or tutorial about actual deployment part of a simple nodejs app.

I know how to manage a server, set up nginx, use https://pm2.keymetrics.io/ to manage the production services, etc. The only mystery is what should the pipeline do after running npm build, npm test... should it put the final artifacts (the pipeline's folder) into some fixed path on the server (/var/www f. e.)?

1 reply

Harshad

@harshadnarvekar

Hello all, We were thinking to integrate authentication of users using LADP. I see we already have plugin to do that. However i was wondering if there is a way we can also manage users and their groups based on the AD groups ? Any help would be highly appreciated. Thanks

2 replies

hprasad068

@hprasad068

Hello all, is there a way we can have a conditional trigger to different downstream pipeline based on success or failure for the current pipeline? like if a pipeline fails trigger pipeline A or if its success trigger Pipeline C

3 replies

Anderson Reyes

@AndersonReyes

Workflows

Nikos Skalis

@nskalis

hi all, can sb advise on what exactly fingerprint is based on https://api.gocd.org/current/#the-scheduling-material-object ?

oh, found it, https://api.gocd.org/current/#get-all-materials

Nikos Skalis

@nskalis

may I ask sth else:

in the pipeline config it says

Automatic pipeline scheduling
If unchecked, this pipeline will only schedule in response to a Manual/API/Timer trigger. Unchecking this box is the same as making the first stage manual.;

but, I cannot find in https://api.gocd.org/current/#pipeline-config how I can disable the automatic pipeline scheduling. can you please advise?

2 replies

domdom8

@domdom8

guys, any gocd bot to run with github?

as i know the existence of some-bot for other CI tools

Ludek Vodicka

@ludekvodicka

hi there. Does GoCD supports parametrized pipelines like Jenkins does? For some manually executed jobs we would need to configure whether to perform full rebuild or only common build. Thanks

5 replies

Ludek Vodicka

@ludekvodicka

And one more question, is there now any simply way how to pas environement/variable between two pipelines? I found few hacks for this (curl between pipelines, writing to specified file/artifact..) but I believe it would be much easier to export envs/vars as artifact to child pipeline. Is this somehow possible? Thanks

2 replies

amithalef

@amithalef

Hello Folks, I am using GoCD Version: 20.4.0. Also I am using k8s elastic agent plugin to provision my agents. Everything was working well for the past 6 months, I started observing a weird issue today which is that its taking a lot of time(and tries) to provision a GOCD elastic agent. I checked the logs in the go-server and was able to see the logs as shown below. My hunch is that this may be due to a network lag which exists only today maybe. [Agent Auto Registration] Auto registering agent with uuid b2c2a017-5afe-40f9-abe5-96b0a7a24319
jvm 1 | 2020-07-20 14:11:05,722 WARN [qtp1534854134-41] AgentService:510 - Agent [Agent [goagent-jdk8-2f6bc0e1-3c1c-4e6b-8ef2-18f65cc45c42, 100.64.38.119, b2c2a017-5afe-40f9-abe5-96b0a7a24319, null]] has no cookie set
jvm 1 | 2020-07-20 14:11:05,722 ERROR [qtp1534854134-41] BuildRepositoryRemoteImpl:56 - Error occurred in com.thoughtworks.go.server.service.ElasticAgentRuntimeInfo@1c729b86[elasticAgentId=goagent-jdk8-2f6bc0e1-3c1c-4e6b-8ef2-18f65cc45c42,elasticPluginId=cd.go.contrib.elasticagent.kubernetes,identifier=Agent [goagent-jdk8-2f6bc0e1-3c1c-4e6b-8ef2-18f65cc45c42, 100.64.38.119, b2c2a017-5afe-40f9-abe5-96b0a7a24319],runtimeStatus=Idle,buildingInfo=AgentBuildingInfo[, ],location=/go,usableSpace=73773543424,operatingSystemName=Alpine Linux v3.11,cookie=<null>] ping.
jvm 1 | com.thoughtworks.go.server.service.AgentNoCookieSetException: Agent [Agent [goagent-jdk8-2f6bc0e1-3c1c-4e6b-8ef2-18f65cc45c42, 100.64.38.119, b2c2a017-5afe-40f9-abe5-96b0a7a24319, null]] has no cookie set
jvm 1 | at com.thoughtworks.go.server.service.AgentService.bombIfAgentDoesNotHaveCookie(AgentService.java:511)
jvm 1 | at com.thoughtworks.go.server.service.AgentService.updateRuntimeInfo(AgentService.java:225)
jvm 1 | at com.thoughtworks.go.remote.BuildRepositoryRemoteImpl.ping(BuildRepositoryRemoteImpl.java:51)
jvm 1 | at com.thoughtworks.go.server.messaging.BuildRepositoryMessageProducer.ping(BuildRepositoryMessageProducer.java:47)
jvm 1 | at jdk.internal.reflect.GeneratedMethodAccessor300.invoke(Unknown Source)
jvm 1 | at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
jvm 1 | at java.base/java.lang.reflect.Method.invoke(Unknown Source)
jvm 1 | at org.springframework.aop.support.AopUtils.invokeJoinpointUsingReflection(AopUtils.java:333)
jvm 1 | at org.springframework.aop.framework.ReflectiveMethodInvocation.invokeJoinpoint(ReflectiveMethodInvocation.java:190)
jvm 1 | at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:157)
jvm 1 | at org.springframework.remoting.support.RemoteInvocationTraceInterceptor.invoke(RemoteInvocationTraceInterceptor.java:78)
jvm 1 | at org.springframework.aop.framework.ReflectiveMethodInvocation.proceed(ReflectiveMethodInvocation.java:179)
jvm 1 | at org.springframework.aop.framework.JdkDynamicAopProxy.invoke(JdkDynamicAopProxy.java:213)
jvm 1 | at com.sun.proxy.$Proxy110.ping(Unknown Source)
jvm 1 | at jdk.internal.reflect.GeneratedMethodAccessor1326.invoke(Unknown Source)
jvm 1 | at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(Unknown Source)
jvm 1 | at java.base/java.lang.reflect.Method.invoke(Unknown Source)
jvm 1 | at org.springframework.remoting.support.RemoteInvocation.invoke(RemoteInvocation.java:212)
jvm 1 | at org.springframework.remoting.support.DefaultRemoteInvocationExecutor.invoke(DefaultRemoteInvocationExecutor.java:39)
jvm 1 | at org.springframework.remoting.support.RemoteInvocationBasedExporter.invoke(RemoteInvocationBasedExporter.java:78)
jvm 1 | at org.springframework.remoting.support.RemoteInvocationBasedExporter.invokeAndCreateResult(RemoteInvocationBasedExporter.java:114)
jvm 1 | at org.springframework.remoting.httpinvoker.HttpInvokerServiceExporter.handleRequest(HttpInvokerServiceExporter.java:80)
jvm 1 | at org.springframework.web.servlet.mvc.HttpRequestHandlerAdapter.handle(HttpRequestHandlerAdapter.java:51)
jvm 1 | at org.springframework.web.

Any Idea why this could be happening?

Jason Stitt

@jasonstitt

Hi. I have a POC of GoCD set up on Kubernetes with elastic agents. The basic setup is able to execute, but how can we run tasks on various different images to use different tools? Or does everything have to be baked into an agent image?

1 reply

Ashley Stovall

@plainsane

i have a question, im setting up an agent on a macmini and the java service wrapper is looking for a license...do i really need to purchase this license

34 replies

patrijua

@patrijua

Hi. I'm having a problem getting artifacts. I have a pipeline from which where I upload directory containing multiple directories as an artifact:

This what I have in the pipeline (defined in yaml):

         artifacts:
            - build:
                source: ros2_foxy/src

Under that src directory there are also multip other directories which are uploaded. Upload is fine because I can see all the material via UI in jobs "Artifacts" tab. There's src directory visible and lot of directories under it, all seems ok.

Now the problem comes when I want to fetch all that material to agent in pipelines next stage:

          tasks:
           - fetch:
              pipeline: ros2-foxy
              stage: static_analysis
              job: static_analysis
              source: ros2_foxy/src
              is_file: no

[go] Could not fetch artifact https://xxxx.xxxxxxx.xxxxxxxxxxx.xx/go/remoting/files/ros2-foxy/10/static_analysis/latest/static_analysis/ros2_foxy/src.zip. Pausing 33 seconds to retry. Error was : Unsuccessful response '404' from the server

What's wrong? To my understanding (gocd/gocd#6874) server will zip the content and then transfer that to agent, but why there's a problem?

1 reply

thanh-dr

@thanh-dr

hi, i'm having problem with newly created GoCD cannot find older commits to revision. For example, I have a github repo with 10 commits already, and I create a pipeline using the repo as material ==> pipeline is triggered automatically with the latest commit. However, I can't find the way to run the pipeline with 9 older commits. Any idea why ? Much appreciate !!!

muhammad-fahad2068

@muhammad-fahad2068

Hi, I have recently updated my Kubernetes version from 1.14 to 1.15
my gocd server is running as a pod in k8 with version gocd/gocd-server:v20.4.0
and Kubernetes Elastic Agent Plugin Version is 3.7.0-217

I am having below error

jvm 1 | 2020-07-29 05:41:44,150 ERROR [158@MessageListener for CreateAgentListener] JMSMessageListenerAdapter:87 - Exception thrown in message handling by listener com.thoughtworks.go.server.messaging.elasticagents.CreateAgentListener@2bc86e88
jvm 1 | java.lang.RuntimeException: The plugin sent a response that could not be understood by Go. Plugin returned with code '500' and the following response: 'Failed to handle request cd.go.elastic-agent.create-agent'

I have checked cluster profile and token and ca certificate seems correct. What could be the issue and how to resolve?

8 replies

Ganesh S Patil

@GaneshSPatil

Hi @muhammad-fahad2068,

can you create a Github issue as mentioned by @arvindsv at https://github.com/gocd/kubernetes-elastic-agents/issues providing the following information:

The kubernetes Elastic Agent Plugin Version
The NPE stack trace (Please make sure you redact all the sensitive information)
The kubernetes pod yaml remote file url
The contents of the remote file (Please make sure you redact all the sensitive information)

Our initial assumptions is that the plugin is unable to reach/parse to the Pod Yaml Specification file specified as the remote file url. As we're investigating the issue can you try copying over the contents of the remote file and specify as pod yaml on the elastic agent profile and see if that works?

mdhakecha

@mdhakecha

[go] Job Started: 2020-07-29 13:51:54 UTC

[go] Start to prepare deploy-packages-coreless-stage/446/deploy/2/deploy_api on EC2AMAZ-SOEJ9LQ [C:\Program Files (x86)\Go Agent]

[go] Start to build deploy-packages-coreless-stage/446/deploy/2/deploy_api on EC2AMAZ-SOEJ9LQ [C:\Program Files (x86)\Go Agent]

[go] Task: fetch artifact [packages] => [] from [create-packages-coreless-stage/create-packages/api]took: 1m 16.33s
[go] Fetching artifact [packages] from [create-packages-coreless-stage/466/create-packages/1/api]
[go] Could not fetch artifact https://127.0.0.1:8154/go/remoting/files/create-packages-coreless-stage/466/create-packages/1/api/packages.zip. Pausing 16 seconds to retry. Error was : Unsuccessful response '404' from the server
[go] Could not fetch artifact https://127.0.0.1:8154/go/remoting/files/create-packages-coreless-stage/466/create-packages/1/api/packages.zip. Pausing 23 seconds to retry. Error was : Unsuccessful response '404' from the server
[go] Could not fetch artifact https://127.0.0.1:8154/go/remoting/files/create-packages-coreless-stage/466/create-packages/1/api/packages.zip. Pausing 37 seconds to retry. Error was : Unsuccessful response '404' from the server
[go] Failed to save artifact [packages] to []
[go] Task status: failed, took: 1m 16.33s

[go] Current job status: failed

[go] Start to create properties deploy-packages-coreless-stage/446/deploy/2/deploy_api on EC2AMAZ-SOEJ9LQ [C:\Program Files (x86)\Go Agent]

[go] Start to upload deploy-packages-coreless-stage/446/deploy/2/deploy_api on EC2AMAZ-SOEJ9LQ [C:\Program Files (x86)\Go Agent]

[go] Job completed deploy-packages-coreless-stage/446/deploy/2/deploy_api on EC2AMAZ-SOEJ9LQ [C:\Program Files (x86)\Go Agent]

1 reply

when i commit my latest code on github that time getting the error on deployment.

This error comes only sometime.

but since last 8 time got the same error for all commits.

please give me solution for it.

Xneno92

@Xneno92

Hi All,
We went form GoCD 20.1 to GoCD 20.4 & We have a reverse proxy to verify our agents client certificates.

SSLVerifyClient require
SSLVerifyDepth 2
SSLCACertificateFile conf/ssl.crt/cruise.crt

After upgrade agents were unable to upload artifacts The agents are still on bootstrapper 19.2
It looks like the agent stopped sending the client certificate after being upgraded to 20.4 ?

And we get this error in our reverse proxy logs
SSL Library Error: error:140890C7:SSL routines:ssl3_get_client_certificate:peer did not return a certificate -- No CAs known to server for verification?

https://docs.gocd.org/20.4.0/installation/ssl_tls/end_to_end_transport_security.html

26 replies

mdhakecha

@mdhakecha

How can i get that port ?

amithalef

@amithalef

Hey Folks,
        I am using the kubernetes elastic agent plugin to spin up gocd agents. I recently moved all my agent k8 spec yaml to a private github repo
and started accessing my agents via the raw URL(which is valid only for 7 days).

This is the URL I am using is:

https://raw.githubusercontent.com/MyOrg/agents-k8s-spec/master/java-agent.yaml?token=some-token-which-expires-in-7-days

The problem is that this URL expires every 7 days so I switched to the following URL which I am able to curl:

https://github-personal-access-token@raw.githubusercontent.com/org/agents-k8s-spec/master/java-agent.yaml

but GOCD is unable to get the agent spec. Any Ideas or suggestions on how I should approach this?

domdom8

@domdom8

hi guys,
i have multiple branch pipeline, so can i use artifact to let them communicate with each other?

ronanlucio

@ronanlucio

Hi all, quick question. Is it possible deploying from cloud to agents on on-premises windows nodes on private networks (I mean, the server can't reach the nodes out, it must be a pull deployment)?

3 replies

kpham007

@kpham007

Hi All,
Is it possible for GoCD to trigger a build when a tag is pushed to Github?

3 replies

Cons†antine

@ConstantineFrol

Please, if someone could help me with my question I can't find info that will explain in details what is the benefits and weakness side of using GoCD.

ronanlucio

@ronanlucio

Hi guys, although it's desirable having a complete pipeline for my scenario, first I'd like to bundle the application package manually and use GoCD only for deployment.
I'm wondering what would be the recommended way to do this. How could I upload this (bundle) artifact and what would be the URL to be configured in to download it? thank you

ronanlucio

@ronanlucio

Hi all, supposing we have pipeline sat up and working fine. Now I need to add a new server to our fleet. How can run the pipeline only for the new server in a way to install the application as the others?

JeromeDelaire

@JeromeDelaire

Hi all, I have a goagent under windows server, and I want to use a private git material. I set public and private keys, and it work fine if I try "git clone" with "administror" user of my windows server computer. But when I want execute a pipeline, my agent can't clone the git repository. I have the following error :

STDERR: Host key verification failed.
STDERR: fatal: Could not read from remote repository.
STDERR:
STDERR: Please make sure you have the correct access rights
STDERR: and the repository exists.

Do you have any idea ?

Regards,

Jérôme

Brandon Nason

@bnason

How would I add a task with the following command echo $REG_PASS | docker login registry.example.com -u $REG_USER --password-stdin ?

8 replies

Neil Saunders

@njsaunders

I have a job that's configured to run on an ECS agent, but gets stuck trying to schedule it: https://snipboard.io/t1EcjK.jpg. I've tried restarting the job, restarting go, killing all the jobs in the ECS cluster, and killing all of the ECS instances. Nothing works. Not sure if it's related, but if I try to update the ECS agent profile (to not use spot instances), I get a "Save failed" message next to the save button. Looking in the logs, I see:

2020-08-12 05:58:37,342 INFO  [qtp970590321-37] GoConfigDao:87 - Config update for entity request by com.thoughtworks.go.server.domain.Username@36ce544[displayName=Neil Saunders,username=neil] is in queue - com.thoughtworks.go.config.update.ElasticAgentProfileUpdateCommand@13cc11d5
2020-08-12 05:58:37,342 INFO  [qtp970590321-37] GoConfigDao:90 - Config update for entity request by com.thoughtworks.go.server.domain.Username@36ce544[displayName=Neil Saunders,username=neil] is being processed
2020-08-12 05:58:37,608 ERROR [qtp970590321-37] GoConfigDao:96 - Config update for entity failed
java.lang.NullPointerException: null
2020-08-12 05:58:37,609 INFO  [qtp970590321-37] GoConfigDao:100 - Entity update for request by com.thoughtworks.go.server.domain.Username@36ce544[displayName=Neil Saunders,username=neil] is completed

Other jobs running fine. Not sure if it's relevant, but the pipeline is defined using the pipelines as code YAML plugin.

I've raised the following issue: gocd/gocd-ecs-elastic-agent#2

Brandon Nason

@bnason

How should I go about getting binaries into the agent image? For instance, I need helm so I can deploy to my cluster. I feel like adding a task to pull the helm binary every time is very wasteful. Should I just build my own agent image instead?

Brandon Nason

@bnason

Is there any way to trigger a pipeline when a tag is added to my git repo? I want to build a docker image with that tag.

ronanlucio

@ronanlucio

Hi, any tip to use bitbucket repo as material? I generated an App password(that's the way we create additional username/password to use in third-party application), but it isn't working

ronanlucio

@ronanlucio

OK, never mind. Just got it working, and yeah, using App password with HTTPS clone repo

Where communities thrive

People

Repo info

Activity