gocd/gocd

GoCD (https://gocd.org) - Chat room for Contributors. See http://bit.ly/1mAA3RV Q&As.

Kristian Lewis Jones

@klj613

I have [Pipeline1]->[Pipeline2] and I want to run tests in the second pipeline. How can i get access to the complete source control checkout of Pipeline1? Trying to use artifacts but seems I can't publish the root directory.

kpham007

@kpham007

Hi. I'm trying to setup email server to use gsuite and following this,https://docs.gocd.org/current/configuration/admin_mailhost_info.html.
I've added mail.smtp.starttls.enable=true to wrapper-properties.conf and have restarted the server.

In server configuration > Email Server, I've got the following settings.
SMTP hostname: smtp.gmail.com
SMTP port 587
Use SMTPS: Unchecked
SMTP username: {gmail address}
SMTP password: {gmail password}

When I try to send a test email, I get an error. go-server.logs show
com.sun.mail.smtp.SMTPSendFailedException: 530 5.7.0 Must issue a STARTTLS command first. i190sm12252903pfc.119 - gsmtp

at com.sun.mail.smtp.SMTPTransport.issueSendCommand(SMTPTransport.java:2358)
at com.sun.mail.smtp.SMTPTransport.mailFrom(SMTPTransport.java:1823)
at com.sun.mail.smtp.SMTPTransport.sendMessage(SMTPTransport.java:1300)
at com.thoughtworks.go.config.GoSmtpMailSender.send(GoSmtpMailSender.java:53)
at com.thoughtworks.go.config.BackgroundMailSender.lambda$send$0(BackgroundMailSender.java:48)
at java.base/java.lang.Thread.run(Unknown Source)

Is mail.smtp.starttls.enable=true not getting picked up? Any ideas? Thanks.

2 replies

thomschacko

@thomschacko

hey i am very much new to gocd. we are using go cd for deployments and could someone please help how to deploy to an aws asg?

22 replies

i have searched but could not find out any lead

thomschacko

@thomschacko

anybody?

Kristian Lewis Jones

@klj613

is there any way to do an artifact of the root directory? e.g. "." - can't get it to work

2 replies

Kristian Lewis Jones

@klj613

I'm using the official docker-in-docker image but it doesn't have docker-compose installed. What is the best practice around this? Should I make a custom agent image with it installed (extend the DIND image), try to install to /usr/local/bin/docker-compose in the pipeline (requires sudo?), install to the current working directory? etc.

7 replies

L Nehring

@lnehrin

I seems that encrypted_values are ties to a particular GoCD installation. When upgrading the encrypted_values are no longer valid and require a sweep through everything to re-enter values. Is there any way to manage the AES keys that GoCD uses? to maybe use the same key with a upgraded installation. Maybe I'm missing something.

16 replies

Kristian Lewis Jones

@klj613

has anyone used AWS ECR (container registry) with the Docker Elastic Agent plugin? not sure if this plugin supports ECR private repositories and can't get it to work

3 replies

tejesh2007

@tejesh2007

Where can i download 18.5 version of gocd and agent currently we are on 18.2 ...

1 reply

aditi1906

@aditi1906

what will be docker URI if gocd is setup on different server than the docker swarm cluster?

Joachim Lusiardi

@jlusiardi

Hello, sorry to ask may be a stupid question. We are using gocd/gocd-agent-debian-9:v20.2.0 as a base image and get the following in the agent logs:

Running GoCD requires Java version >= VERSION_11 and <= 12. You are currently running with Java version 13. GoCD will now exit!

in the base container, a openjdk version "13.0.2" 2020-01-14 is shipped. Also https://docs.gocd.org/current/installation/system_requirements.html says, java should be 11 or 12. What does this error message exactly mean and how to fix?

Kristian Lewis Jones

@klj613

Does anyone know if using a custom registry with Docker Elastic Agent Plugin conflict with the Artifact for Docker plugin? Downloading the artifact fails if I'm using an agent from a custom registry

venkatabarath

@venkatabarath

I am facing one issue when executing tasks in gocd for Linux. After executing the commands given in sh script, the task is not exited. It reaches last line in sh script and waits till time out. Any lead to address this behavior?

Adding to above issue, the command that i am trying to execute using shell is a perl script which will start services in linux.

3 replies

Sushma10037017

@Sushma10037017

Hi, We are hitting max thread limits on GoCd server. Increased it from 500 to 750, but during peak hours we see the high number of threads. WE have around 800 pipelines, resources are well within limits and no major errors at gocd server or at agent. This is causing latency in assigning agents to jobs(10-15 mins). Any suggestions would be really helpful!. Thanks!

Hi, we are observing delay in agents getting assigned to jobs(more than 10-15mins). We are using elastic agents with cluster autoscaler on Kubernetes, where the agent pod comes up immediately but the job is not assigned to that pod.
On GoCD server I see plugin-cd.go.contrib.elasticagent.kubernetes] - [Create Agent Request] Request for creating an agent for Job Identifier [JobIdentifier{pipelineName='run-web-automation', pipelineCounter=81, pipelineLabel='81', stageName='check', stageCounter='1', jobName='build', jobId=399,537}] has already been scheduled. Skipping current request.
The agent logs are just stuck after these lines 2020-04-15 07:10:48,688 [stdout] - 2020-04-15 07:10:48,688 INFO [main] p.G.c.t.g.s.p.GitPathMaterialPlugin:72 [plugin-GitPathMaterial] - Loading GitPathMaterialPlugin... 2020-04-15 07:10:51,058 [stderr] - SLF4J: Failed to load class "org.slf4j.impl.StaticLoggerBinder". 2020-04-15 07:10:51,058 [stderr] - SLF4J: Defaulting to no-operation (NOP) logger implementation 2020-04-15 07:10:51,059 [stderr] - SLF4J: See http://www.slf4j.org/codes.html#StaticLoggerBinder for further details. 2020-04-15 07:10:53,797 [stdout] - 2020-04-15 07:10:53,797 INFO [main] p.c.g.a.s.d.g.s.a.p.S3ArtifactPlugin:72 [plugin-cd.go.artifact.s3] - Loading plugin Artifact plugin for S3[null].
We are on GoCD version 19.5.0 and elastic-agents plugin version 3.0.0-156 with 900 pipelines and these delays are observed mostly at our peak hours. Any help is appreciated. Thanks

Murilo

@murilodag

"Save failed. java.lang.UnsupportedOperationException: JsonNull" on pipeline clone after migration from GoCD 17 to lastest 20.2.0

Anyone seen this before?

1 reply

Vikas Kumar

@vikas027

Hey guys, I am new to GoCD. Can someone please give me some pointers to configure private git repos with K8S Elastic agents? I can store ssh key in the docker image of the agent, but was looking to know if there is a better/elegant way out there.

4 replies

parthasarathyrajagopal04

@parthasarathyrajagopal04

Hi, How to pass dynamic value to parameters? kindly let me know if there is a way to do. v19.10

L Nehring

@lnehrin

So it appears that a pipeline being configured in cruise-config.xml cannot have a material that is a stage of a pipeline declared in a Config Repository?

26 replies

Vikas Kumar

@vikas027

On a fresh installation on Kubernetes, there is no authentication at all… how can I bootstrap the installation with atleast an admin user and probably add more using an API?

3 replies

Vikas Kumar

@vikas027

Just found a bug helm/charts#22120

Senthil V S

@siliconsenthil

About elastic agents in this page https://www.gocd.org/elastic-agents.html, ECS is given as option in the bottom. But I cannot find ECS option
in https://www.gocd.org/plugins/#elastic-agents

Vikas Kumar

@vikas027

I have raised a few PRs
gocd/docker-gocd-agent-dind#13
helm/charts#22126

Vikas Kumar

@vikas027

Does anyone has an example to use buildkit or kaniko in a GoCD agent?

Vikas Kumar

@vikas027

@arvindsv @varshavaradarajan Any pointers on this? Sorry to @ mention you directly.

2 replies

zindarato

@zindarato

Hello! I'm running into issues getting a Go agent working and was wondering if anyone had any pointers. The below error happens on both Windows 10 and Ubuntu 18. I've been searching for a fix for weeks now, and have tried lots of things, including pointing at a different Java version than the bundles one (pointed at Java 11 installed on Ubuntu). Anyone seen this before?

INFO   | jvm 1    | 2020/04/27 22:38:20 | java.lang.reflect.InvocationTargetException
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at java.base/java.lang.reflect.Method.invoke(Method.java:566)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at com.thoughtworks.gocd.Boot.run(Boot.java:90)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at com.thoughtworks.gocd.Boot.main(Boot.java:56)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at java.base/java.lang.reflect.Method.invoke(Method.java:566)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at org.tanukisoftware.wrapper.WrapperJarApp.run(WrapperJarApp.java:451)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at java.base/java.lang.Thread.run(Thread.java:834)
INFO   | jvm 1    | 2020/04/27 22:38:20 | Caused by: java.lang.NoClassDefFoundError: javax/xml/bind/DatatypeConverter
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at com.thoughtworks.go.agent.launcher.DownloadableFile.matchChecksum(DownloadableFile.java:72)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at com.thoughtworks.go.agent.launcher.DownloadableFile.isChecksumEquals(DownloadableFile.java:79)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at com.thoughtworks.go.agent.launcher.ServerBinaryDownloader.downloadIfNecessary(ServerBinaryDownloader.java:73)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at com.thoughtworks.go.agent.launcher.AgentLauncherImpl.doLaunch(AgentLauncherImpl.java:90)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at com.thoughtworks.go.agent.launcher.AgentLauncherImpl.lambda$launch$0(AgentLauncherImpl.java:68)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at com.thoughtworks.go.logging.LogConfigurator.runWithLogger(LogConfigurator.java:62)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at com.thoughtworks.go.agent.launcher.AgentLauncherImpl.launch(AgentLauncherImpl.java:68)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at com.thoughtworks.go.agent.bootstrapper.AgentBootstrapper.go(AgentBootstrapper.java:76)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at com.thoughtworks.go.agent.bootstrapper.AgentBootstrapper.lambda$main$0(AgentBootstrapper.java:57)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at com.thoughtworks.go.logging.LogConfigurator.runWithLogger(LogConfigurator.java:53)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     at com.thoughtworks.go.agent.bootstrapper.AgentBootstrapper.main(AgentBootstrapper.java:57)
INFO   | jvm 1    | 2020/04/27 22:38:20 |     ... 12 more
...
INFO   | jvm 1    | 2020/04/27 22:38:20 | WrapperManager Debug: ShutdownHook started
INFO   | jvm 1    | 2020/04/27 22:38:20 | WrapperManager Debug: WrapperManager.stop(0) called by thread: Wrapper-Shutdown-Hook
INFO   | jvm 1    | 2020/04/27 22:38:20 | WrapperManager Debug: Send a packet STOP : 0
INFO   | jvm 1    | 2020/04/27 22:38:20 | WrapperManager Debug: Pausing f

6 replies

Joel Serrano

@joelsdc

Hey there! Just wanted to ask 2 quick questions... 1- if you have a material that is used in the same git repo on different pipelines, do you name them the same or different? --> For example, test.git repo is used in pipeline1 (id: test_repo), if it's used also in pipeline3, do you name it also id:test_repo or should the name be different for some gocd internal functionality reason?

The other question is regarding gocd-yaml-config, can templates be done in yaml too or is it only for pipeline/environments?

2 replies

Thanks anyone!

fabdullahs

@fabdullahs

Hi, I am trying to fetch build artifact created in previous stage but gocd returns 404. I can see the build artifact on gocd server. Looks like , gocd is updating path with 'latest' and i guess, its failing because of that.This is where gocd is trying to find.

Could not fetch artifact https://<host>/go/remoting/files/test-artifacts/9/create-artifacts/latest/create-artifacts/test_build.txt. Pausing 10 seconds to retry. Error was : Unsuccessful response '404' from the server

and artifacts is available on the host at this location.

<gocd home>/artifacts/pipelines/test-artifacts/9/create-artifacts/1/create-artifacts-runInstance-1/test_build.txt
somehow go is replacing '1' with 'latest' and returns 404.

Any idea how to fix this?

7 replies

Joel Serrano

@joelsdc

hey guys, just wanted to let you know that: https://www.thoughtworks.com/go points to https://www.gocd.org/enterprise/ which in turn seems like a misconfigured AWS CloudFront/S3 endpoint...

1 reply

404 Not Found
Code: NoSuchKey
Message: The specified key does not exist.
Key: enterprise/index.html
RequestId: A51C98175E06B9E7
HostId: IocXavMC/31foGro30Q712srErsUT2rulRpIc+7dDa/02yKB/KOOqZmlb23v2shM+NPI4UcqMnA=

Joel Serrano

@joelsdc

Hello everyone, would the following assumption be correct? If you have 2 pipelines in yaml-config: pipeline1(material:git) and pipeline2(material:pipeline1). Can Pipeline1 modify the parameters of pipeline2? Because currently it seems the only way is to make that change in the yaml repo and trigger a re-sync.. I believe my answer is "no", because the parameters in yaml-config are read-only for GoCD, so the changes must come from the repo towards GoCD, not the other way around... correct?

alokeDcoder

@alokeDcoder

hell o everyone, do any one knows how to retrieve old builds in gocd artifacts

vaseemt

@vaseemt

Hi Is it possible to setup multibranch pipeline in gocd? is there any plugin available?

Sushma10037017

@Sushma10037017

Hi, Job properties are no longer supported in GoCD? Don't see anything mentioned related to this in release notes.

3 replies

gu3sss

@gu3sss

Hello! Is there a way to add an env variable (declared in Environments section) in the place of git branch in Pipeline as code yaml?

pipelines:
  pipeline1:
    group: group1
    materials:
      mygit:
        git: git@github.com:repo/abc.git
        branch: $BRANCH
environments:
  develop:
    environment_variables:
      BRANCH: dev
    pipelines:
      - pipeline1

16 replies

Nikos Skalis

@nskalis

hi, I have go-server and go-agent running on the same server, I wanted to add a second agent, and I noticed that the GO_SERVER_URL had been renamed to

wrapper.app.parameter.100=-serverUrl
wrapper.app.parameter.101=https://x.x.x.x:8154/go

what I don't know is from where the https came from, I have used two certificates 1) for nginx serving the web app (agnostic to GoCD) 2) for the ldaps authentication part (using keytool)

when trying to add the second agent I see the following error:

2020-05-11 21:02:10,140 ERROR [WrapperJarAppMain] ServerBinaryDownloader:88 - Couldn't update admin/agent-launcher.jar. Sleeping for 1m. Error: 
javax.net.ssl.SSLHandshakeException: PKIX path building failed: sun.security.provider.certpath.SunCertPathBuilderException: unable to find valid certification path to requested target

can you advise where to look and how to fix this ?

patrijua

@patrijua

Hi. We have issues that changing credentials for git material in pipeline yaml do not come into effect. One set of credentials had become outdated for one Bitbucket repository. I updated credentials (both username and password) in pipeline yaml (using encrypted_password) and pushed, but still agent seems to be trying to use old outdated credentials. These credentials are correct because we use these same credentials with other repos in other pipelines and I have also successfully tested these credentials manually with this one problematic repository. GoCD Version: 19.12.0 running in k8s. Any ideas? Our project is not the only one, because I know that others have also stumbled into this same issue. Any ideas?

6 replies

andy-vdg

@andy-vdg

Hi, I am having trouble with upgrading GoCD Server to 20.3. I have a configuration that works fine in 19.12 but when I pull the 20.3 Docker image I get this error:

INVALID MERGED CONFIGURATION
Number of errors: 1+
I. Rule Validation Errors:
       1. Not allowed to refer pipeline group 'PaymentGateway' from the config repository.;;
II. Config Validation Errors:
- For COnfig Repo: https://[trunketed] at [trunkated]

I can't seem to find anything about this error and why it would suddenly throw it in a newer version. Any ideas? Thanks!

2 replies

andy-vdg

@andy-vdg

In the new pipeline wizard (I'm on 19.12) it asks to define a task as code and won't let me save and edit until I do. What's the correct syntax for adding an ANT task? Anything I've tried continuously resulted in a custom task being added. All documentation I can find still shows the old wizard with a dropdown selector for task type and a separate field for target.

andy-vdg

@andy-vdg

(OMG... I'm used to Slack and don't like how Gitter handles pasted screenshots...)
This is the field I'm talking about:

1 reply

Murilo

@murilodag

Good afternoon everyone, have anyone seen the error below? I know this is mentioned in the troubleshooting guide, but my agents start and work for hours. They lose contact at random times after it.

2020-05-19 10:20:18,064 INFO [scheduler-2] RetryExec:113 - Retrying request to {s}->https://<my-url-with-port>:443
2020-05-19 10:23:01,014 ERROR [scheduler-3] AgentController:90 - [Agent Loop] Error occurred during loop:
org.springframework.remoting.RemoteAccessException: Could not access HTTP invoker remote service at [https://<my-url-without-port>/go/remoting/remoteBuildRepository]; nested exception is javax.net.ssl.SSLHandshakeException: Remote host terminated the handshake
at org.springframework.remoting.httpinvoker.HttpInvokerClientInterceptor.convertHttpInvokerAccessException(HttpInvokerClientInterceptor.java:226)
<stack>
Caused by: javax.net.ssl.SSLHandshakeException: Remote host terminated the handshake
at java.base/sun.security.ssl.SSLSocketImpl.handleEOF(SSLSocketImpl.java:1313)
<stack>
Caused by: java.io.EOFException: SSL peer shut down incorrectly
at java.base/sun.security.ssl.SSLSocketInputRecord.decode(SSLSocketInputRecord.java:167)
<stack>

1 reply

smadyelse

@smadyelse

Good Morning, I am trying to use GoCD on Windows and need to set the working directory of the GoCD Agent to my E:\Builds folder

Sorry, I pressed enter key without thinking. My question is how do I do that. I cannot find any way to do it. I imagine reinstalling the app onto my E Drive might work but that seems ridiculous. Is there anyone who can help?

Where communities thrive

People

Repo info

Activity