guardian/grid

The Guardian’s new image management system

Akash Askoolum

@akash1810

source ./upload-template.sh && echo $TEMPLATE_URL

Eugene Brukson

@ebrukson

lol my bad I shold have seen that

$ source ./upload-template.sh && echo $TEMPLATE_URL
Uploading template to s3://media-service-dist-2ef8f7ed180aa3b4fdd2/cloudformation/DEV/media-service-DEV-grid-user.template
upload: ../dev-template.json to s3://media-service-dist-2ef8f7ed180aa3b4fdd2/cloudformation/DEV/media-service-DEV-grid-user.template
https://s3-us-east-1.amazonaws.com/media-service-dist-2ef8f7ed180aa3b4fdd2/cloudformation/DEV/media-service-DEV-grid-user.template

and it works
i created the SF stack manually using the template that works as well

Akash Askoolum

@akash1810

OK. A little confused as to why create-dev-stack doesn’t run successfully now. I successfuly tested it yesterday.

Eugene Brukson

@ebrukson

anything to do with Linux version I have? Ubuntu 14 here

aws-cli/1.9.9 Python/2.7.6 Linux/3.13.0-48-generic botocore/1.3.9

Akash Askoolum

@akash1810

you’re only a minor version higher than my machine - I’m on was-cli/1.9.8

shouldn’t be a problem

You say you’ve created it manually using the template?

Eugene Brukson

@ebrukson

yes from AWS panel

Akash Askoolum

@akash1810

Eugene Brukson

@ebrukson

using the template that was uploaded by the script

Akash Askoolum

@akash1810

we will need to take a look at the scripts

but as you’ve got a stack, that shouldn’t be a blocker

hopefully :smile:

Eugene Brukson

@ebrukson

cool
let me try

Eugene Brukson

@ebrukson

no dice :(
same issue as before. I had the stack running before but couldnt get media api up. Thrall seems to be running, but not media api.

http://grid.sjmweb.com:9001/ media api
http://grid.sjmweb.com:9002/ thrall

dot-properties were generated accordingly

kahuna is also up and running but giving me an error notice possible due to media-api not available
http://grid.sjmweb.com:9005/

Akash Askoolum

@akash1810

are you seeing any particular errors?

Eugene Brukson

@ebrukson

This message was deleted

No source available, here is the exception stack trace:

     Global$.onStart(Global.scala:20)
     play.api.GlobalPlugin.onStart(GlobalSettings.scala:220)
     play.api.Play$$anonfun$start$1$$anonfun$apply$mcV$sp$1.apply(Play.scala:91)
     play.api.Play$$anonfun$start$1$$anonfun$apply$mcV$sp$1.apply(Play.scala:91)
     scala.collection.immutable.List.foreach(List.scala:381)
     play.api.Play$$anonfun$start$1.apply$mcV$sp(Play.scala:91)
     play.api.Play$$anonfun$start$1.apply(Play.scala:91)
     play.api.Play$$anonfun$start$1.apply(Play.scala:91)
     play.utils.Threads$.withContextClassLoader(Threads.scala:21)
     play.api.Play$.start(Play.scala:90)
     play.core.ReloadableApplication$$anonfun$get$1$$anonfun$apply$1$$anonfun$1.apply(ApplicationProvider.scala:157)
     play.core.ReloadableApplication$$anonfun$get$1$$anonfun$apply$1$$anonfun$1.apply(ApplicationProvider.scala:130)
     scala.Option.map(Option.scala:146)
     play.core.ReloadableApplication$$anonfun$get$1$$anonfun$apply$1.apply(ApplicationProvider.scala:130)
     play.core.ReloadableApplication$$anonfun$get$1$$anonfun$apply$1.apply(ApplicationProvider.scala:128)
     scala.util.Success.flatMap(Try.scala:230)
     play.core.ReloadableApplication$$anonfun$get$1.apply(ApplicationProvider.scala:128)
     play.core.ReloadableApplication$$anonfun$get$1.apply(ApplicationProvider.scala:120)
     scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24)
     scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24)
     scala.concurrent.forkjoin.ForkJoinTask$AdaptedRunnableAction.exec(ForkJoinTask.java:1361)
     scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260)
     scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339)
     scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979)

Akash Askoolum

@akash1810

is elasticsearch running

Eugene Brukson

@ebrukson

also in the terminal

at play.core.ReloadableApplication$$anonfun$get$1$$anonfun$apply$1.apply(ApplicationProvider.scala:128) ~[play_2.11-2.3.8.jar:2.3.8]
Caused by: com.amazonaws.services.s3.model.AmazonS3Exception: Access Denied (Service: Amazon S3; Status Code: 403; Error Code: AccessDenied; Reques                                     t ID: 62DE76B6BD6279E8)

Elastic search is running

Akash Askoolum

@akash1810

and have you run https://github.com/guardian/grid/blob/master/cloud-formation/scripts/post-dev-stack-creation.sh

^ needs to be run once the cf stack has been made

Eugene Brukson

@ebrukson

wasnt aware
ran it now

still the same error. Should I restart the app?

Akash Askoolum

@akash1810

yes, restart

Eugene Brukson

@ebrukson

same thing, no dice

should I restart the whole setup with a clean image? what version of Scala should I be using?

Akash Askoolum

@akash1810

you shouldn’t be seeing 403s now though?

Eugene Brukson

@ebrukson

sorry I terminated the service let me restart it again

same issue: http://grid.sjmweb.com:9001/

Eugene Brukson

@ebrukson

reinstalled from scratch on another box. Dev stack can be created now but i am getting the same error still :(
"No sources available"
should I look into grid setting?

Akash Askoolum

@akash1810

so you've created a stack, ran post-dev-stack-creation.sh to populate the buckets with the required files and ran dot-properties to generate the files in /etc/gu/... can you start elasticsearch, then start media-api, then curl localhost:9001

any errors, paste them here

@ebrukson ^

Eugene Brukson

@ebrukson

Here is the error I keep getting. Only Thrall runs without issues

Akash Askoolum

@akash1810

iirc you’re creating your stack in us-east-1. I’ve a strong feeling your current problem is related to guardian/grid#1507

Eugene Brukson

@ebrukson

ty for the tip
I will try with eu-west-1

Akash Askoolum

@akash1810

@ebrukson just a quick fyi that we’ve released #1507 now

Eugene Brukson

@ebrukson

Thanks for that. create-dev-stack.sh script now works in any region for me, however the media-api service still kicks off an error

Robert Kenny

@kenoir

@akash1810 do you think @ebrukson last problem is down to missing lines in the .properties file? That error looks familiar.

Akash Askoolum

@akash1810

looks like it - CommonPlayAppProperties.scala:10suggests a missing domain.root value

Eugene Brukson

@ebrukson

I have it set

[aws]
; awscli profile name, defaulted to media-service Hint cat ~/.aws/credentials
profile_name = media-service
region = us-east-1

[properties]
; Domain root of your site, e.g. media.foobar.co.uk
domain_root = grid2.sjmweb.com

; Token used to access mixpanel. See https://mixpanel.com/help/questions/articles/where-can-i-find-my-project-token
mixpanel_token =

; Comma separated list of CORS domains.
cors = sjmweb.com, grid2.sjwmweb.com

; Configuration for pan domain authentication. See https://github.com/guardian/pan-domain-authentication
panda_domain = sjmweb.com

Akash Askoolum

@akash1810

Hmm, the line Caused by: scala.MatchError: grid2.sjmweb.com (of class java.lang.String) is curious.

Where communities thrive

People

Repo info

Activity