Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
    Eugene Brukson
    @ebrukson
    Eugene Brukson
    @ebrukson
    reinstalled from scratch on another box. Dev stack can be created now but i am getting the same error still :(
    "No sources available"
    should I look into grid setting?
    Akash Askoolum
    @akash1810
    so you've created a stack, ran post-dev-stack-creation.sh to populate the buckets with the required files and ran dot-properties to generate the files in /etc/gu/... can you start elasticsearch, then start media-api, then curl localhost:9001
    any errors, paste them here
    @ebrukson ^
    Eugene Brukson
    @ebrukson
    Untitled.png
    Here is the error I keep getting. Only Thrall runs without issues
    Akash Askoolum
    @akash1810
    iirc you’re creating your stack in us-east-1. I’ve a strong feeling your current problem is related to guardian/grid#1507
    Eugene Brukson
    @ebrukson
    ty for the tip
    I will try with eu-west-1
    Akash Askoolum
    @akash1810
    @ebrukson just a quick fyi that we’ve released #1507 now
    Eugene Brukson
    @ebrukson
    Thanks for that. create-dev-stack.sh script now works in any region for me, however the media-api service still kicks off an error
    grid_issue1.png
    Robert Kenny
    @kenoir
    @akash1810 do you think @ebrukson last problem is down to missing lines in the .properties file? That error looks familiar.
    Akash Askoolum
    @akash1810
    looks like it - CommonPlayAppProperties.scala:10suggests a missing domain.root value
    Eugene Brukson
    @ebrukson
    I have it set
    [aws]
    ; awscli profile name, defaulted to media-service Hint cat ~/.aws/credentials
    profile_name = media-service
    region = us-east-1
    
    [properties]
    ; Domain root of your site, e.g. media.foobar.co.uk
    domain_root = grid2.sjmweb.com
    
    ; Token used to access mixpanel. See https://mixpanel.com/help/questions/articles/where-can-i-find-my-project-token
    mixpanel_token =
    
    ; Comma separated list of CORS domains.
    cors = sjmweb.com, grid2.sjwmweb.com
    
    ; Configuration for pan domain authentication. See https://github.com/guardian/pan-domain-authentication
    panda_domain = sjmweb.com
    Akash Askoolum
    @akash1810
    Hmm, the line Caused by: scala.MatchError: grid2.sjmweb.com (of class java.lang.String) is curious.
    Mark Pajak
    @MarkPajak
    Hello! Please could you me know what linux OS and RAM you'd recommend to install this on? Thanks.
    Akash Askoolum
    @akash1810
    @MarkPajak no hard recommendation, however, we use ubuntu with 2GB RAM per service
    Mark Pajak
    @MarkPajak
    OK great, thanks. ALso your link to https://github.com/guardian/dev-nginx#install-ssl-certificates is giving a 404. Does the server need an SSL? Thanks
    Mark Pajak
    @MarkPajak
    I am getting a "Cannot load plugin" error when connecting ot the services over a browser : (shift+enter for line break) exception occurred during Plugin [play.api.GlobalPlugin] initialization No source available, here is the exception stack trace: ->java.lang.ExceptionInInitializerError: Global$.beforeStart(Global.scala:16) play.api.GlobalPlugin.<init>(GlobalSettings.scala:214) sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) java.lang.reflect.Constructor.newInstance(Constructor.java:422) play.api.WithDefaultPlugins$$anonfun$plugins$1$$anonfun$apply$9.apply(Application.scala:132) play.api.WithDefaultPlugins$$anonfun$plugins$1$$anonfun$apply$9.apply(Application.scala:130) scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:245) scala.collection.TraversableLike$$anonfun$map$1.apply(TraversableLike.scala:245) scala.collection.immutable.List.foreach(List.scala:381) scala.collection.TraversableLike$class.map(TraversableLike.scala:245) scala.collection.immutable.List.map(List.scala:285) play.api.WithDefaultPlugins$$anonfun$plugins$1.apply(Application.scala:130) play.api.WithDefaultPlugins$$anonfun$plugins$1.apply(Application.scala:166) play.utils.Threads$.withContextClassLoader(Threads.scala:21) play.api.WithDefaultPlugins$class.plugins(Application.scala:128) play.api.DefaultApplication.plugins$lzycompute(Application.scala:402) play.api.DefaultApplication.plugins(Application.scala:402) play.api.Play$$anonfun$start$1.apply$mcV$sp(Play.scala:91) play.api.Play$$anonfun$start$1.apply(Play.scala:91) play.api.Play$$anonfun$start$1.apply(Play.scala:91) play.utils.Threads$.withContextClassLoader(Threads.scala:21) play.api.Play$.start(Play.scala:90) play.core.ReloadableApplication$$anonfun$get$1$$anonfun$apply$1$$anonfun$1.apply(ApplicationProvider.scala:157) play.core.ReloadableApplication$$anonfun$get$1$$anonfun$apply$1$$anonfun$1.apply(ApplicationProvider.scala:130) scala.Option.map(Option.scala:146) play.core.ReloadableApplication$$anonfun$get$1$$anonfun$apply$1.apply(ApplicationProvider.scala:130) play.core.ReloadableApplication$$anonfun$get$1$$anonfun$apply$1.apply(ApplicationProvider.scala:128) scala.util.Success.flatMap(Try.scala:230) play.core.ReloadableApplication$$anonfun$get$1.apply(ApplicationProvider.scala:128) play.core.ReloadableApplication$$anonfun$get$1.apply(ApplicationProvider.scala:120) scala.concurrent.impl.Future$PromiseCompletingRunnable.liftedTree1$1(Future.scala:24) scala.concurrent.impl.Future$PromiseCompletingRunnable.run(Future.scala:24) scala.concurrent.forkjoin.ForkJoinTask$AdaptedRunnableAction.exec(ForkJoinTask.java:1361) scala.concurrent.forkjoin.ForkJoinTask.doExec(ForkJoinTask.java:260) scala.concurrent.forkjoin.ForkJoinPool$WorkQueue.runTask(ForkJoinPool.java:1339) scala.concurrent.forkjoin.ForkJoinPool.runWorker(ForkJoinPool.java:1979) scala.concurrent.forkjoin.ForkJoinWorkerThread.run(ForkJoinWorkerThread.java:107)
    Akash Askoolum
    @akash1810
    @MarkPajak re dev-nginx - we recognise dev-nginx is a private repo, we're looking at opening it up. All it does is create nginx configurations - see here for a community response https://github.com/guardian/grid/issues/1090#issuecomment-154572622. (Note, if you run the Grid using Docker, these configurations will be generated automatically.)
    re SSL - yes it is required. All APIs operate over https
    regarding being unable to connect to a service via a browser and the stack trace - what service does this relate to?
    please also note that services must be launched from the project root - i.e. cd /path/to/grid then sbt "project media-api" "run 9001"
    Fabrizio Marmitt
    @fabriziomarmitt
    Hi guys! I am interested in using the Grid in my company, so I'm starting testing. I would like to understand one thing, the Grid works only linked to an account of the AWS?
    Thank you
    Akash Askoolum
    @akash1810
    Yes, currently you need an AWS account.
    However it would be great to be cloud provider agnostic one day. Contributions welcome! 🙂
    gandlaprasad
    @gandlaprasad
    Please provide the steps to setup and run the grid application with docker.
    Akash Askoolum
    @akash1810
    hi @gandlaprasad please find some documentation here - https://github.com/guardian/grid/tree/master/docker. Also note that using Docker has only been tested in DEV.
    Dafydd
    @dafyddPrys

    Hi everyone. I've been using the guide to run the grid in Docker today - very useful. I am having an issue when running the docker-compose file.. I'm getting errors from various containers saying they cannot find certain directories in the /configs directories of their ubuntu instances. For example:

    cropper_1 | cp: cannot stat ‘/configs/etc/gu’: No such file or directory
    thrall_1 | cp: cannot stat ‘/configs/etc/gu’: No such file or directory
    auth_1 | cp: cannot stat ‘/configs/etc/gu’: No such file or directory
    kahuna_1 | cp: cannot stat ‘/configs/etc/gu’: No such file or directory
    imgops_1 | cp: cannot stat '/configs/imgops/nginx.conf': No such file or directory

    Am I missing something obvious here / is there some direction you think I should go in with troubleshooting? I have verified that these folders don't exist beyond /configs/ in their containers by editing the entrypoints... I could fumble about in the dark forever or I thought I could just ask for any hints here..

    Cheers!

    Dafydd
    @dafyddPrys
    So with some more reading and understanding, it looks like the configs-vol on my host, which is being mounted as /configs into each container, doesn't contain what the entrypoint scripts expect them to. I cannot quite understand what the 'local' driver that the config-vol volume is using represents, or where the files that are supposed to be mapped to /configs in the containers are coming from. I will keep reading.
    Robert Kenny
    @kenoir
    @dafyddPrys @akash1810 set up the Docker stuff, so he's the best person to ask.
    Dafydd
    @dafyddPrys
    @kenoir thanks. I managed to get a bit further with this on Friday. I will ask again I run into any further issues. Thanks!
    andreeee
    @andreeee
    Long shot here.. Anyone have insights as to why collections aren't working for me? I'm currently using grid via docker (I know it hasn't been tested outside of DEV) and it looks like the things that are working as expected except for collection and cropper functionality. Cropper makes sense as I believe it has to do with CORS and the certs I'm don't account for urls deeper than 1 subdomain. Collections on the other hand is there and looks like it should be working but clicking the edit button leaves me with no option do anything and the panel remains blank.
    @dafyddPrys @akash1810 as referenced above
    andreeee
    @andreeee
    Figured out the issue with cropper functionality per the Troubleshooting README, the .cer file needed to be added to the java runtime
    nmaffongelli
    @nmaffongelli
    Hello! How are you? First of all, sorry for my English. I am interested in using Grid, so I'm trying to test it. I think that the only thing missing it's setting the 'grid-settings.yml', (I could run the auth service correctly, create stack, .properties,...). I know there's information in https://github.com/guardian/pan-domain-authentication , but I would like to ask you if it's possible to give me some details on which are the minimum properties I have to set in 'grid-settings.yml' and from where should I get them to be able to run the services in localhost. Thanks.
    G0n3D
    @G0n3D
    Hi :)
    i would like to install Guardian Grid on my server but the documentation is very poor
    do you have a how to for debian server for example ?
    Baldur Árnason
    @spoldman
    you dont have a built grid in a docker registry somewhere or some place to test it out?
    Baldur Árnason
    @spoldman
    or is docker maybe not the best way to try this out on aws?
    Justin Shin
    @jshin47
    Do you think this could be a reasonable choice for an image management system for a dataset of images for a machine learning application?
    Babyboy
    @1601

    Hello,
    How are you doing?
    I am trying to run this image management system in my Machine, any idea on where to get the s3 watcher key? For the config

    // An API key used to ingest images from the s3watcher.
    s3Watcher: {
    key: ''
    },

    Best Regards

    Michael Barton
    @mbarton
    Hi @1601. The s3watcher is only used if you want to set up the Grid to automatically read files from a folder. There are a few API keys used internally you'll need to set up however.
    Instructions for generating API keys are here https://github.com/guardian/grid/blob/master/docs/04.02-authentication.md#api-keys. There's an S3 bucket where all the keys are stored (where the name of the file in S3 is the key name)
    The Grid internally will use an API key for communication between the cropper service and media-api service, so you'll need to generate one for that (like here https://github.com/guardian/grid/blob/b0764a37258ca1f81f3f771ca247566917a2e6c2/cloud-formation/scripts/post-dev-stack-creation.sh#L27)
    matthewdavidwebb
    @matthewdavidwebb
    Hi, is there a guide to setting up Grid on a standalone server with local repositories for images?
    Michael Barton
    @mbarton
    Hi @matthewdavidwebb. The Grid is AWS-native and so doesn’t run on a standalone server at the moment I’m afraid
    matthewdavidwebb
    @matthewdavidwebb
    Thanks for clarifying @mbarton