by

Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Repo info
Activity
  • Sep 07 07:58
    dependabot[bot] labeled #160
  • Sep 07 07:58
    dependabot[bot] labeled #160
  • Sep 07 07:58
    dependabot[bot] opened #160
  • Sep 07 07:58

    dependabot[bot] on npm_and_yarn

    Bump http-proxy from 1.17.0 to … (compare)

  • Jul 16 16:46
    dependabot[bot] labeled #159
  • Jul 16 16:46
    dependabot[bot] labeled #159
  • Jul 16 16:46
    dependabot[bot] opened #159
  • Jul 16 16:46

    dependabot[bot] on npm_and_yarn

    Bump lodash from 4.17.11 to 4.1… (compare)

  • Jun 06 13:09
    dependabot[bot] labeled #158
  • Jun 06 13:09
    dependabot[bot] labeled #158
  • Jun 06 13:09
    dependabot[bot] opened #158
  • Jun 06 13:09

    dependabot[bot] on npm_and_yarn

    Bump websocket-extensions from … (compare)

  • Mar 10 20:41
    patcon commented #157
  • Mar 10 20:40
    patcon commented #153
  • Feb 24 22:53
    dependabot[bot] labeled #157
  • Feb 24 22:53
    dependabot[bot] labeled #157
  • Feb 24 22:53
    dependabot[bot] opened #157
  • Feb 24 22:53

    dependabot[bot] on bundler

    Bump nokogiri from 1.6.7.2 to 1… (compare)

  • Jan 31 08:06
    keeganmcbride synchronize #153
  • Jan 31 08:06

    keeganmcbride on bootstrap4

    Change dropdown menu to BS4 (compare)

Chris Whong
@chriswhong
and then you can click a dataset and go to its jkan page
Tim Wisniewski
@timwis
oh cool
Chris Whong
@chriswhong
never used knack
Tim Wisniewski
@timwis
configurable application/database builder SaaS product basically
Chris Whong
@chriswhong
cool
Tim Wisniewski
@timwis
Can you update that issue with the resolution in case others run into the same problem?
Oh and don't forget to remove me from the org once it's working! I get nervous with too much power :D
Chris Whong
@chriswhong
Yes i will
on both accounts
Dan Feder
@dafeder
@timwis wondering if you’ve tested JKAN with hundreds of datasets, and what the site regeneration time looks like? been playing more with Jekyll generally and seeing reports of very long build times on larger sites
Tim Wisniewski
@timwis
@dafeder the demo jkan site has 216 datasets https://demo.jkan.io/datasets/
long build times are usually the result of accidentally including folders like node_modules in the build
or having some expensive templating code
Dan Feder
@dafeder
do you know how long it takes to build the demo?
Tim Wisniewski
@timwis
hm, don’t recall off-hand
looks like 6.5 seconds
Dan Feder
@dafeder
nice, not bad at all
though I suppose you’re getting into the minutes when you’re above 2k datasets
(arguably not a big deal)
Tim Wisniewski
@timwis
yeah — i’d rather it be something scaleable, and it may be i’ve done something silly like included a folder it doesn’t needs..
would be interesting to experiment on it
but as you pointed out, not many cities have 2k datasets on their portal
Aaron Couch
@acouch
@timwis @dafeder I was interested in the scalability question. I made 3,000 random datasets as a test and it seems to hold up pretty well. https://acouch.github.io/jkan/datasets/ the local build time was 51 seconds and the page loads pretty quickly. that could probably be optimized as well.
Noted that it isn't the design goal to support portals with that many but looks like it can
Nick Jackson
@jacksonj04
hi all, is there anyone around who might be able to help me with a custom schema field?
Tim Wisniewski
@timwis
hi @jacksonj04, sure
Nick Jackson
@jacksonj04
ah, hang on, I think I might have made a stupid .yaml vs .yml naming error...
although whilst I'm here, does a custom schema need to define all fields, or just additional ones?
Tim Wisniewski
@timwis
hmm, let me check
fairly certain it’s all, as i don’t recall any kind of inheritance system
should be easy enough to verify that though by trying a schema with just a few fields.
Nick Jackson
@jacksonj04
so, https://github.com/mysociety/jkan is the repo in question. I've tried to add a last_modified field to https://github.com/mysociety/jkan/blob/gh-pages/_data/schemas/mysociety.yml and updated the schema name in https://github.com/mysociety/jkan/blob/gh-pages/_config.yml, but I don't get the new field either in edit pages or dataset pages
Tim Wisniewski
@timwis
oh, mysociety, cool!
Nick Jackson
@jacksonj04
yup, stuart harrison recommended I give jkan a whirl instead of a more heavy-duty data portal, since we're starting to create/release more of our stuff as a result of research
Tim Wisniewski
@timwis
that’s great. well, sorry you’re having trouble with the schema. lets see if we can figure it out. in the meantime, the city of san diego just launched a jkan portal with a custom schema, though it appears they’ve modified the default.yml schema https://github.com/cityofsandiego/seaboard/blob/master/src/_data/schemas/default.yml
reproduced the issue locally
ah, i see why
the reason that JKAN lets you add schemas instead of simply modifying the existing schema is because JKAN supports multiple schemas
each dataset’s front-matter includes a schema field. the schema property in _config.yml is simply the site’s default schema.
Nick Jackson
@jacksonj04
ohh, I see
i’ll admit that may be an example of over-engineering :P there’s probably some discussion around it in an issue from last year though
Nick Jackson
@jacksonj04
got it, new datasets are created using the new schema, and if I go through and update the old datasets it all works happily
(as in manually update the schema field)
Tim Wisniewski
@timwis
yep; or you can just modify default.yml instead of adidng a new schema
Nick Jackson
@jacksonj04
thanks for the help, hopefully you'll be seeing a jkan-powered data.mysociety.org sometime soon!
Tim Wisniewski
@timwis
sure thing. looking forward to it!
here’s some background: timwis/jkan#60
looks like we should add a note about what you ran into to the documentaiton about this: https://github.com/timwis/jkan/wiki/Schema-Customization
OxOpenData
@OxOpenData
Hey all. Just wondered if anyone else was using the Octopub tool from the Open Data Institute (https://octopub.io/) alongside their jkan sites? I've just started in earnest and am finding it a really good way of providing a nicer interface between jkan and github. Have a look https://oxopendata.github.io/jkan/datasets/expenditure-over-500/
If you like it, there is a new (better) version launching this month. I took part in the user testing and am going to the launch event