Where communities thrive


  • Join over 1.5M+ people
  • Join over 100K+ communities
  • Free without limits
  • Create your own community
People
Activity
  • 03:54
    renovate[bot] edited #784
  • 03:51
    codecov-commenter commented #222
  • 03:50
    codecov-commenter commented #222
  • 03:50
    renovate[bot] edited #222
  • 03:50
    renovate[bot] synchronize #222
  • 03:50

    renovate[bot] on dev

    chore(dependencies): update dev… (compare)

  • 01:40
    renovate[bot] commented #201
  • 01:39
    renovate[bot] synchronize #201
  • 01:39

    renovate[bot] on dev

    chore(dependencies): update dev… (compare)

  • Jun 24 19:02
    renovate[bot] edited #784
  • Jun 24 17:52
    renovate[bot] edited #784
  • Jun 24 15:25
    renovate[bot] edited #784
  • Jun 24 03:40
    stencila-ci labeled #1006
  • Jun 24 03:40
    stencila-ci commented #1006
  • Jun 24 03:40

    stencila-ci on v0.87.3

    (compare)

  • Jun 24 03:40

    stencila-ci on master

    chore(release): 0.87.3 [skip ci… (compare)

  • Jun 24 03:38

    stencila-ci on gh-pages

    Deploy website - based on c467d… (compare)

  • Jun 24 03:31

    delete-merged-branch[bot] on 2021-06-23-fix-tests-on-ci

    (compare)

  • Jun 24 03:31

    alex-ketch on master

    test(Desktop): Run tests in CI … test(Desktop): Fix test failure… Merge pull request #1006 from s… (compare)

  • Jun 24 03:31
    alex-ketch closed #1006
Finlay Thompson
@finlay
No, didn't like that....
I really hate corporate proxies
It is always hard to get things to work
Nokome Bentley
@nokome
Mmmm, not sure why that is not working
It would be pretty straightforward to create a self contained binary - which would avoid these issues
I mean for our CI to do that - like for Dockter
Finlay Thompson
@finlay
yeah, that would be good.
Nokome Bentley
@nokome
Happy to go ahead and prioritize that if you think you'd use it - as I said, keen to have beta testers kicking the wheels so anything that encourages that
Finlay Thompson
@finlay
yeah that would be good. I am going to head back to my office now, and have a go there too. Do you have time for a quick phone call ?
Nokome Bentley
@nokome
Sure
Nokome Bentley
@nokome
FWIW alias nixster='/path/to/nixster/node_modules/.bin/ts-node --project /path/to/nixster/tsconfig.json /path/to/nixster/src/cli.ts' should work (not --projectoption)
Nokome Bentley
@nokome
@finlay : linux binaries now available. See https://github.com/stencila/nixster#install for installation instructions. Feedback would be great
Mac Cowell
@100ideas

Hey yall, I'm working on an experimental schema-autosuggest frontend interface that helps a user consume, transform, mashup, & remap data tables. I've been reviewing the source code of stencila & stencila/schema to see how I might implement something that will be as broadly useful as possible.

I am really torn about json-schema & json-ld. Ultimately I want to use both, like you are, to ensure data workflows can be serialized and reused in an unambiguous & repeatable manner. But my design intent is to allow the user to be as initially unconstrained as possible as they create and structure hierarchies of tabular data, nudging them towards standard / published schemas without requiring them to restructure their raw data before doing anything else. What I need to do - in the frontend experience - is help users explore various ways of mashing up, overriding, and fragmenting existing json-schema as they build a data processing workflow, then reconcile the resulting definitions with the preexsiting ones in the most parsimonious (least redundant) way.

It seems like stencila/schema has an architecture designed to support modular, hierarchical, reusable schema definitions, and I'd like to know more about how this particular approach was developed and how the major parts of it work together.

I can roughly see that schemas are initially defined in lightweight yaml - that's nice - and then compiled into a hierarchical json-schema (and ts-definitions) at runtime. In particular schemas can [extend](https://github.com/stencila/schema/blob/master/CONTRIBUTING.md#the-extends-keyword) other schemas, setting up a class-like inheritance mechanism. Why did you decide to design it this way, and would it have been possible to use native json-schema $refs or json hyper-schema links instead? Where those options too verbose / user-unfriendly?

since this has gotten really long, I'm going to stencila/schema#62, but I'll leave it here too in case anyone wants to comment briefly

lastly, how often are users likely to be creating or extending schemas in the course of normal use w/ stencila?
Nokome Bentley
@nokome
Hey @100ideas :wave: . Thanks for the interest - I'll respond over on Github but feel free to move back here is you want to chat more "realtime"
Finlay Thompson
@finlay
Morning @nokome
The link instruction doesn't work ? I think you need to publish the release or something ?
Nokome Bentley
@nokome
OK, I was just fiddling with release tags - give me 15mins
...and I should have it fixed
Finlay Thompson
@finlay
Okay, different error:
finlay@triage-lab:~$ curl -L https://raw.githubusercontent.com/stencila/nixster/master/install.sh | bash
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100  1233  100  1233    0     0   1972      0 --:--:-- --:--:-- --:--:--  1969
  % Total    % Received % Xferd  Average Speed   Time    Time     Time  Current
                                 Dload  Upload   Total   Spent    Left  Speed
100     9    0     9    0     0      5      0 --:--:--  0:00:01 --:--:--     5
tar: This does not look like a tar archive

gzip: stdin: not in gzip format
tar: Child returned status 1
tar: Error is not recoverable: exiting now
mv: cannot stat 'nixster': No such file or directory
Nokome Bentley
@nokome
OK, works again now.
Can you please give it another try
Finlay Thompson
@finlay
Okay, another error, this time related to curl and ssl certificates!
Let me have a look see...
Finlay Thompson
@finlay
hmm, I made it work with --insecure flag on the curl
That is not a fix you want to check in though
Nokome Bentley
@nokome
Mmmm, are you behind that corporate firewall again?
Finlay Thompson
@finlay
Yes. I'll try on my laptop too
I get this message: "This site has been blocked according to MBIE Internet Usage Policy."
oh well
Nokome Bentley
@nokome
But you've got the binary installed?
Finlay Thompson
@finlay
not yet
Nokome Bentley
@nokome
Oh right, I thought the --insecure flag worked
Finlay Thompson
@finlay
no, it moved the problem to the next level
Now I am getting blocked on the API rate limit at Github!
on my laptop, which is not on the corporate network...
Nokome Bentley
@nokome
Right - well you could just use the "manual" instructions https://github.com/stencila/nixster#linux
Finlay Thompson
@finlay
okay, so the guest wifi was also blocked because of the API limits at Github. Presumably many people hitting the github api all the time from a big organisation
all being seen from one, non-authenticated, IP address
I'll try the manual instructions...
Nokome Bentley
@nokome
Wow, lots of roadblocks :construction: !
Finlay Thompson
@finlay
No, can't do a manual download on the MBIE network
Blocked because: "Your request was denied because of its content categorization: "MED Safe Sites;Software Downloads;Content Servers""
Guess its the "Software Downloads" bit
Finlay Thompson
@finlay
Okay, got the binary onto the computer. Now I get a more serious error:
finlay@triage-lab:~$ nixster --help
pkg/prelude/bootstrap.js:1185
      throw error;
      ^

Error: Cannot find module '../build/better_sqlite3.node'
1) If you want to compile the package/file into executable, please pay attention to compilation warnings and specify a literal in 'require' call. 2) If you don't want to compile the package/file into executable and want to 'require' it from filesystem (likely plugin), specify an absolute path in 'require' call using process.cwd() or process.execPath.
    at Function.Module._resolveFilename (internal/modules/cjs/loader.js:580:15)
    at Function.Module._resolveFilename (pkg/prelude/bootstrap.js:1287:46)
    at Function.Module._load (internal/modules/cjs/loader.js:506:25)
    at Module.require (internal/modules/cjs/loader.js:635:17)
    at Module.require (pkg/prelude/bootstrap.js:1166:31)
    at require (internal/modules/cjs/helpers.js:22:18)
    at Object.<anonymous> (/snapshot/nixster/node_modules/better-sqlite3/lib/database.js:5:21)
    at Module._compile (pkg/prelude/bootstrap.js:1261:22)
    at Object.Module._extensions..js (internal/modules/cjs/loader.js:710:10)
    at Module.load (internal/modules/cjs/loader.js:598:32)
That looks like it needs to have a access to a sqlite3 db somewhere ?
-rwxr-xr-x 1 finlay finlay 56M May 16 10:45 /usr/local/bin/nixster
Does that look to be right size ?