These are chat archives for frictionlessdata/chat

7th
Oct 2018
Adam Shepherd
@ashepherd
Oct 07 2018 16:20
hi folks, does anyone have an example of how to use a datapackage-pipelines custom plugin (from here https://github.com/frictionlessdata/datapackage-pipelines#processor-resolution) ?
Adam Kariv
@akariv
Oct 07 2018 16:37
@ashepherd sure, what are you trying to do?
Adam Shepherd
@ashepherd
Oct 07 2018 16:39
thanks @akariv, we've written some custom pipelines as a plugin, and i'm trying to extend the DPP Dockerfile (https://github.com/frictionlessdata/datapackage-pipelines/blob/master/Dockerfile) to inject my custom pipelines plugin into the container with something like:
FROM frictionlessdata/datapackage-pipelines:1.7.1

## Add custom processors into the container
Adam Kariv
@akariv
Oct 07 2018 16:41
I see - you can pip install them in case these are datapackage-pipelines extension packages (such as datapackage-pipelines-aws).
If these are processors of your own, you should add them in the container (using Docker's ADD or COPY commands) and then set the DPP_PROCESSOR_PATH environment variable so that they become discoverable by dpp
Adam Shepherd
@ashepherd
Oct 07 2018 16:42
ah, perfect! i see that in the Dockerfile, so I'll follow suit with my own RUN cmd. thanks @akariv !
Adam Kariv
@akariv
Oct 07 2018 16:42
No problem, good luck :)
Adam Shepherd
@ashepherd
Oct 07 2018 16:42
ah, thanks for DPP_PROCESSOR_PATH I missed that first time through. cheers!