Assumed the pluggin installation would do that.
That's a possible improvement for later. Jenkins has the concept of tools, and if I remember well, other plug-ins like Selenium Plugin fetch required dependencies. The trick part here is that some of these dependencies are OS specific, and could fail to be installed from Jenkins/JVM.
Easier to install via pip or conda.
Do you have steps to perform before issuing the pip install? Thank you.
All I did was to create a venv (python -m venv venv and activate it source ./venv/bin/activate). You could include these two steps in your container, though you would also either need to copy a layer with python/pip from another container, or modify your Dockerfile to fetch these two, plus run pip install -r requirements.txt or add the dependencies in another RUN command in your container. HTH
3 replies
Hi @chinnusujitha , a Jenkins job can take one/many parameters. You can configure a parameter of type File; or you can use a string containing an S3 object ID or maybe another identifier for your file in another file system.
After that your model could be deployed to your environment. If you need to run code, the machine-learning-plugin developed during last GSoC might be useful. But if your deployment involves only copying a trained model somewhere to use in a web app or scripts, then I think all you'll need is vanilla Jenkins.
Maybe some Shell or Groovy to assist with what you need. Plus, you can use any Jenkins plug-in to help you keeping track of metadata in your Job (Ioannis M. has a lot of experience doing that), reporting the execution, archiving artefacts, etc. Hope that helps (and I'm learning Airflow, o if you write about it anywhere, let me know as I'd be interested to read and see how you implemented it).
- "Triggering a Jenkins job using API call and passing parameters" https://beginnersforum.net/blog/2019/11/28/jenkin-paramerized-job-api-json/
- "Remote Access API" https://www.jenkins.io/doc/book/using/remote-access-api/ (search for 'Another example - sending a "File Parameter"')
