These are chat archives for FreeCodeCamp/DataScience

18th
Jan 2018
evaristoc
@evaristoc
Jan 18 2018 13:57

PEOPLE

This is a VERY interesting conversation I brought here a couple of times but never discussed properly: The possible end of the Data Science Bubble and the Auto-ML systems.

https://www.kaggle.com/c/data-science-bowl-2018/discussion/47584#270543

Not that I think we are close to those days but it is also naïve to think that the bubble will last forever. And yes: there are now many solutions put forward by different online providers that will make the whole calculation for you.

This is unfortunately a natural steps in all industry that become mature and more for those industries based on computers: to centralize (eg. moving all ML activities to India) and to automate.

Additionally, thanks to things like Kaggle (and freeCodeCamp...) there is an increased supply of labour force and algorithms that will sooner or later affect the job availability and the wages.

Just to complement that: in many meetups (Nederlands) I noticed how many small companies that were servicing the data analysis market were moving to:

  • maintenance
  • other areas, like back-end and front-end

Not enough work, they argued. Much of the standard analytical services are now offered by the big players.

Hurry up to get there. And even if you get there, be prepared to last in that job for few years. Specially if what you are looking for is a "secure job".

The opportunities are actually in the specializations and the added value, not in the things that are becoming commodity.

Mayank
@Mps24-7uk
Jan 18 2018 14:52
I am working on Machine Learning Application that can predict whether the review given by the user is positive or negative. I used Pickle and cpickle in the python file . The application is working on the local computer but when i am deploying my model on the Heroku cloud station platform it's showing me error: Could not find a version that satisfies the requirement cPickle (from -r /tmp/build16c305b15b59f0b947f32725cbfe781e/**-7uk-pr0ot-6c85b9b/requirements.txt (line 2)) (from versions: )
No matching distribution found for cPickle
evaristoc
@evaristoc
Jan 18 2018 18:51

@Mps24-7uk I haven't tried any pickling from Heroku but it looks like either a version or the cPickle package are not installed there? I think you should be able to see what it is available and if you can install a package. I would suggest to also check the Python version.

Probably the best way to deal with this is using containers or any other tool that will port your settings into Heroku. Not my area of expertise though.