These are chat archives for FreeCodeCamp/DataScience

8th
Feb 2018
Joshuaek
@Joshuaek
Feb 08 2018 07:03
Hi all, any suggestions for tools to map data onto a uk map by postcode? I have data (such as average age) which I want to use to colour a map...
evaristoc
@evaristoc
Feb 08 2018 08:34

@becausealice2 yes I found the news too. Things are changing. Did you know that in order to keep to the rules, all those platforms must hire more people in order to double check? They haven't create the right algorithm yet that can detect those "outliers".

It might be an statistical issue:

In the pharmaceutical sector, every new medicine must go through a long way of clinical trials to show that they are safe. The analysis is done based on statistics over a sample. If everything goes well any side effect might appears in a very few of the test subjects.

However those samples are relatively small to the population. When they start to sell after the trial is completed they might reach a larger section of the population and the side effects will pop up more clearly.

It is like this: suppose the medicine side effect affect a 0,1% of the population. Let's say they found out testing a sample of size 1,000. So during trial the medicine affected just 1 person. Now suppose the medicine sells to 1,000,000 people. How many people are likely to suffer from side effects?

It is possible that it is the same for Machine Learning processing. You test your model over a small size of the total number of events. Even if largely accurate (let's say 99,99%), there are always a few "falses" that will pass the test. If you have to test a substantial amount in production, those few "falses" can be actually a large amount, depending of the total target population size. You need people to help you out with those ones.

Alice Jiang
@becausealice2
Feb 08 2018 08:38
I never thought about the need for more hires to deal with this. I'm gonna apply to do ML for pornhub.
evaristoc
@evaristoc
Feb 08 2018 08:38
It is a visual inspection...
So you will have a lot of fun!!!
The hires must do a visual inspection.
Alice Jiang
@becausealice2
Feb 08 2018 08:44
Yes. Inspect the algorithm performance with my eyes.
I was gonna say "keep an eye on model performance" but in this context that has too many possible interpretations and I just wanna see numbers.
evaristoc
@evaristoc
Feb 08 2018 13:22
@becausealice2 Not sure if I was clear: you have to see the videos, not the algo. You won't see any numbers.
Alice Jiang
@becausealice2
Feb 08 2018 17:01
Ruined my joke :(
Manish Shiwlani
@ManishShiwlani
Feb 08 2018 19:58
Are these people banned showing on the right that says banned next to them?
Alice Jiang
@becausealice2
Feb 08 2018 21:29
Fellow data dweebs! My career goals company, Affective is hiring!. They're expanding their research and need massive nerds to do the thing!