These are chat archives for FreeCodeCamp/DataScience

18th
Mar 2016
evaristoc
@evaristoc
Mar 18 2016 11:28
People:
There are few discussions about Data Science and Machine Learning in the python room!
For example: you can check the last suggestion by @koustuvsinha there about Andrej Karpathy's works, especially ConvNetJS. If you are interested in ML/DS check that room too!
Koustuv Sinha
@koustuvsinha
Mar 18 2016 12:19
@evaristoc about that, there is a great course by Andrej Karpathy on Conv Nets which just got over, but the materials are still up if anyone is interested : http://cs231n.stanford.edu
evaristoc
@evaristoc
Mar 18 2016 12:37
@koustuvsinha did you follow that training? How was it?
Koustuv Sinha
@koustuvsinha
Mar 18 2016 12:41
i am doing it right now @evaristoc . its amazing! Karpathy really is an awesome teacher
the assignments are a bit hard, but they are very detailed
all in python
evaristoc
@evaristoc
Mar 18 2016 12:43
@koustuvsinha I think I will have look... thanks! Interested in convolutional, never tried those before...
CamperBot
@camperbot
Mar 18 2016 12:43
evaristoc sends brownie points to @koustuvsinha :sparkles: :thumbsup: :sparkles:
:star: 68 | @koustuvsinha | http://www.freecodecamp.com/koustuvsinha
Koustuv Sinha
@koustuvsinha
Mar 18 2016 12:44
sure! :) conv nets and rnns are covered. it starts right from building a simple 2 layer nn to a multi layer fcc, then goes on to conv nets
evaristoc
@evaristoc
Mar 18 2016 12:48
@koustuvsinha for what I have seen, very well explained indeed!
And implementing everything using only scipy... so far I have not seen any mention to sk-learn, for example... very useful...
Koustuv Sinha
@koustuvsinha
Mar 18 2016 12:49
yeah it trains you to build your own nn library from scratch. no dependency other than scipy numpy
evaristoc
@evaristoc
Mar 18 2016 12:55

@koustuvsinha really good reference! thanks! I wish we had something here in FCC to apply those kind of stuff...

@koustuvsinha If you find some examples, or something you think valuable to discuss, please let me know? Either here or in the python room... Have you found relevant information to share in this room that is available in other rooms? Java? Go? Let us know!

CamperBot
@camperbot
Mar 18 2016 12:55
evaristoc sends brownie points to @koustuvsinha :sparkles: :thumbsup: :sparkles:
:warning: evaristoc already gave koustuvsinha points
evaristoc
@evaristoc
Mar 18 2016 13:01

@koustuvsinha I think I need to practice again but I feel like I can figure out what to expect up to backpropagation algos and the like... The rest is a bit new to me...


By the way, people:
Did you know that...?
Andrew Ng, one of founders of coursera and the teacher of the famous ML course, was one of the people behind DeepMind origins and currently enjoying a top position in Baidu.

Additionaly, Andrej Karpathy, the person behind the course suggested by @koustuvsinha, was a student of Andrew Ng at Stanford and prepared part of the tools used for the coursera ML course...

Koustuv Sinha
@koustuvsinha
Mar 18 2016 13:15
sure @evaristoc !!
recently he is working on Neural Talk, which anotates images with captions
Karpathy was a student under Andrew Ng, and now he is doing his PhD from Stanford under Prof Fei Fei Li. he has created quite some awesome tools, such as char-rnn : a RNN trainable on characters to spew interesting stuff
recently he is working on Neural Talk, which anotates images with captions
incidentally, i downloaded the FCC wiki repo and concatenated all .md files into one, and ran the char-rnn on it. though i dont have gpu support yet, it does spew out few cool (although not meaningful) stuff :D
evaristoc
@evaristoc
Mar 18 2016 14:56
@koustuvsinha Nice!!!! Can you point out to your results? I have been trying to use other simpler strategies for those types of analyses (eg. nearest-neighbour, which coincidentially has a similar acronym as neural networks :) ); we can see how effective char-rnn is...
We should investigate what we can do to get some gpu (AWS?)...
Koustuv Sinha
@koustuvsinha
Mar 18 2016 15:02
sure! will post my results soon here! :smile: getting gpus in aws would be great! but i dont know the costs associated with it
evaristoc
@evaristoc
Mar 18 2016 15:03
Let's investigate... @Lightwaves capi: do you have ideas about getting GPU's for free and how to connect? Appreciate...
Lightwaves
@Lightwaves
Mar 18 2016 17:39
@evaristoc outside of AWS I'm not sure which is a damn shame
Seems to be a cost prohibitive venture renting a gpu cluster.
Actually for a small one 0.65 an hour.
evaristoc
@evaristoc
Mar 18 2016 17:52
Thanks @Lightwaves! Asked you thinking you were more aware of those stuff...
So forget gpu at least you have a final project...
CamperBot
@camperbot
Mar 18 2016 17:52
evaristoc sends brownie points to @lightwaves :sparkles: :thumbsup: :sparkles:
:star: 186 | @lightwaves | http://www.freecodecamp.com/lightwaves
Lightwaves
@Lightwaves
Mar 18 2016 18:03
I wouldn't totally say forget about it differs how long it would take he just needs to be aware it'd be about 15 dollars a day to run AWS GPU cluster
evaristoc
@evaristoc
Mar 18 2016 18:12
hmmm.... 15 bucks... not the best way to go then...
Quincy Larson
@QuincyLarson
Mar 18 2016 19:28
@evaristoc It sounds like Stack Overflow will release their full data set next week. I definitely think this is something our Data Science room can dig into for further insights :)
evaristoc
@evaristoc
Mar 18 2016 19:28
@QuincyLarson yes! I think so too! Thanks!!