These are chat archives for axschech/hackjersey2blueteam

29th
Mar 2015
igor-im
@igor-im
Mar 29 2015 05:27
ok I can't see straight anymore lol
I'm having memory issues with these datasets which I'm trying to work out
as a workaround for now, I imported just the accident data manually into mongo, so I'll do a db dump that you can import into yours,
there are 3.2 million records on the accident
size on disk 13gb as a db
I'll keep working on getting them sterilized and combined, but for now you guys can at least work with these
I'll put a json of the record on trello
axschech
@axschech
Mar 29 2015 13:29
lol i literally passed out as soon asi got home
npantoja
@npantoja
Mar 29 2015 14:48
I'm geocoding the addresses from the 2013 Passaic Accidents sample data now. 3% done.
mmacvey1
@mmacvey1
Mar 29 2015 14:49
I'm geocoding the addresses from the 2013 Passaic Accidents sample data now. 3% done.
axschech
@axschech
Mar 29 2015 16:58
awesome!
axschech
@axschech
Mar 29 2015 17:23
@mmacvey1 great job!
mmacvey1
@mmacvey1
Mar 29 2015 17:27
@axschech thanks. didn't really work out how I was hoping it would...

@/all to make this data really useful for journalists who like maps... it would be nice to add latitude and longitude to the database.

If we have a slide in the presentation for what we would like help with and future features ideas... definitely add something about geocoding the data.

make sense?
axschech
@axschech
Mar 29 2015 17:35
we have lat and long its in the accidents
i added it :D
mmacvey1
@mmacvey1
Mar 29 2015 17:37
@axschech that's amazing.
@axschech what did you use to geocode?
axschech
@axschech
Mar 29 2015 17:38
@comrh is using google, but we dont have anything besides lat long and a lot of the records have it empty :/
mmacvey1
@mmacvey1
Mar 29 2015 17:41
@axschech I see. to be more specific... we need to figure out a way to take the address information that we have and populate the lat and lng info where it is empty
so that anyone who uses our database will get full lat lng info with their query results
axschech
@axschech
Mar 29 2015 17:45
yea im not sure if the original data had addresses but the data we have no doesnt
*now
also github is getting destroyed lol
mmacvey1
@mmacvey1
Mar 29 2015 18:01
@axschech ah, okay. the street address is crash location. To pull an address together in one column I did =CONCATENATE(crash_location + ", " + municipality_name + ", NJ")
maybe down the line we could do a similar operation with our new database