These are chat archives for UnderstandLingBV/Tuktu

9th
Jun 2016
Erik Tromp
@ErikTromp
Jun 09 2016 09:12
@dmassart if you like, you can test the new SQL generator
I added back pressure support to it by using Iteratees
David Massart
@dmassart
Jun 09 2016 20:50
@ErikTromp glad to report that it works. I have been able to process (read from SQL server, do some data transformation and write in MongoDB) 13,173,193 records (1.180 GB) in 1 hour 52 minutes and 57 seconds - using the previous version, the process stalled after about 2 million records