These are chat archives for arita37/tensorflow

14th
Oct 2017
Vaibhav Satam
@SatioO
Oct 14 2017 17:23

I am writing to ask the principle of how to feed a big training data to a tensor flow model. My training data is hosted in csv file(s), and basically I am using the below code to load data in queue.

filename_queue = tf.train.string_inputproducer([...])
reader = tf.TextLineReader()
, line = reader.read(filename_queue)

line = tf.decode_csv(line, record_defaults=default)
label_batch, feature_batch = tf.train.shuffle_batch([label, feature], batch_size=batch_size, capacity=512, min_after_dequeue=256, num_threads=8)