These are chat archives for arita37/tensorflow
I am writing to ask the principle of how to feed a big training data to a tensor flow model. My training data is hosted in csv file(s), and basically I am using the below code to load data in queue.
filename_queue = tf.train.string_inputproducer([...])
reader = tf.TextLineReader() , line = reader.read(filename_queue)
line = tf.decode_csv(line, record_defaults=default)
label_batch, feature_batch = tf.train.shuffle_batch([label, feature], batch_size=batch_size, capacity=512, min_after_dequeue=256, num_threads=8)