How to read data into Tensorflow?

后端 未结 4 607
鱼传尺愫
鱼传尺愫 2021-02-05 22:22

I\'m trying to read data from CSV files to tensorflow,

https://www.tensorflow.org/versions/r0.7/how_tos/reading_data/index.html#filenames-shuffling-and-epoch-limits

4条回答
  •  自闭症患者
    2021-02-05 22:55

    of course you can implement to directly read batch random sort trained data from mongo to feed to tensorflow. below is my way:

            for step in range(self.steps):
    
    
                pageNum=1;
                while(True):
                    trainArray,trainLabelsArray = loadBatchTrainDataFromMongo(****)
                    if len(trainArray)==0:
                        logging.info("train datas consume up!")
                        break;
                    logging.info("started to train")
                    sess.run([model.train_op],
                             feed_dict={self.input: trainArray,
                                        self.output: np.asarray(trainLabelsArray),
                                        self.keep_prob: params['dropout_rate']})
    
                    pageNum=pageNum+1;
    

    and also you need preprocess trained data in mongodb, such like: assign each trained data in mongodb a random sort value...

提交回复
热议问题