Why use tensorflow gfile? (for file I/O)

£可爱£侵袭症+ 提交于 2019-12-20 12:06:28

问题


Tensorflow code uses methods for file I/O that are different than python builtin methods. According to the source code, it is useful as

"File I/O wrappers without thread locking"

I am not sure on what occasions it is useful and when it shouldn't be used.

Any idea?

Thank you


回答1:


This comment:

File I/O wrappers without thread locking

...is a particularly unhelpful description for TensorFlow's tf.gfile module!

The main roles of the tf.gfile module are:

  1. To provide an API that is close to Python's file objects, and
  2. To provide an implementation based on TensorFlow's C++ FileSystem API.

The C++ FileSystem API supports multiple file system implementations, including local files, Google Cloud Storage (using a gs:// prefix), and HDFS (using an hdfs:// prefix). TensorFlow exports these as tf.gfile so that you can uses these implementations for saving and loading checkpoints, writing TensorBoard logs, and accessing training data (among other uses). However, if all of your files are local, you can use the regular Python file API without any problem.



来源:https://stackoverflow.com/questions/42922948/why-use-tensorflow-gfile-for-file-i-o

易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!