Mounting HDFS directory

寵の児 提交于 2019-12-11 10:26:17

问题


Can I mount HDFS directory (configured in Ubuntu) to a drive in Windows server ?

After mapping e.g H:\ ---> \home\user1\HDFSCreatedDir , would like to read, write and move/copy files using normal Java IO package API's.


回答1:


Yes, HDFS directory can be mounted in Windows and Linux. You can use one of the tools below:

  • contrib/fuse-dfs is built on fuse, some C glue, libhdfs and the hadoop-dev.jar
  • fuse-j-hdfs is built on fuse, fuse for java, and the hadoop-dev.jar
  • hdfs-fuse - a google code project is very similar to contrib/fuse-dfs
  • webdav - hdfs exposed as a webdav resource
  • mapR - contains a closed source hdfs compatible file system that supports read/write NFS access
  • HDFS NFS Proxy - exports HDFS as NFS without use of fuse. Supports Kerberos and re-orders writes so they are written to hdfs sequentially.
  • native-hdfs-fuse - a FUSE implementation in C that supports random writes While not complete filesystem implementations (FUSE or otherwise), the following projects could be useful when building one
  • hadoofus - an implementation of the libhdfs API in C for hadoop 0.20.203 to 1.0.3


来源:https://stackoverflow.com/questions/23966414/mounting-hdfs-directory

标签
易学教程内所有资源均来自网络或用户发布的内容,如有违反法律规定的内容欢迎反馈
该文章没有解决你所遇到的问题?点击提问,说说你的问题,让更多的人一起探讨吧!