- 安装maven,设置MAVEN_HOME等配置
- 下载flume源码
- eclipse-oxygen,设置eclipse 使用外部maven,并配置settings.xml
shell mvn clean install -DskipTests -Dmaven.test.skip=true
- 遇到问题:
[INFO] ------------------------------------------------------------------------
[INFO] Reactor Summary:
[INFO]
[INFO] Apache Flume ....................................... SUCCESS [ 7.379 s]
[INFO] Flume NG SDK ....................................... SUCCESS [ 5.782 s]
[INFO] Flume NG Configuration ............................. SUCCESS [ 2.031 s]
[INFO] Flume Auth ......................................... SUCCESS [ 5.672 s]
[INFO] Flume NG Core ...................................... SUCCESS [ 8.823 s]
[INFO] Flume NG Sinks ..................................... SUCCESS [ 0.227 s]
[INFO] Flume NG HDFS Sink ................................. SUCCESS [ 2.950 s]
[INFO] Flume NG IRC Sink .................................. SUCCESS [ 1.329 s]
[INFO] Flume NG Channels .................................. SUCCESS [ 0.158 s]
[INFO] Flume NG JDBC channel .............................. SUCCESS [ 2.076 s]
[INFO] Flume NG file-based channel ........................ SUCCESS [ 4.922 s]
[INFO] Flume NG Spillable Memory channel .................. SUCCESS [ 1.562 s]
[INFO] Flume NG Node ...................................... SUCCESS [ 2.766 s]
[INFO] Flume NG Embedded Agent ............................ SUCCESS [ 1.610 s]
[INFO] Flume NG HBase Sink ................................ SUCCESS [ 4.669 s]
[INFO] Flume NG ElasticSearch Sink ........................ SUCCESS [ 3.568 s]
[INFO] Flume NG Morphline Solr Sink ....................... FAILURE [ 15.589 s]
[INFO] Flume Shared Utils ................................. SKIPPED
[INFO] Flume Shared Kafka Test Utils ...................... SKIPPED
[INFO] Flume Kafka Sink ................................... SKIPPED
[INFO] Flume NG Kite Dataset Sink ......................... SKIPPED
[INFO] Flume NG Hive Sink ................................. SKIPPED
[INFO] Flume Sources ...................................... SKIPPED
[INFO] Flume Scribe Source ................................ SKIPPED
[INFO] Flume JMS Source ................................... SKIPPED
[INFO] Flume Twitter Source ............................... SKIPPED
[INFO] Flume Kafka Source ................................. SKIPPED
[INFO] Flume Taildir Source ............................... SKIPPED
[INFO] flume-kafka-channel ................................ SKIPPED
[INFO] Flume legacy Sources ............................... SKIPPED
[INFO] Flume legacy Avro source ........................... SKIPPED
[INFO] Flume legacy Thrift Source ......................... SKIPPED
[INFO] Flume NG Clients ................................... SKIPPED
[INFO] Flume NG Log4j Appender ............................ SKIPPED
[INFO] Flume NG Tools ..................................... SKIPPED
[INFO] Flume NG distribution .............................. SKIPPED
[INFO] Flume NG Integration Tests ......................... SKIPPED
[INFO] ------------------------------------------------------------------------
[INFO] BUILD FAILURE
[INFO] ------------------------------------------------------------------------
[INFO] Total time: 01:17 min
[INFO] Finished at: 2017-10-31T15:56:38+08:00
[INFO] Final Memory: 154M/528M
[INFO] ------------------------------------------------------------------------
[ERROR] Failed to execute goal on project flume-ng-morphline-solr-sink: Could no
t resolve dependencies for project org.apache.flume.flume-ng-sinks:flume-ng-morp
hline-solr-sink:jar:1.7.0: Failed to collect dependencies at org.kitesdk:kite-mo
rphlines-all:pom:1.0.0 -> org.kitesdk:kite-morphlines-useragent:jar:1.0.0 -> ua_
parser:ua-parser:jar:1.3.0: Failed to read artifact descriptor for ua_parser:ua-
parser:jar:1.3.0: Could not transfer artifact ua_parser:ua-parser:pom:1.3.0 from
/to maven-twttr (http://maven.twttr.com): maven.twttr.com: Unknown host maven.tw
ttr.com -> [Help 1]
# hosts中加入如下映射
199.16.156.89 maven.twttr.com
如果顺利,已将所需jar都下载下来了。
# 从existing maven project 导入成 eclipse 项目
# 探测到需要m2e插件,安装即可
导入后遇到如下问题
举例:flume-avro-source 项目其中一个错误如下:
AvroFlumeOGEvent cannot be resolved to a type
/flume-avro-source/src/main/java/org/apache/flume/source/avroLegacy/AvroLegacySource.java
举例:
在flume-avro-source项目中,target目录下是空的。
因为报错的这些找不到的类是需要通过avro生成的。
在flume-avro-source项目上,右键run as -> maven generate-source ,运行之后,target目录下多了几个java文件。target\avro 目录设置为 source即可。
按顺序 将其他两个项目做相同操作即可:flume-ng-sdk、flume-ng-core
flume 1.8按照此方法也可以导入
来源:oschina
链接:https://my.oschina.net/u/120395/blog/1558747