confluent-cloud

Can't read from kafka by KafkaIO in beam

纵然是瞬间 提交于 2020-01-16 16:31:53
问题 I have written a very simpel pipeline in Apchea Beam as follow to read data from my kafka cluster on Confluent Cloud as follow: Pipeline pipeline = Pipeline.create(options); Map<String, Object> propertyBuilder = new HashMap(); propertyBuilder.put("ssl.endpoint.identification.algorithm", "https"); propertyBuilder.put("sasl.mechanism","PLAIN"); propertyBuilder.put("request.timeout.ms","20000"); propertyBuilder.put("retry.backoff.ms","500"); pipeline .apply(KafkaIO.<byte[], byte[]>readBytes()

Can't read from kafka by KafkaIO in beam

ぃ、小莉子 提交于 2020-01-16 16:31:08
问题 I have written a very simpel pipeline in Apchea Beam as follow to read data from my kafka cluster on Confluent Cloud as follow: Pipeline pipeline = Pipeline.create(options); Map<String, Object> propertyBuilder = new HashMap(); propertyBuilder.put("ssl.endpoint.identification.algorithm", "https"); propertyBuilder.put("sasl.mechanism","PLAIN"); propertyBuilder.put("request.timeout.ms","20000"); propertyBuilder.put("retry.backoff.ms","500"); pipeline .apply(KafkaIO.<byte[], byte[]>readBytes()