From 5ccbdbf89e35052dc3c029cb9e8f7786fae09d5d Mon Sep 17 00:00:00 2001 From: heibaiying <31504331+heibaiying@users.noreply.github.com> Date: Sun, 26 May 2019 19:07:10 +0800 Subject: [PATCH] =?UTF-8?q?Update=20Spark=5FStreaming=E6=95=B4=E5=90=88Kaf?= =?UTF-8?q?ka.md?= MIME-Version: 1.0 Content-Type: text/plain; charset=UTF-8 Content-Transfer-Encoding: 8bit --- notes/Spark_Streaming整合Kafka.md | 7 ++++--- 1 file changed, 4 insertions(+), 3 deletions(-) diff --git a/notes/Spark_Streaming整合Kafka.md b/notes/Spark_Streaming整合Kafka.md index 975a8d9..0244587 100644 --- a/notes/Spark_Streaming整合Kafka.md +++ b/notes/Spark_Streaming整合Kafka.md @@ -26,7 +26,7 @@ Spark针对Kafka的不同版本,提供了两套整合方案:`spark-streaming | Direct DStream | Yes | Yes | | SSL / TLS Support | No | Yes | | Offset Commit API(偏移量提交) | No | Yes | -| Dynamic Topic Subscription(动态主题订阅) | No | Yes | +| Dynamic Topic Subscription
(动态主题订阅) | No | Yes | 本文使用的Kafka版本为`kafka_2.12-2.2.0`,故采用第二种方式进行整合。 @@ -48,7 +48,8 @@ Spark针对Kafka的不同版本,提供了两套整合方案:`spark-streaming spark-streaming-kafka-0-10_${scala.version} 2.4.3 - + com.thoughtworks.paranamer paranamer @@ -320,4 +321,4 @@ bin/kafka-console-producer.sh --broker-list hadoop001:9092 --topic spark-streami ## 参考资料 -1. https://spark.apache.org/docs/latest/streaming-kafka-0-10-integration.html \ No newline at end of file +1. https://spark.apache.org/docs/latest/streaming-kafka-0-10-integration.html