我想从github得到一些示例代码(https://github.com/kaantas/spark-twitter-sentiment-analysis). 我遵循以下步骤;
已启动zkserver
启动了kafka 2.5.0版本(我也在使用apachespark3.0.0和jdk8)
启动tweeetlistener.py(tweets开始流,我可以看到tweet cmd窗口)
我用spyder打开twitter主题avg情绪val.py,它只显示底部文本
注:我不知道任何关于jar的想法,如果我将使用外部jar,请解释如何?谢谢。。。
Traceback (most recent call last):
File "C:\Users\merha\Desktop\spark-twitter-sentiment-analysis-master\twitter_topic_avg_sentiment_val.py", line 40, in <module>
query.awaitTermination()
File "C:\Anaconda3\lib\site-packages\pyspark\sql\streaming.py", line 103, in awaitTermination
return self._jsq.awaitTermination()
File "C:\Anaconda3\lib\site-packages\py4j\java_gateway.py", line 1305, in __call__
answer, self.gateway_client, self.target_id, self.name)
File "C:\Anaconda3\lib\site-packages\pyspark\sql\utils.py", line 137, in deco
raise_from(converted)
File "<string>", line 3, in raise_from
StreamingQueryException: org/apache/spark/kafka010/KafkaConfigUpdater
=== Streaming Query ===
Identifier: [id = f5dd9cb5-fcea-42ec-a20e-93a2ad233e1f, runId = 6cffdd89-3792-4500-a508-e4abc76425fb]
Current Committed Offsets: {}
Current Available Offsets: {}
Current State: INITIALIZING
Thread State: RUNNABLE
5条答案
按热度按时间jhkqcmku1#
mo49yndu2#
--<<<twitter主题\u平均情绪\u值.py>>>>>
iyzzxitl3#
--------<tweet\u listener.py>>>
huwehgph4#
3j86kqsm5#
在我下载并复制这个jar文件之后
spark-token-provider-kafka-0-10
到spark jars文件夹(或添加到spark\u classpath),我的问题解决了。