我正在使用flink 1.10.1和beam版本2.22.0。使用“mvn package-pflinkrunner”构建了beam字数计算示例,当提交到本地运行的flink集群时,它运行良好。
现在,按照https://github.com/apache/flink 对于beam wordcount示例,在尝试启动作业集群时,它失败,出现以下avro异常:
Caused by: java.util.ServiceConfigurationError: org.apache.beam.runners.core.construction.CoderTranslatorRegistrar: Provider org.apache.beam.runners.core.construction.AvroCoderRegistrar not a subtype
at java.util.ServiceLoader.fail(ServiceLoader.java:239)
at java.util.ServiceLoader.access$300(ServiceLoader.java:185)
at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:376)
at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404)
at java.util.ServiceLoader$1.next(ServiceLoader.java:480)
at org.apache.beam.runners.core.construction.CoderTranslation.loadCoderURNs(CoderTranslation.java:52)
at org.apache.beam.runners.core.construction.CoderTranslation.<clinit>(CoderTranslation.java:44)
at org.apache.beam.runners.core.construction.SdkComponents.registerCoder(SdkComponents.java:269)
at org.apache.beam.runners.core.construction.PCollectionTranslation.toProto(PCollectionTranslation.java:35)
at org.apache.beam.runners.core.construction.SdkComponents.registerPCollection(SdkComponents.java:224)
at org.apache.beam.runners.core.construction.PTransformTranslation.translateAppliedPTransform(PTransformTranslation.java:475)
at org.apache.beam.runners.core.construction.ParDoTranslation$ParDoTranslator.translate(ParDoTranslation.java:168)
at org.apache.beam.runners.core.construction.PTransformTranslation.toProto(PTransformTranslation.java:234)
at org.apache.beam.runners.core.construction.ParDoTranslation.getParDoPayload(ParDoTranslation.java:731)
at org.apache.beam.runners.core.construction.ParDoTranslation.isSplittable(ParDoTranslation.java:746)
at org.apache.beam.runners.core.construction.PTransformMatchers$6.matches(PTransformMatchers.java:266)
at org.apache.beam.sdk.Pipeline$2.visitPrimitiveTransform(Pipeline.java:284)
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:665)
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:657)
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:657)
at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:657)
at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:317)
at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:251)
at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:463)
at org.apache.beam.sdk.Pipeline.replace(Pipeline.java:262)
at org.apache.beam.sdk.Pipeline.replaceAll(Pipeline.java:212)
at org.apache.beam.runners.flink.FlinkPipelineExecutionEnvironment.translate(FlinkPipelineExecutionEnvironment.java:115)
at org.apache.beam.runners.flink.FlinkRunner.run(FlinkRunner.java:82)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:317)
at org.apache.beam.sdk.Pipeline.run(Pipeline.java:303)
at org.apache.beam.examples.WordCount.runWordCount(WordCount.java:185)
at org.apache.beam.examples.WordCount.main(WordCount.java:193)
at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
at java.lang.reflect.Method.invoke(Method.java:498)
at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:321)
at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:205)
at org.apache.flink.client.program.OptimizerPlanEnvironment.getPipeline(OptimizerPlanEnvironment.java:80)
... 12 more
有什么线索/提示这里可能出了什么问题吗?谢谢
暂无答案!
目前还没有任何答案,快来回答吧!