beam wordcount docker映像无法在flink runner上启动,avrocoderregistrar不是子类型异常

j1dl9f46  于 2021-06-21  发布在  Flink
关注(0)|答案(0)|浏览(178)

我正在使用flink 1.10.1和beam版本2.22.0。使用“mvn package-pflinkrunner”构建了beam字数计算示例,当提交到本地运行的flink集群时,它运行良好。
现在,按照https://github.com/apache/flink 对于beam wordcount示例,在尝试启动作业集群时,它失败,出现以下avro异常:

Caused by: java.util.ServiceConfigurationError: org.apache.beam.runners.core.construction.CoderTranslatorRegistrar: Provider org.apache.beam.runners.core.construction.AvroCoderRegistrar not a subtype
        at java.util.ServiceLoader.fail(ServiceLoader.java:239)
        at java.util.ServiceLoader.access$300(ServiceLoader.java:185)
        at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:376)
        at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404)
        at java.util.ServiceLoader$1.next(ServiceLoader.java:480)
        at org.apache.beam.runners.core.construction.CoderTranslation.loadCoderURNs(CoderTranslation.java:52)
        at org.apache.beam.runners.core.construction.CoderTranslation.<clinit>(CoderTranslation.java:44)
        at org.apache.beam.runners.core.construction.SdkComponents.registerCoder(SdkComponents.java:269)
        at org.apache.beam.runners.core.construction.PCollectionTranslation.toProto(PCollectionTranslation.java:35)
        at org.apache.beam.runners.core.construction.SdkComponents.registerPCollection(SdkComponents.java:224)
        at org.apache.beam.runners.core.construction.PTransformTranslation.translateAppliedPTransform(PTransformTranslation.java:475)
        at org.apache.beam.runners.core.construction.ParDoTranslation$ParDoTranslator.translate(ParDoTranslation.java:168)
        at org.apache.beam.runners.core.construction.PTransformTranslation.toProto(PTransformTranslation.java:234)
        at org.apache.beam.runners.core.construction.ParDoTranslation.getParDoPayload(ParDoTranslation.java:731)
        at org.apache.beam.runners.core.construction.ParDoTranslation.isSplittable(ParDoTranslation.java:746)
        at org.apache.beam.runners.core.construction.PTransformMatchers$6.matches(PTransformMatchers.java:266)
        at org.apache.beam.sdk.Pipeline$2.visitPrimitiveTransform(Pipeline.java:284)
        at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:665)
        at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:657)
        at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:657)
        at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:657)
        at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$600(TransformHierarchy.java:317)
        at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:251)
        at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:463)
        at org.apache.beam.sdk.Pipeline.replace(Pipeline.java:262)
        at org.apache.beam.sdk.Pipeline.replaceAll(Pipeline.java:212)
        at org.apache.beam.runners.flink.FlinkPipelineExecutionEnvironment.translate(FlinkPipelineExecutionEnvironment.java:115)
        at org.apache.beam.runners.flink.FlinkRunner.run(FlinkRunner.java:82)
        at org.apache.beam.sdk.Pipeline.run(Pipeline.java:317)
        at org.apache.beam.sdk.Pipeline.run(Pipeline.java:303)
        at org.apache.beam.examples.WordCount.runWordCount(WordCount.java:185)
        at org.apache.beam.examples.WordCount.main(WordCount.java:193)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43)
        at java.lang.reflect.Method.invoke(Method.java:498)
        at org.apache.flink.client.program.PackagedProgram.callMainMethod(PackagedProgram.java:321)
        at org.apache.flink.client.program.PackagedProgram.invokeInteractiveModeForExecution(PackagedProgram.java:205)
        at org.apache.flink.client.program.OptimizerPlanEnvironment.getPipeline(OptimizerPlanEnvironment.java:80)
        ... 12 more

有什么线索/提示这里可能出了什么问题吗?谢谢

暂无答案!

目前还没有任何答案,快来回答吧!

相关问题