org.apache.flink.api.common.operators.Operator.getOperatorInfo()方法的使用及代码示例

x33g5p2x  于2022-01-26 转载在 其他  
字(9.0k)|赞(0)|评价(0)|浏览(82)

本文整理了Java中org.apache.flink.api.common.operators.Operator.getOperatorInfo()方法的一些代码示例，展示了Operator.getOperatorInfo()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。Operator.getOperatorInfo()方法的具体详情如下：
包路径：org.apache.flink.api.common.operators.Operator
类名称：Operator
方法名：getOperatorInfo

Operator.getOperatorInfo介绍

[英]Gets the information about the operators input/output types.
[中]获取有关运算符输入/输出类型的信息。

代码示例

代码示例来源：origin: apache/flink

@Override
public UnaryOperatorInformation<OUT, OUT> getOperatorInfo() {
  TypeInformation<OUT> previousOut = input.getOperatorInfo().getOutputType();
  return new UnaryOperatorInformation<OUT, OUT>(previousOut, previousOut);
}

代码示例来源：origin: apache/flink

public Union(Operator<T> input1, Operator<T> input2, String unionLocationName) {
  this(new BinaryOperatorInformation<T, T, T>(input1.getOperatorInfo().getOutputType(),
      input1.getOperatorInfo().getOutputType(), input1.getOperatorInfo().getOutputType()), unionLocationName);
  setFirstInput(input1);
  setSecondInput(input2);
}

代码示例来源：origin: apache/flink

@Override
  protected List<IN> executeOnCollections(List<IN> inputData, RuntimeContext runtimeContext, ExecutionConfig executionConfig) {

    TypeInformation<IN> inputType = getInput().getOperatorInfo().getOutputType();

    int[] sortColumns = this.partitionOrdering.getFieldPositions();
    boolean[] sortOrderings = this.partitionOrdering.getFieldSortDirections();

    final TypeComparator<IN> sortComparator;
    if (inputType instanceof CompositeType) {
      sortComparator = ((CompositeType<IN>) inputType).createComparator(sortColumns, sortOrderings, 0, executionConfig);
    } else if (inputType instanceof AtomicType) {
      sortComparator = ((AtomicType) inputType).createComparator(sortOrderings[0], executionConfig);
    } else {
      throw new UnsupportedOperationException("Partition sorting does not support type "+inputType+" yet.");
    }

    Collections.sort(inputData, new Comparator<IN>() {
      @Override
      public int compare(IN o1, IN o2) {
        return sortComparator.compare(o1, o2);
      }
    });

    return inputData;
  }
}

代码示例来源：origin: apache/flink

type = input1.getOperatorInfo().getOutputType();
} else if (input2.length > 0 && input2[0] != null) {
  type = input2[0].getOperatorInfo().getOutputType();
} else {
  throw new IllegalArgumentException("Could not determine type information from inputs.");

代码示例来源：origin: apache/flink

public static TypeComparatorFactory<?> getShipComparator(Channel channel, ExecutionConfig executionConfig) {
  PlanNode source = channel.getSource();
  Operator<?> javaOp = source.getProgramOperator();
  TypeInformation<?> type = javaOp.getOperatorInfo().getOutputType();
  return createComparator(type, channel.getShipStrategyKeys(),
    getSortOrders(channel.getShipStrategyKeys(), channel.getShipStrategySortOrder()), executionConfig);
}

代码示例来源：origin: apache/flink

/**
 * @param criterion
 */
public <X> void setTerminationCriterion(Operator<X> criterion) {
  
  TypeInformation<X> type = criterion.getOperatorInfo().getOutputType();
  
  FlatMapOperatorBase<X, X, TerminationCriterionMapper<X>> mapper =
      new FlatMapOperatorBase<X, X, TerminationCriterionMapper<X>>(
          new TerminationCriterionMapper<X>(),
          new UnaryOperatorInformation<X, X>(type, type),
          "Termination Criterion Aggregation Wrapper");
  mapper.setInput(criterion);
  
  this.terminationCriterion = mapper;
  this.getAggregators().registerAggregationConvergenceCriterion(TERMINATION_CRITERION_AGGREGATOR_NAME, new TerminationCriterionAggregator(), new TerminationCriterionAggregationConvergence());
}

代码示例来源：origin: apache/flink

@SuppressWarnings("unchecked")
protected void executeOnCollections(List<IN> inputData, RuntimeContext ctx, ExecutionConfig executionConfig) throws Exception {
  OutputFormat<IN> format = this.formatWrapper.getUserCodeObject();
  TypeInformation<IN> inputType = getInput().getOperatorInfo().getOutputType();

代码示例来源：origin: apache/flink

TypeInformation<?> type = javaOp.getOperatorInfo().getOutputType();
    (source.getDriverStrategy() == DriverStrategy.SORTED_GROUP_COMBINE || source.getDriverStrategy() == DriverStrategy.ALL_GROUP_REDUCE_COMBINE)) {
  GroupReduceOperatorBase<?, ?, ?> groupNode = (GroupReduceOperatorBase<?, ?, ?>) javaOp;
  type = groupNode.getInput().getOperatorInfo().getOutputType();
  type = groupNode.getInput().getOperatorInfo().getOutputType();

代码示例来源：origin: apache/flink

final TypeInformation<?> sourceOutputType = sourceNode.getOptimizerNode().getOperator().getOperatorInfo().getOutputType();
final TypeInformation<IntermediateSampleData> isdTypeInformation = TypeExtractor.getForClass(IntermediateSampleData.class);
final UnaryOperatorInformation sipOperatorInformation = new UnaryOperatorInformation(sourceOutputType, isdTypeInformation);

代码示例来源：origin: com.alibaba.blink/flink-core

public Union(Operator<T> input1, Operator<T> input2, String unionLocationName) {
  this(new BinaryOperatorInformation<T, T, T>(input1.getOperatorInfo().getOutputType(),
      input1.getOperatorInfo().getOutputType(), input1.getOperatorInfo().getOutputType()), unionLocationName);
  setFirstInput(input1);
  setSecondInput(input2);
}

代码示例来源：origin: org.apache.flink/flink-core

public Union(Operator<T> input1, Operator<T> input2, String unionLocationName) {
  this(new BinaryOperatorInformation<T, T, T>(input1.getOperatorInfo().getOutputType(),
      input1.getOperatorInfo().getOutputType(), input1.getOperatorInfo().getOutputType()), unionLocationName);
  setFirstInput(input1);
  setSecondInput(input2);
}

代码示例来源：origin: org.apache.flink/flink-optimizer_2.10

@Override
public UnaryOperatorInformation<OUT, OUT> getOperatorInfo() {
  TypeInformation<OUT> previousOut = input.getOperatorInfo().getOutputType();
  return new UnaryOperatorInformation<OUT, OUT>(previousOut, previousOut);
}

代码示例来源：origin: org.apache.flink/flink-optimizer

@Override
public UnaryOperatorInformation<OUT, OUT> getOperatorInfo() {
  TypeInformation<OUT> previousOut = input.getOperatorInfo().getOutputType();
  return new UnaryOperatorInformation<OUT, OUT>(previousOut, previousOut);
}

代码示例来源：origin: org.apache.flink/flink-optimizer_2.11

@Override
public UnaryOperatorInformation<OUT, OUT> getOperatorInfo() {
  TypeInformation<OUT> previousOut = input.getOperatorInfo().getOutputType();
  return new UnaryOperatorInformation<OUT, OUT>(previousOut, previousOut);
}

代码示例来源：origin: com.alibaba.blink/flink-optimizer

@Override
public UnaryOperatorInformation<OUT, OUT> getOperatorInfo() {
  TypeInformation<OUT> previousOut = input.getOperatorInfo().getOutputType();
  return new UnaryOperatorInformation<OUT, OUT>(previousOut, previousOut);
}

代码示例来源：origin: org.apache.flink/flink-optimizer

public static TypeComparatorFactory<?> getShipComparator(Channel channel, ExecutionConfig executionConfig) {
  PlanNode source = channel.getSource();
  Operator<?> javaOp = source.getProgramOperator();
  TypeInformation<?> type = javaOp.getOperatorInfo().getOutputType();
  return createComparator(type, channel.getShipStrategyKeys(),
    getSortOrders(channel.getShipStrategyKeys(), channel.getShipStrategySortOrder()), executionConfig);
}

代码示例来源：origin: org.apache.flink/flink-optimizer_2.11

public static TypeComparatorFactory<?> getShipComparator(Channel channel, ExecutionConfig executionConfig) {
  PlanNode source = channel.getSource();
  Operator<?> javaOp = source.getProgramOperator();
  TypeInformation<?> type = javaOp.getOperatorInfo().getOutputType();
  return createComparator(type, channel.getShipStrategyKeys(),
    getSortOrders(channel.getShipStrategyKeys(), channel.getShipStrategySortOrder()), executionConfig);
}

代码示例来源：origin: com.alibaba.blink/flink-optimizer

public static TypeComparatorFactory<?> getShipComparator(Channel channel, ExecutionConfig executionConfig) {
  PlanNode source = channel.getSource();
  Operator<?> javaOp = source.getProgramOperator();
  TypeInformation<?> type = javaOp.getOperatorInfo().getOutputType();
  return createComparator(type, channel.getShipStrategyKeys(),
    getSortOrders(channel.getShipStrategyKeys(), channel.getShipStrategySortOrder()), executionConfig);
}

代码示例来源：origin: org.apache.flink/flink-optimizer_2.10

public static TypeComparatorFactory<?> getShipComparator(Channel channel, ExecutionConfig executionConfig) {
  PlanNode source = channel.getSource();
  Operator<?> javaOp = source.getProgramOperator();
  TypeInformation<?> type = javaOp.getOperatorInfo().getOutputType();
  return createComparator(type, channel.getShipStrategyKeys(),
    getSortOrders(channel.getShipStrategyKeys(), channel.getShipStrategySortOrder()), executionConfig);
}

代码示例来源：origin: org.apache.flink/flink-core

/**
 * @param criterion
 */
public <X> void setTerminationCriterion(Operator<X> criterion) {
  
  TypeInformation<X> type = criterion.getOperatorInfo().getOutputType();
  
  FlatMapOperatorBase<X, X, TerminationCriterionMapper<X>> mapper =
      new FlatMapOperatorBase<X, X, TerminationCriterionMapper<X>>(
          new TerminationCriterionMapper<X>(),
          new UnaryOperatorInformation<X, X>(type, type),
          "Termination Criterion Aggregation Wrapper");
  mapper.setInput(criterion);
  
  this.terminationCriterion = mapper;
  this.getAggregators().registerAggregationConvergenceCriterion(TERMINATION_CRITERION_AGGREGATOR_NAME, new TerminationCriterionAggregator(), new TerminationCriterionAggregationConvergence());
}

内容来源于网络，如有侵权，请联系作者删除！

Operator

相关文章

    查看更多
    微信公众号

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com