org.apache.flink.api.java.operators.UnsortedGrouping.getInputDataSet()方法的使用及代码示例

x33g5p2x  于2022-02-01 转载在 其他  
字(7.2k)|赞(0)|评价(0)|浏览(95)

本文整理了Java中org.apache.flink.api.java.operators.UnsortedGrouping.getInputDataSet()方法的一些代码示例,展示了UnsortedGrouping.getInputDataSet()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。UnsortedGrouping.getInputDataSet()方法的具体详情如下:
包路径:org.apache.flink.api.java.operators.UnsortedGrouping
类名称:UnsortedGrouping
方法名:getInputDataSet

UnsortedGrouping.getInputDataSet介绍

暂无

代码示例

代码示例来源:origin: apache/flink

/**
 * Applies a GroupReduce transformation on a grouped {@link DataSet}.
 *
 * <p>The transformation calls a {@link org.apache.flink.api.common.functions.RichGroupReduceFunction} for each group of the DataSet.
 * A GroupReduceFunction can iterate over all elements of a group and emit any
 *   number of output elements including none.
 *
 * @param reducer The GroupReduceFunction that is applied on each group of the DataSet.
 * @return A GroupReduceOperator that represents the reduced DataSet.
 *
 * @see org.apache.flink.api.common.functions.RichGroupReduceFunction
 * @see GroupReduceOperator
 * @see DataSet
 */
public <R> GroupReduceOperator<T, R> reduceGroup(GroupReduceFunction<T, R> reducer) {
  if (reducer == null) {
    throw new NullPointerException("GroupReduce function must not be null.");
  }
  TypeInformation<R> resultType = TypeExtractor.getGroupReduceReturnTypes(reducer,
      this.getInputDataSet().getType(), Utils.getCallLocationName(), true);
  return new GroupReduceOperator<T, R>(this, resultType, inputDataSet.clean(reducer), Utils.getCallLocationName());
}

代码示例来源:origin: apache/flink

/**
 * Applies a GroupCombineFunction on a grouped {@link DataSet}.
 * A GroupCombineFunction is similar to a GroupReduceFunction but does not perform a full data exchange. Instead, the
 * CombineFunction calls the combine method once per partition for combining a group of results. This
 * operator is suitable for combining values into an intermediate format before doing a proper groupReduce where
 * the data is shuffled across the node for further reduction. The GroupReduce operator can also be supplied with
 * a combiner by implementing the RichGroupReduce function. The combine method of the RichGroupReduce function
 * demands input and output type to be the same. The CombineFunction, on the other side, can have an arbitrary
 * output type.
 * @param combiner The GroupCombineFunction that is applied on the DataSet.
 * @return A GroupCombineOperator which represents the combined DataSet.
 */
public <R> GroupCombineOperator<T, R> combineGroup(GroupCombineFunction<T, R> combiner) {
  if (combiner == null) {
    throw new NullPointerException("GroupCombine function must not be null.");
  }
  TypeInformation<R> resultType = TypeExtractor.getGroupCombineReturnTypes(combiner,
      this.getInputDataSet().getType(), Utils.getCallLocationName(), true);
  return new GroupCombineOperator<T, R>(this, resultType, inputDataSet.clean(combiner), Utils.getCallLocationName());
}

代码示例来源:origin: org.apache.flink/flink-java

/**
 * Applies a GroupCombineFunction on a grouped {@link DataSet}.
 * A GroupCombineFunction is similar to a GroupReduceFunction but does not perform a full data exchange. Instead, the
 * CombineFunction calls the combine method once per partition for combining a group of results. This
 * operator is suitable for combining values into an intermediate format before doing a proper groupReduce where
 * the data is shuffled across the node for further reduction. The GroupReduce operator can also be supplied with
 * a combiner by implementing the RichGroupReduce function. The combine method of the RichGroupReduce function
 * demands input and output type to be the same. The CombineFunction, on the other side, can have an arbitrary
 * output type.
 * @param combiner The GroupCombineFunction that is applied on the DataSet.
 * @return A GroupCombineOperator which represents the combined DataSet.
 */
public <R> GroupCombineOperator<T, R> combineGroup(GroupCombineFunction<T, R> combiner) {
  if (combiner == null) {
    throw new NullPointerException("GroupCombine function must not be null.");
  }
  TypeInformation<R> resultType = TypeExtractor.getGroupCombineReturnTypes(combiner,
      this.getInputDataSet().getType(), Utils.getCallLocationName(), true);
  return new GroupCombineOperator<T, R>(this, resultType, inputDataSet.clean(combiner), Utils.getCallLocationName());
}

代码示例来源:origin: com.alibaba.blink/flink-java

/**
 * Applies a GroupCombineFunction on a grouped {@link DataSet}.
 * A GroupCombineFunction is similar to a GroupReduceFunction but does not perform a full data exchange. Instead, the
 * CombineFunction calls the combine method once per partition for combining a group of results. This
 * operator is suitable for combining values into an intermediate format before doing a proper groupReduce where
 * the data is shuffled across the node for further reduction. The GroupReduce operator can also be supplied with
 * a combiner by implementing the RichGroupReduce function. The combine method of the RichGroupReduce function
 * demands input and output type to be the same. The CombineFunction, on the other side, can have an arbitrary
 * output type.
 * @param combiner The GroupCombineFunction that is applied on the DataSet.
 * @return A GroupCombineOperator which represents the combined DataSet.
 */
public <R> GroupCombineOperator<T, R> combineGroup(GroupCombineFunction<T, R> combiner) {
  if (combiner == null) {
    throw new NullPointerException("GroupCombine function must not be null.");
  }
  TypeInformation<R> resultType = TypeExtractor.getGroupCombineReturnTypes(combiner,
      this.getInputDataSet().getType(), Utils.getCallLocationName(), true);
  return new GroupCombineOperator<T, R>(this, resultType, inputDataSet.clean(combiner), Utils.getCallLocationName());
}

代码示例来源:origin: org.apache.flink/flink-java

/**
 * Applies a GroupReduce transformation on a grouped {@link DataSet}.
 *
 * <p>The transformation calls a {@link org.apache.flink.api.common.functions.RichGroupReduceFunction} for each group of the DataSet.
 * A GroupReduceFunction can iterate over all elements of a group and emit any
 *   number of output elements including none.
 *
 * @param reducer The GroupReduceFunction that is applied on each group of the DataSet.
 * @return A GroupReduceOperator that represents the reduced DataSet.
 *
 * @see org.apache.flink.api.common.functions.RichGroupReduceFunction
 * @see GroupReduceOperator
 * @see DataSet
 */
public <R> GroupReduceOperator<T, R> reduceGroup(GroupReduceFunction<T, R> reducer) {
  if (reducer == null) {
    throw new NullPointerException("GroupReduce function must not be null.");
  }
  TypeInformation<R> resultType = TypeExtractor.getGroupReduceReturnTypes(reducer,
      this.getInputDataSet().getType(), Utils.getCallLocationName(), true);
  return new GroupReduceOperator<T, R>(this, resultType, inputDataSet.clean(reducer), Utils.getCallLocationName());
}

代码示例来源:origin: com.alibaba.blink/flink-java

/**
 * Applies a GroupReduce transformation on a grouped {@link DataSet}.
 *
 * <p>The transformation calls a {@link org.apache.flink.api.common.functions.RichGroupReduceFunction} for each group of the DataSet.
 * A GroupReduceFunction can iterate over all elements of a group and emit any
 *   number of output elements including none.
 *
 * @param reducer The GroupReduceFunction that is applied on each group of the DataSet.
 * @return A GroupReduceOperator that represents the reduced DataSet.
 *
 * @see org.apache.flink.api.common.functions.RichGroupReduceFunction
 * @see GroupReduceOperator
 * @see DataSet
 */
public <R> GroupReduceOperator<T, R> reduceGroup(GroupReduceFunction<T, R> reducer) {
  if (reducer == null) {
    throw new NullPointerException("GroupReduce function must not be null.");
  }
  TypeInformation<R> resultType = TypeExtractor.getGroupReduceReturnTypes(reducer,
      this.getInputDataSet().getType(), Utils.getCallLocationName(), true);
  return new GroupReduceOperator<T, R>(this, resultType, inputDataSet.clean(reducer), Utils.getCallLocationName());
}

相关文章