org.apache.spark.api.java.JavaRDD.toLocalIterator()方法的使用及代码示例

x33g5p2x  于2022-01-21 转载在 其他  
字(3.1k)|赞(0)|评价(0)|浏览(126)

本文整理了Java中org.apache.spark.api.java.JavaRDD.toLocalIterator()方法的一些代码示例,展示了JavaRDD.toLocalIterator()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。JavaRDD.toLocalIterator()方法的具体详情如下:
包路径:org.apache.spark.api.java.JavaRDD
类名称:JavaRDD
方法名:toLocalIterator

JavaRDD.toLocalIterator介绍

暂无

代码示例

代码示例来源:origin: org.apache.spark/spark-core_2.11

@Test
public void toLocalIterator() {
 List<Integer> correct = Arrays.asList(1, 2, 3, 4);
 JavaRDD<Integer> rdd = sc.parallelize(correct);
 List<Integer> result = Lists.newArrayList(rdd.toLocalIterator());
 assertEquals(correct, result);
}

代码示例来源:origin: org.apache.spark/spark-core

@Test
public void toLocalIterator() {
 List<Integer> correct = Arrays.asList(1, 2, 3, 4);
 JavaRDD<Integer> rdd = sc.parallelize(correct);
 List<Integer> result = Lists.newArrayList(rdd.toLocalIterator());
 assertEquals(correct, result);
}

代码示例来源:origin: org.apache.spark/spark-core_2.10

@Test
public void toLocalIterator() {
 List<Integer> correct = Arrays.asList(1, 2, 3, 4);
 JavaRDD<Integer> rdd = sc.parallelize(correct);
 List<Integer> result = Lists.newArrayList(rdd.toLocalIterator());
 assertEquals(correct, result);
}

代码示例来源:origin: com.davidbracewell/mango

@Override
public Iterator<T> iterator() {
 return rdd.toLocalIterator();
}

代码示例来源:origin: edu.usc.ir/age-predictor-cli

public void reset() {
iterator = samples.toLocalIterator();
}

代码示例来源:origin: edu.usc.ir/age-predictor-cli

public static ObjectStream<Event> createEventStream(final JavaRDD<EventWrapper> samples) {
  
  return new ObjectStream<Event>() {    
    private Iterator<EventWrapper> iterator = samples.toLocalIterator();
    
    public Event read() {
    if (iterator.hasNext()) {
      return iterator.next().getEvent();
    }
    else {
      return null;
    }
    }
      
    public void reset() {
    iterator = samples.toLocalIterator();
    }
      
    public void close() {
    }
      
  };    
  }
}

代码示例来源:origin: com.davidbracewell/mango

@Override
public void forEachLocal(SerializableConsumer<? super T> consumer) {
 rdd.toLocalIterator().forEachRemaining(consumer);
}

代码示例来源:origin: nerdammer/spash

@Override
public void mkString(PrintWriter writer) {
  Iterator<T> it = target.toLocalIterator();
  while(it.hasNext()) {
    T el = it.next();
    writer.println(el != null ? el.toString() : "");
  }
}

代码示例来源:origin: com.davidbracewell/mango

@Override
public <R> R collect(@NonNull Collector<? super T, T, R> collector) {
 return Streams.asStream(rdd.toLocalIterator()).collect(collector);
}

代码示例来源:origin: org.qcri.rheem/rheem-spark

@Override
public Tuple<Collection<ExecutionLineageNode>, Collection<ChannelInstance>> evaluate(
    ChannelInstance[] inputs,
    ChannelInstance[] outputs,
    SparkExecutor sparkExecutor,
    OptimizationContext.OperatorContext operatorContext) {
  assert inputs.length == this.getNumInputs();
  assert outputs.length == this.getNumOutputs();
  final RddChannel.Instance input = (RddChannel.Instance) inputs[0];
  final JavaRDD<T> inputRdd = input.provideRdd();
  inputRdd.toLocalIterator().forEachRemaining(this.callback);
  return ExecutionOperator.modelEagerExecution(inputs, outputs, operatorContext);
}

代码示例来源:origin: edu.usc.ir/age-predictor-cli

Iterator<Tuple2<Double, Double>> iterator = valuesAndPreds.toLocalIterator();
report.createNewFile();
FileWriter writer = new FileWriter(report);

相关文章

微信公众号

最新文章

更多