本文整理了Java中org.apache.spark.api.java.JavaRDD.toLocalIterator()
方法的一些代码示例,展示了JavaRDD.toLocalIterator()
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。JavaRDD.toLocalIterator()
方法的具体详情如下:
包路径:org.apache.spark.api.java.JavaRDD
类名称:JavaRDD
方法名:toLocalIterator
暂无
代码示例来源:origin: org.apache.spark/spark-core_2.11
@Test
public void toLocalIterator() {
List<Integer> correct = Arrays.asList(1, 2, 3, 4);
JavaRDD<Integer> rdd = sc.parallelize(correct);
List<Integer> result = Lists.newArrayList(rdd.toLocalIterator());
assertEquals(correct, result);
}
代码示例来源:origin: org.apache.spark/spark-core
@Test
public void toLocalIterator() {
List<Integer> correct = Arrays.asList(1, 2, 3, 4);
JavaRDD<Integer> rdd = sc.parallelize(correct);
List<Integer> result = Lists.newArrayList(rdd.toLocalIterator());
assertEquals(correct, result);
}
代码示例来源:origin: org.apache.spark/spark-core_2.10
@Test
public void toLocalIterator() {
List<Integer> correct = Arrays.asList(1, 2, 3, 4);
JavaRDD<Integer> rdd = sc.parallelize(correct);
List<Integer> result = Lists.newArrayList(rdd.toLocalIterator());
assertEquals(correct, result);
}
代码示例来源:origin: com.davidbracewell/mango
@Override
public Iterator<T> iterator() {
return rdd.toLocalIterator();
}
代码示例来源:origin: edu.usc.ir/age-predictor-cli
public void reset() {
iterator = samples.toLocalIterator();
}
代码示例来源:origin: edu.usc.ir/age-predictor-cli
public static ObjectStream<Event> createEventStream(final JavaRDD<EventWrapper> samples) {
return new ObjectStream<Event>() {
private Iterator<EventWrapper> iterator = samples.toLocalIterator();
public Event read() {
if (iterator.hasNext()) {
return iterator.next().getEvent();
}
else {
return null;
}
}
public void reset() {
iterator = samples.toLocalIterator();
}
public void close() {
}
};
}
}
代码示例来源:origin: com.davidbracewell/mango
@Override
public void forEachLocal(SerializableConsumer<? super T> consumer) {
rdd.toLocalIterator().forEachRemaining(consumer);
}
代码示例来源:origin: nerdammer/spash
@Override
public void mkString(PrintWriter writer) {
Iterator<T> it = target.toLocalIterator();
while(it.hasNext()) {
T el = it.next();
writer.println(el != null ? el.toString() : "");
}
}
代码示例来源:origin: com.davidbracewell/mango
@Override
public <R> R collect(@NonNull Collector<? super T, T, R> collector) {
return Streams.asStream(rdd.toLocalIterator()).collect(collector);
}
代码示例来源:origin: org.qcri.rheem/rheem-spark
@Override
public Tuple<Collection<ExecutionLineageNode>, Collection<ChannelInstance>> evaluate(
ChannelInstance[] inputs,
ChannelInstance[] outputs,
SparkExecutor sparkExecutor,
OptimizationContext.OperatorContext operatorContext) {
assert inputs.length == this.getNumInputs();
assert outputs.length == this.getNumOutputs();
final RddChannel.Instance input = (RddChannel.Instance) inputs[0];
final JavaRDD<T> inputRdd = input.provideRdd();
inputRdd.toLocalIterator().forEachRemaining(this.callback);
return ExecutionOperator.modelEagerExecution(inputs, outputs, operatorContext);
}
代码示例来源:origin: edu.usc.ir/age-predictor-cli
Iterator<Tuple2<Double, Double>> iterator = valuesAndPreds.toLocalIterator();
report.createNewFile();
FileWriter writer = new FileWriter(report);
内容来源于网络,如有侵权,请联系作者删除!