本文整理了Java中org.apache.spark.api.java.JavaRDD.foreachAsync()
方法的一些代码示例,展示了JavaRDD.foreachAsync()
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。JavaRDD.foreachAsync()
方法的具体详情如下:
包路径:org.apache.spark.api.java.JavaRDD
类名称:JavaRDD
方法名:foreachAsync
暂无
代码示例来源:origin: org.apache.spark/spark-core_2.10
@Test
public void foreachAsync() throws Exception {
List<Integer> data = Arrays.asList(1, 2, 3, 4, 5);
JavaRDD<Integer> rdd = sc.parallelize(data, 1);
JavaFutureAction<Void> future = rdd.foreachAsync(integer -> {});
future.get();
assertFalse(future.isCancelled());
assertTrue(future.isDone());
assertEquals(1, future.jobIds().size());
}
代码示例来源:origin: org.apache.spark/spark-core
@Test
public void foreachAsync() throws Exception {
List<Integer> data = Arrays.asList(1, 2, 3, 4, 5);
JavaRDD<Integer> rdd = sc.parallelize(data, 1);
JavaFutureAction<Void> future = rdd.foreachAsync(integer -> {});
future.get();
assertFalse(future.isCancelled());
assertTrue(future.isDone());
assertEquals(1, future.jobIds().size());
}
代码示例来源:origin: org.apache.spark/spark-core_2.11
@Test
public void foreachAsync() throws Exception {
List<Integer> data = Arrays.asList(1, 2, 3, 4, 5);
JavaRDD<Integer> rdd = sc.parallelize(data, 1);
JavaFutureAction<Void> future = rdd.foreachAsync(integer -> {});
future.get();
assertFalse(future.isCancelled());
assertTrue(future.isDone());
assertEquals(1, future.jobIds().size());
}
代码示例来源:origin: org.apache.spark/spark-core_2.10
@Test
public void testAsyncActionCancellation() throws Exception {
List<Integer> data = Arrays.asList(1, 2, 3, 4, 5);
JavaRDD<Integer> rdd = sc.parallelize(data, 1);
JavaFutureAction<Void> future = rdd.foreachAsync(integer -> {
Thread.sleep(10000); // To ensure that the job won't finish before it's cancelled.
});
future.cancel(true);
assertTrue(future.isCancelled());
assertTrue(future.isDone());
try {
future.get(2000, TimeUnit.MILLISECONDS);
fail("Expected future.get() for cancelled job to throw CancellationException");
} catch (CancellationException ignored) {
// pass
}
}
代码示例来源:origin: org.apache.spark/spark-core
@Test
public void testAsyncActionCancellation() throws Exception {
List<Integer> data = Arrays.asList(1, 2, 3, 4, 5);
JavaRDD<Integer> rdd = sc.parallelize(data, 1);
JavaFutureAction<Void> future = rdd.foreachAsync(integer -> {
Thread.sleep(10000); // To ensure that the job won't finish before it's cancelled.
});
future.cancel(true);
assertTrue(future.isCancelled());
assertTrue(future.isDone());
try {
future.get(2000, TimeUnit.MILLISECONDS);
fail("Expected future.get() for cancelled job to throw CancellationException");
} catch (CancellationException ignored) {
// pass
}
}
代码示例来源:origin: org.apache.spark/spark-core_2.11
@Test
public void testAsyncActionCancellation() throws Exception {
List<Integer> data = Arrays.asList(1, 2, 3, 4, 5);
JavaRDD<Integer> rdd = sc.parallelize(data, 1);
JavaFutureAction<Void> future = rdd.foreachAsync(integer -> {
Thread.sleep(10000); // To ensure that the job won't finish before it's cancelled.
});
future.cancel(true);
assertTrue(future.isCancelled());
assertTrue(future.isDone());
try {
future.get(2000, TimeUnit.MILLISECONDS);
fail("Expected future.get() for cancelled job to throw CancellationException");
} catch (CancellationException ignored) {
// pass
}
}
内容来源于网络,如有侵权,请联系作者删除!