本文整理了Java中org.apache.spark.api.java.JavaPairRDD.saveAsTextFile()
方法的一些代码示例,展示了JavaPairRDD.saveAsTextFile()
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。JavaPairRDD.saveAsTextFile()
方法的具体详情如下:
包路径:org.apache.spark.api.java.JavaPairRDD
类名称:JavaPairRDD
方法名:saveAsTextFile
暂无
代码示例来源:origin: databricks/learning-spark
public static void main(String[] args) throws Exception {
String master = args[0];
JavaSparkContext sc = new JavaSparkContext(
master, "wordcount", System.getenv("SPARK_HOME"), System.getenv("JARS"));
JavaRDD<String> rdd = sc.textFile(args[1]);
JavaPairRDD<String, Integer> counts = rdd.flatMap(
new FlatMapFunction<String, String>() {
public Iterable<String> call(String x) {
return Arrays.asList(x.split(" "));
}}).mapToPair(new PairFunction<String, String, Integer>(){
public Tuple2<String, Integer> call(String x){
return new Tuple2(x, 1);
}}).reduceByKey(new Function2<Integer, Integer, Integer>(){
public Integer call(Integer x, Integer y){ return x+y;}});
counts.saveAsTextFile(args[2]);
}
}
代码示例来源:origin: databricks/learning-spark
contactCounts.saveAsTextFile(outputDir + "/contactCount");
} else {
System.out.println("Too many errors " + invalidSignCount.value() +
return new Tuple2(country, callSignCount._2());
}}).reduceByKey(new SumInts());
countryContactCounts.saveAsTextFile(outputDir + "/countries.txt");
System.out.println("Saved country contact counts as a file");
代码示例来源:origin: mahmoudparsian/data-algorithms-book
cart.saveAsTextFile("/output/z");
代码示例来源:origin: mahmoudparsian/data-algorithms-book
return new Tuple2<String,Tuple2<Long,Integer>>(K, V);
});
monoid.saveAsTextFile("/output/3");
reduced.saveAsTextFile("/output/4");
);
mean.saveAsTextFile("/output/5");
System.exit(0);
代码示例来源:origin: mahmoudparsian/data-algorithms-book
return new Tuple2<String,Integer>(tokens[0], Integer.parseInt(tokens[1]));
});
kv.saveAsTextFile("/output/2");
uniqueKeys.saveAsTextFile("/output/3");
代码示例来源:origin: mahmoudparsian/data-algorithms-book
return new Tuple2<String,Integer>(tokens[0], Integer.parseInt(tokens[1]));
});
kv.saveAsTextFile("/output/2");
uniqueKeys.saveAsTextFile("/output/3");
代码示例来源:origin: mahmoudparsian/data-algorithms-book
monoid.saveAsTextFile("/output/3");
reduced.saveAsTextFile("/output/4");
mean.saveAsTextFile("/output/5");
System.exit(0);
代码示例来源:origin: mahmoudparsian/data-algorithms-book
counts.saveAsTextFile(outputPath);
代码示例来源:origin: mahmoudparsian/data-algorithms-book
kv.saveAsTextFile("/output/2");
uniqueKeys.saveAsTextFile("/output/3");
代码示例来源:origin: mahmoudparsian/data-algorithms-book
filteredAnagrams.saveAsTextFile(outputPath);
代码示例来源:origin: mahmoudparsian/data-algorithms-book
counts.saveAsTextFile(outputPath);
代码示例来源:origin: mahmoudparsian/data-algorithms-book
sorted.saveAsTextFile(outputPath);
代码示例来源:origin: mahmoudparsian/data-algorithms-book
sortedByFreq.saveAsTextFile(outputPath);
代码示例来源:origin: mahmoudparsian/data-algorithms-book
counts.sortByKey().saveAsTextFile(outputPath);
代码示例来源:origin: mahmoudparsian/data-algorithms-book
result.saveAsTextFile(outputPath);
代码示例来源:origin: mahmoudparsian/data-algorithms-book
counts.sortByKey().saveAsTextFile(outputPath);
代码示例来源:origin: mahmoudparsian/data-algorithms-book
rankedProducts.coalesce(1,true).saveAsTextFile(outputPath);
代码示例来源:origin: mahmoudparsian/data-algorithms-book
rankedProducts.coalesce(1,true).saveAsTextFile(outputPath);
代码示例来源:origin: mahmoudparsian/data-algorithms-book
rankedProducts.coalesce(1,true).saveAsTextFile(outputPath);
代码示例来源:origin: mahmoudparsian/data-algorithms-book
rankedProducts.coalesce(1,true).saveAsTextFile(outputPath);
内容来源于网络,如有侵权,请联系作者删除!