org.apache.spark.api.java.JavaPairRDD.saveAsTextFile()方法的使用及代码示例

x33g5p2x  于2022-01-21 转载在 其他  
字(3.7k)|赞(0)|评价(0)|浏览(80)

本文整理了Java中org.apache.spark.api.java.JavaPairRDD.saveAsTextFile()方法的一些代码示例,展示了JavaPairRDD.saveAsTextFile()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。JavaPairRDD.saveAsTextFile()方法的具体详情如下:
包路径:org.apache.spark.api.java.JavaPairRDD
类名称:JavaPairRDD
方法名:saveAsTextFile

JavaPairRDD.saveAsTextFile介绍

暂无

代码示例

代码示例来源:origin: databricks/learning-spark

public static void main(String[] args) throws Exception {
    String master = args[0];
    JavaSparkContext sc = new JavaSparkContext(
   master, "wordcount", System.getenv("SPARK_HOME"), System.getenv("JARS"));
  JavaRDD<String> rdd = sc.textFile(args[1]);
  JavaPairRDD<String, Integer> counts = rdd.flatMap(
   new FlatMapFunction<String, String>() {
    public Iterable<String> call(String x) {
     return Arrays.asList(x.split(" "));
    }}).mapToPair(new PairFunction<String, String, Integer>(){
      public Tuple2<String, Integer> call(String x){
       return new Tuple2(x, 1);
      }}).reduceByKey(new Function2<Integer, Integer, Integer>(){
        public Integer call(Integer x, Integer y){ return x+y;}});
  counts.saveAsTextFile(args[2]);
  }
}

代码示例来源:origin: databricks/learning-spark

contactCounts.saveAsTextFile(outputDir + "/contactCount");
} else {
 System.out.println("Too many errors " + invalidSignCount.value() +
   return new Tuple2(country, callSignCount._2());
  }}).reduceByKey(new SumInts());
countryContactCounts.saveAsTextFile(outputDir + "/countries.txt");
System.out.println("Saved country contact counts as a file");

代码示例来源:origin: mahmoudparsian/data-algorithms-book

cart.saveAsTextFile("/output/z");

代码示例来源:origin: mahmoudparsian/data-algorithms-book

return new Tuple2<String,Tuple2<Long,Integer>>(K, V);
});
monoid.saveAsTextFile("/output/3");
reduced.saveAsTextFile("/output/4");
);
mean.saveAsTextFile("/output/5");
System.exit(0);

代码示例来源:origin: mahmoudparsian/data-algorithms-book

return new Tuple2<String,Integer>(tokens[0], Integer.parseInt(tokens[1]));
});
kv.saveAsTextFile("/output/2");
uniqueKeys.saveAsTextFile("/output/3");

代码示例来源:origin: mahmoudparsian/data-algorithms-book

return new Tuple2<String,Integer>(tokens[0], Integer.parseInt(tokens[1]));
});
kv.saveAsTextFile("/output/2");
uniqueKeys.saveAsTextFile("/output/3");

代码示例来源:origin: mahmoudparsian/data-algorithms-book

monoid.saveAsTextFile("/output/3");
reduced.saveAsTextFile("/output/4");
mean.saveAsTextFile("/output/5");
System.exit(0);

代码示例来源:origin: mahmoudparsian/data-algorithms-book

counts.saveAsTextFile(outputPath);

代码示例来源:origin: mahmoudparsian/data-algorithms-book

kv.saveAsTextFile("/output/2");
uniqueKeys.saveAsTextFile("/output/3");

代码示例来源:origin: mahmoudparsian/data-algorithms-book

filteredAnagrams.saveAsTextFile(outputPath);

代码示例来源:origin: mahmoudparsian/data-algorithms-book

counts.saveAsTextFile(outputPath);

代码示例来源:origin: mahmoudparsian/data-algorithms-book

sorted.saveAsTextFile(outputPath);

代码示例来源:origin: mahmoudparsian/data-algorithms-book

sortedByFreq.saveAsTextFile(outputPath);

代码示例来源:origin: mahmoudparsian/data-algorithms-book

counts.sortByKey().saveAsTextFile(outputPath);

代码示例来源:origin: mahmoudparsian/data-algorithms-book

result.saveAsTextFile(outputPath);

代码示例来源:origin: mahmoudparsian/data-algorithms-book

counts.sortByKey().saveAsTextFile(outputPath);

代码示例来源:origin: mahmoudparsian/data-algorithms-book

rankedProducts.coalesce(1,true).saveAsTextFile(outputPath);

代码示例来源:origin: mahmoudparsian/data-algorithms-book

rankedProducts.coalesce(1,true).saveAsTextFile(outputPath);

代码示例来源:origin: mahmoudparsian/data-algorithms-book

rankedProducts.coalesce(1,true).saveAsTextFile(outputPath);

代码示例来源:origin: mahmoudparsian/data-algorithms-book

rankedProducts.coalesce(1,true).saveAsTextFile(outputPath);

相关文章

微信公众号

最新文章

更多

JavaPairRDD类方法