org.apache.spark.SparkContext.appName()方法的使用及代码示例

x33g5p2x  于2022-01-30 转载在 其他  
字(1.1k)|赞(0)|评价(0)|浏览(152)

本文整理了Java中org.apache.spark.SparkContext.appName()方法的一些代码示例,展示了SparkContext.appName()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。SparkContext.appName()方法的具体详情如下:
包路径:org.apache.spark.SparkContext
类名称:SparkContext
方法名:appName

SparkContext.appName介绍

暂无

代码示例

代码示例来源:origin: apache/incubator-rya

conf.set(RdfCloudTripleStoreConfiguration.CONF_TBL_PREFIX, tablePrefix);
Job job = Job.getInstance(conf, sc.appName());

代码示例来源:origin: apache/incubator-rya

conf.set(RdfCloudTripleStoreConfiguration.CONF_TBL_PREFIX, tablePrefix);
Job job = Job.getInstance(conf, sc.appName());

代码示例来源:origin: uber/marmaray

private void assertExpectationsOnSparkContext(
  @NonNull final SparkArgs sparkArgs,
  @NonNull final SparkContext sc) {
  final String registeredAvroSchemaStr = sc.conf().getAvroSchema().head()._2();
  final Schema expectedAvroSchema = sparkArgs.getAvroSchemas().get().get(0);
  Assert.assertEquals(expectedAvroSchema.toString(), registeredAvroSchemaStr);
  Assert.assertEquals("foo_bar", sc.appName());
  Assert.assertEquals("512", sc.hadoopConfiguration().get("mapreduce.map.memory.mb"));
}

相关文章