本文整理了Java中org.apache.spark.SparkContext.appName()
方法的一些代码示例,展示了SparkContext.appName()
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。SparkContext.appName()
方法的具体详情如下:
包路径:org.apache.spark.SparkContext
类名称:SparkContext
方法名:appName
暂无
代码示例来源:origin: apache/incubator-rya
conf.set(RdfCloudTripleStoreConfiguration.CONF_TBL_PREFIX, tablePrefix);
Job job = Job.getInstance(conf, sc.appName());
代码示例来源:origin: apache/incubator-rya
conf.set(RdfCloudTripleStoreConfiguration.CONF_TBL_PREFIX, tablePrefix);
Job job = Job.getInstance(conf, sc.appName());
代码示例来源:origin: uber/marmaray
private void assertExpectationsOnSparkContext(
@NonNull final SparkArgs sparkArgs,
@NonNull final SparkContext sc) {
final String registeredAvroSchemaStr = sc.conf().getAvroSchema().head()._2();
final Schema expectedAvroSchema = sparkArgs.getAvroSchemas().get().get(0);
Assert.assertEquals(expectedAvroSchema.toString(), registeredAvroSchemaStr);
Assert.assertEquals("foo_bar", sc.appName());
Assert.assertEquals("512", sc.hadoopConfiguration().get("mapreduce.map.memory.mb"));
}
内容来源于网络,如有侵权,请联系作者删除!