org.apache.hadoop.hive.ql.exec.Utilities.clearWorkMapForConf()方法的使用及代码示例

x33g5p2x  于2022-02-01 转载在 其他  
字(3.2k)|赞(0)|评价(0)|浏览(84)

本文整理了Java中org.apache.hadoop.hive.ql.exec.Utilities.clearWorkMapForConf()方法的一些代码示例,展示了Utilities.clearWorkMapForConf()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Utilities.clearWorkMapForConf()方法的具体详情如下:
包路径:org.apache.hadoop.hive.ql.exec.Utilities
类名称:Utilities
方法名:clearWorkMapForConf

Utilities.clearWorkMapForConf介绍

暂无

代码示例

代码示例来源:origin: apache/hive

public static void clearWork(Configuration conf) {
 Path mapPath = getPlanPath(conf, MAP_PLAN_NAME);
 Path reducePath = getPlanPath(conf, REDUCE_PLAN_NAME);
 // if the plan path hasn't been initialized just return, nothing to clean.
 if (mapPath == null && reducePath == null) {
  return;
 }
 try {
  FileSystem fs = mapPath.getFileSystem(conf);
  if (fs.exists(mapPath)) {
   fs.delete(mapPath, true);
  }
  if (fs.exists(reducePath)) {
   fs.delete(reducePath, true);
  }
 } catch (Exception e) {
  LOG.warn("Failed to clean-up tmp directories.", e);
 } finally {
  // where a single process works with multiple plans - we must clear
  // the cache before working with the next plan.
  clearWorkMapForConf(conf);
 }
}

代码示例来源:origin: apache/drill

public static void clearWork(Configuration conf) {
 Path mapPath = getPlanPath(conf, MAP_PLAN_NAME);
 Path reducePath = getPlanPath(conf, REDUCE_PLAN_NAME);
 // if the plan path hasn't been initialized just return, nothing to clean.
 if (mapPath == null && reducePath == null) {
  return;
 }
 try {
  FileSystem fs = mapPath.getFileSystem(conf);
  if (fs.exists(mapPath)) {
   fs.delete(mapPath, true);
  }
  if (fs.exists(reducePath)) {
   fs.delete(reducePath, true);
  }
 } catch (Exception e) {
  LOG.warn("Failed to clean-up tmp directories.", e);
 } finally {
  // where a single process works with multiple plans - we must clear
  // the cache before working with the next plan.
  clearWorkMapForConf(conf);
 }
}

代码示例来源:origin: apache/drill

Utilities.clearWorkMapForConf(job);

代码示例来源:origin: apache/hive

Utilities.clearWorkMapForConf(job);

代码示例来源:origin: apache/hive

Utilities.clearWorkMapForConf(job);
if (LOG.isInfoEnabled()) {
 LOG.info("number of splits " + result.size());

代码示例来源:origin: apache/drill

Utilities.clearWorkMapForConf(job);
if (LOG.isInfoEnabled()) {
 LOG.info("number of splits " + result.size());

代码示例来源:origin: apache/hive

JobConf workCfg = workToConf.get(w);
if (workCfg != null) {
 Utilities.clearWorkMapForConf(workCfg);

代码示例来源:origin: apache/drill

JobConf workCfg = workToConf.get(w);
if (workCfg != null) {
 Utilities.clearWorkMapForConf(workCfg);

代码示例来源:origin: com.facebook.presto.hive/hive-apache

public static void clearWork(Configuration conf) {
 Path mapPath = getPlanPath(conf, MAP_PLAN_NAME);
 Path reducePath = getPlanPath(conf, REDUCE_PLAN_NAME);
 // if the plan path hasn't been initialized just return, nothing to clean.
 if (mapPath == null && reducePath == null) {
  return;
 }
 try {
  FileSystem fs = mapPath.getFileSystem(conf);
  if (fs.exists(mapPath)) {
   fs.delete(mapPath, true);
  }
  if (fs.exists(reducePath)) {
   fs.delete(reducePath, true);
  }
 } catch (Exception e) {
  LOG.warn("Failed to clean-up tmp directories.", e);
 } finally {
  // where a single process works with multiple plans - we must clear
  // the cache before working with the next plan.
  clearWorkMapForConf(conf);
 }
}

代码示例来源:origin: com.facebook.presto.hive/hive-apache

Utilities.clearWorkMapForConf(job);

代码示例来源:origin: com.facebook.presto.hive/hive-apache

Utilities.clearWorkMapForConf(job);
LOG.info("number of splits " + result.size());
perfLogger.PerfLogEnd(CLASS_NAME, PerfLogger.GET_SPLITS);

相关文章

微信公众号

最新文章

更多

Utilities类方法