org.apache.hadoop.hive.ql.exec.Utilities.isInputFileFormatVectorized()方法的使用及代码示例

x33g5p2x  于2022-02-01 转载在 其他  
字(1.8k)|赞(0)|评价(0)|浏览(79)

本文整理了Java中org.apache.hadoop.hive.ql.exec.Utilities.isInputFileFormatVectorized()方法的一些代码示例,展示了Utilities.isInputFileFormatVectorized()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Utilities.isInputFileFormatVectorized()方法的具体详情如下:
包路径:org.apache.hadoop.hive.ql.exec.Utilities
类名称:Utilities
方法名:isInputFileFormatVectorized

Utilities.isInputFileFormatVectorized介绍

暂无

代码示例

代码示例来源:origin: apache/drill

private boolean checkInputsVectorized(MapWork mapWork) {
 boolean mayWrap = HiveConf.getBoolVar(conf, ConfVars.LLAP_IO_NONVECTOR_WRAPPER_ENABLED);
 for (PartitionDesc pd : mapWork.getPathToPartitionInfo().values()) {
  if (Utilities.isInputFileFormatVectorized(pd) || (mayWrap
    && HiveInputFormat.canWrapForLlap(pd.getInputFileFormatClass(), true))) {
   continue;
  }
  LOG.info("Input format: " + pd.getInputFileFormatClassName()
   + ", doesn't provide vectorized input");
  return false;
 }
 return true;
}

代码示例来源:origin: apache/hive

private boolean checkInputsVectorized(MapWork mapWork) {
 boolean mayWrap = HiveConf.getBoolVar(conf, ConfVars.LLAP_IO_NONVECTOR_WRAPPER_ENABLED);
 Collection<Class<?>> excludedInputFormats = Utilities.getClassNamesFromConfig(conf, ConfVars.HIVE_VECTORIZATION_VECTORIZED_INPUT_FILE_FORMAT_EXCLUDES);
 for (PartitionDesc pd : mapWork.getPathToPartitionInfo().values()) {
  if ((Utilities.isInputFileFormatVectorized(pd) && !excludedInputFormats
    .contains(pd.getInputFileFormatClass())) || (mayWrap && HiveInputFormat
    .canWrapForLlap(pd.getInputFileFormatClass(), true))) {
   continue;
  }
  LOG.info("Input format: " + pd.getInputFileFormatClassName()
   + ", doesn't provide vectorized input");
  return false;
 }
 return true;
}

代码示例来源:origin: apache/hive

boolean isInputFileFormatVectorized = Utilities.isInputFileFormatVectorized(pd);

代码示例来源:origin: apache/drill

boolean isInputFileFormatVectorized = Utilities.isInputFileFormatVectorized(pd);

相关文章

微信公众号

最新文章

更多

Utilities类方法