本文整理了Java中org.apache.hadoop.hive.ql.exec.Utilities.parseSplitBucket()
方法的一些代码示例,展示了Utilities.parseSplitBucket()
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Utilities.parseSplitBucket()
方法的具体详情如下:
包路径:org.apache.hadoop.hive.ql.exec.Utilities
类名称:Utilities
方法名:parseSplitBucket
暂无
代码示例来源:origin: apache/hive
private InputSplit[] pruneBuckets(MapWork work, InputSplit[] splits) {
final BitSet buckets = work.getIncludedBuckets();
final String bucketIn = buckets.toString();
List<InputSplit> filteredSplits = new ArrayList<InputSplit>(splits.length / 2);
for (InputSplit split : splits) {
final int bucket = Utilities.parseSplitBucket(split);
if (bucket < 0 || buckets.get(bucket)) {
// match or UNKNOWN
filteredSplits.add(split);
} else {
LOG.info("Pruning with IN ({}) - removing {}", bucketIn, split);
}
}
if (filteredSplits.size() < splits.length) {
// reallocate only if any filters pruned
splits = filteredSplits.toArray(new InputSplit[filteredSplits.size()]);
}
return splits;
}
代码示例来源:origin: apache/drill
private InputSplit[] pruneBuckets(MapWork work, InputSplit[] splits) {
final BitSet buckets = work.getIncludedBuckets();
final String bucketIn = buckets.toString();
List<InputSplit> filteredSplits = new ArrayList<InputSplit>(splits.length / 2);
for (InputSplit split : splits) {
final int bucket = Utilities.parseSplitBucket(split);
if (bucket < 0 || buckets.get(bucket)) {
// match or UNKNOWN
filteredSplits.add(split);
} else {
LOG.info("Pruning with IN ({}) - removing {}", bucketIn, split);
}
}
if (filteredSplits.size() < splits.length) {
// reallocate only if any filters pruned
splits = filteredSplits.toArray(new InputSplit[filteredSplits.size()]);
}
return splits;
}
内容来源于网络,如有侵权,请联系作者删除!