org.apache.hadoop.hive.ql.metadata.Hive.replaceFiles()方法的使用及代码示例

x33g5p2x  于2022-01-20 转载在 其他  
字(2.6k)|赞(0)|评价(0)|浏览(173)

本文整理了Java中org.apache.hadoop.hive.ql.metadata.Hive.replaceFiles()方法的一些代码示例,展示了Hive.replaceFiles()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Hive.replaceFiles()方法的具体详情如下:
包路径:org.apache.hadoop.hive.ql.metadata.Hive
类名称:Hive
方法名:replaceFiles

Hive.replaceFiles介绍

[英]Replaces files in the partition with new data set specified by srcf. Works by renaming directory of srcf to the destination file. srcf, destf, and tmppath should resident in the same DFS, but the oldPath can be in a different DFS.
[中]用srcf指定的新数据集替换分区中的文件。通过将srcf的目录重命名为目标文件来工作。srcf、destf和tmppath应驻留在同一个DFS中,但旧路径可以位于不同的DFS中。

代码示例

代码示例来源:origin: apache/drill

if (replace || (oldPart == null && !isAcid)) {
 boolean isAutoPurge = "true".equalsIgnoreCase(tbl.getProperty("auto.purge"));
 replaceFiles(tbl.getPath(), loadPath, newPartPath, oldPartPath, getConf(),
   isSrcLocal, isAutoPurge);
} else {

代码示例来源:origin: apache/drill

Path tableDest = tbl.getPath();
 boolean isAutopurge = "true".equalsIgnoreCase(tbl.getProperty("auto.purge"));
 replaceFiles(tableDest, loadPath, tableDest, tableDest, sessionConf, isSrcLocal, isAutopurge);
} else {
 FileSystem fs;

代码示例来源:origin: apache/hive

boolean needRecycle = !tbl.isTemporary()
     && ReplChangeManager.isSourceOfReplication(Hive.get().getDatabase(tbl.getDbName()));
 replaceFiles(tbl.getPath(), loadPath, destPath, oldPartPath, getConf(), isSrcLocal,
   isAutoPurge, newFiles, FileUtils.HIDDEN_FILES_PATH_FILTER, needRecycle, isManaged);
} else {

代码示例来源:origin: apache/hive

boolean needRecycle = !tbl.isTemporary()
     && ReplChangeManager.isSourceOfReplication(Hive.get().getDatabase(tbl.getDbName()));
 replaceFiles(tblPath, loadPath, destPath, tblPath, conf, isSrcLocal, isAutopurge,
   newFiles, FileUtils.HIDDEN_FILES_PATH_FILTER, needRecycle, isManaged);
} else {

代码示例来源:origin: org.apache.hadoop.hive/hive-exec

/**
 * Replaces the directory corresponding to the table by srcf. Works by
 * deleting the table directory and renaming the source directory.
 *
 * @param srcf
 *          Source directory
 * @param tmpd
 *          Temporary directory
 */
protected void replaceFiles(Path srcf) throws HiveException {
 Path tableDest =  new Path(getDataLocation().getPath());
 Hive.replaceFiles(srcf, tableDest, tableDest, Hive.get().getConf());
}

代码示例来源:origin: org.apache.hadoop.hive/hive-exec

Hive.replaceFiles(loadPath, newPartPath, oldPartPath, getConf());
} else {
 FileSystem fs = FileSystem.get(tbl.getDataLocation(), getConf());

代码示例来源:origin: com.facebook.presto.hive/hive-apache

Hive.replaceFiles(tbl.getPath(), loadPath, newPartPath, oldPartPath, getConf(),
   isSrcLocal);
} else {

代码示例来源:origin: com.facebook.presto.hive/hive-apache

if (replace) {
 Path tableDest = tbl.getPath();
 replaceFiles(tableDest, loadPath, tableDest, tableDest, sessionConf, isSrcLocal);
} else {
 FileSystem fs;

相关文章

微信公众号

最新文章

更多

Hive类方法