org.apache.gobblin.util.AvroUtils.getAllNestedAvroFiles()方法的使用及代码示例

x33g5p2x  于2022-01-16 转载在 其他  
字(1.9k)|赞(0)|评价(0)|浏览(77)

本文整理了Java中org.apache.gobblin.util.AvroUtils.getAllNestedAvroFiles()方法的一些代码示例,展示了AvroUtils.getAllNestedAvroFiles()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。AvroUtils.getAllNestedAvroFiles()方法的具体详情如下:
包路径:org.apache.gobblin.util.AvroUtils
类名称:AvroUtils
方法名:getAllNestedAvroFiles

AvroUtils.getAllNestedAvroFiles介绍

暂无

代码示例

代码示例来源:origin: apache/incubator-gobblin

private static List<FileStatus> getDirectorySchemaHelper(Path directory, FileSystem fs) throws IOException {
 List<FileStatus> files = Lists.newArrayList();
 if (fs.exists(directory)) {
  getAllNestedAvroFiles(fs.getFileStatus(directory), files, fs);
  if (files.size() > 0) {
   Collections.sort(files, FileListUtils.LATEST_MOD_TIME_ORDER);
  }
 }
 return files;
}

代码示例来源:origin: apache/incubator-gobblin

private static void getAllNestedAvroFiles(FileStatus dir, List<FileStatus> files, FileSystem fs) throws IOException {
 if (dir.isDirectory()) {
  FileStatus[] filesInDir = fs.listStatus(dir.getPath());
  if (filesInDir != null) {
   for (FileStatus f : filesInDir) {
    getAllNestedAvroFiles(f, files, fs);
   }
  }
 } else if (dir.getPath().getName().endsWith(AVRO_SUFFIX)) {
  files.add(dir);
 }
}

代码示例来源:origin: org.apache.gobblin/gobblin-utility

private static List<FileStatus> getDirectorySchemaHelper(Path directory, FileSystem fs) throws IOException {
 List<FileStatus> files = Lists.newArrayList();
 if (fs.exists(directory)) {
  getAllNestedAvroFiles(fs.getFileStatus(directory), files, fs);
  if (files.size() > 0) {
   Collections.sort(files, FileListUtils.LATEST_MOD_TIME_ORDER);
  }
 }
 return files;
}

代码示例来源:origin: org.apache.gobblin/gobblin-utility

private static void getAllNestedAvroFiles(FileStatus dir, List<FileStatus> files, FileSystem fs) throws IOException {
 if (dir.isDirectory()) {
  FileStatus[] filesInDir = fs.listStatus(dir.getPath());
  if (filesInDir != null) {
   for (FileStatus f : filesInDir) {
    getAllNestedAvroFiles(f, files, fs);
   }
  }
 } else if (dir.getPath().getName().endsWith(AVRO_SUFFIX)) {
  files.add(dir);
 }
}

相关文章