org.apache.flink.core.fs.Path.getParent()方法的使用及代码示例

x33g5p2x  于2022-01-26 转载在 其他  
字(9.7k)|赞(0)|评价(0)|浏览(88)

本文整理了Java中org.apache.flink.core.fs.Path.getParent()方法的一些代码示例，展示了Path.getParent()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。Path.getParent()方法的具体详情如下：
包路径：org.apache.flink.core.fs.Path
类名称：Path
方法名：getParent

Path.getParent介绍

[英]Returns the parent of a path, i.e., everything that precedes the last separator or null if at root.
[中]返回路径的父级，即最后一个分隔符前面的所有内容，如果是根，则返回null。

代码示例

代码示例来源：origin: apache/flink

/**
 * Adds a suffix to the final name in the path.
 *
 * @param suffix The suffix to be added
 * @return the new path including the suffix
 */
public Path suffix(String suffix) {
  return new Path(getParent(), getName() + suffix);
}

代码示例来源：origin: apache/flink

public static Path compressDirectory(Path directory, Path target) throws IOException {
  FileSystem sourceFs = directory.getFileSystem();
  FileSystem targetFs = target.getFileSystem();
  try (ZipOutputStream out = new ZipOutputStream(targetFs.create(target, FileSystem.WriteMode.NO_OVERWRITE))) {
    addToZip(directory, sourceFs, directory.getParent(), out);
  }
  return target;
}

代码示例来源：origin: apache/flink

@Override
public FSDataOutputStream create(final Path filePath, final WriteMode overwrite) throws IOException {
  checkNotNull(filePath, "filePath");
  if (exists(filePath) && overwrite == WriteMode.NO_OVERWRITE) {
    throw new FileAlreadyExistsException("File already exists: " + filePath);
  }
  final Path parent = filePath.getParent();
  if (parent != null && !mkdirs(parent)) {
    throw new IOException("Mkdirs failed to create " + parent);
  }
  final File file = pathToFile(filePath);
  return new LocalDataOutputStream(file);
}

代码示例来源：origin: apache/flink

@Test
public void testGetParent() {
  Path p = new Path("/my/fancy/path");
  assertEquals("/my/fancy", p.getParent().toUri().getPath());
  p = new Path("/my/other/fancy/path/");
  assertEquals("/my/other/fancy", p.getParent().toUri().getPath());
  p = new Path("hdfs:///my/path");
  assertEquals("/my", p.getParent().toUri().getPath());
  p = new Path("hdfs:///myPath/");
  assertEquals("/", p.getParent().toUri().getPath());
  p = new Path("/");
  assertNull(p.getParent());
  p = new Path("C:/my/windows/path");
  assertEquals("/C:/my/windows", p.getParent().toUri().getPath());
}

代码示例来源：origin: apache/flink

@Override
  public void go() throws Exception {
    fs.initOutPathLocalFS(path.getParent(), WriteMode.OVERWRITE, true);
    try (FSDataOutputStream out = fs.create(path, WriteMode.OVERWRITE)) {
      out.write(11);
    }
  }
}

代码示例来源：origin: apache/flink

@Test
public void testSerializationOnlyInProgress() throws IOException {
  final File testFolder = tempFolder.newFolder();
  final FileSystem fs = FileSystem.get(testFolder.toURI());
  final Path testBucket = new Path(testFolder.getPath(), "test");
  final RecoverableWriter writer = fs.createRecoverableWriter();
  final RecoverableFsDataOutputStream stream = writer.open(testBucket);
  stream.write(IN_PROGRESS_CONTENT.getBytes(Charset.forName("UTF-8")));
  final RecoverableWriter.ResumeRecoverable current = stream.persist();
  final BucketState<String> bucketState = new BucketState<>(
      "test", testBucket, Long.MAX_VALUE, current, new HashMap<>());
  final SimpleVersionedSerializer<BucketState<String>> serializer =
      new BucketStateSerializer<>(
          writer.getResumeRecoverableSerializer(),
          writer.getCommitRecoverableSerializer(),
          SimpleVersionedStringSerializer.INSTANCE
      );
  final byte[] bytes = SimpleVersionedSerialization.writeVersionAndSerialize(serializer, bucketState);
  // to simulate that everything is over for file.
  stream.close();
  final BucketState<String> recoveredState =  SimpleVersionedSerialization.readVersionAndDeSerialize(serializer, bytes);
  Assert.assertEquals(testBucket, recoveredState.getBucketPath());
  FileStatus[] statuses = fs.listStatus(testBucket.getParent());
  Assert.assertEquals(1L, statuses.length);
  Assert.assertTrue(
      statuses[0].getPath().getPath().startsWith(
          (new Path(testBucket.getParent(), ".test.inprogress")).toString())
  );
}

代码示例来源：origin: apache/flink

(new Path(testBucket.getParent(), ".test-2.inprogress").toString())));

代码示例来源：origin: com.alibaba.blink/flink-core

/**
 * Adds a suffix to the final name in the path.
 *
 * @param suffix The suffix to be added
 * @return the new path including the suffix
 */
public Path suffix(String suffix) {
  return new Path(getParent(), getName() + suffix);
}

代码示例来源：origin: org.apache.flink/flink-core

/**
 * Adds a suffix to the final name in the path.
 *
 * @param suffix The suffix to be added
 * @return the new path including the suffix
 */
public Path suffix(String suffix) {
  return new Path(getParent(), getName() + suffix);
}

代码示例来源：origin: com.alibaba.blink/flink-runtime

@VisibleForTesting
  static Path getTempMetaPath(Path path) {
    return new Path(path.getParent(), "_tmp_" + path.getName());
  }
}

代码示例来源：origin: org.apache.flink/flink-core

public static Path compressDirectory(Path directory, Path target) throws IOException {
  FileSystem sourceFs = directory.getFileSystem();
  FileSystem targetFs = target.getFileSystem();
  try (ZipOutputStream out = new ZipOutputStream(targetFs.create(target, FileSystem.WriteMode.NO_OVERWRITE))) {
    addToZip(directory, sourceFs, directory.getParent(), out);
  }
  return target;
}

代码示例来源：origin: org.apache.flink/flink-runtime_2.10

private void delete(String blobPath) {
  try {
    LOG.debug("Deleting {}.", blobPath);
    
    Path path = new Path(blobPath);
    fileSystem.delete(path, true);
    // send a call to delete the directory containing the file. This will
    // fail (and be ignored) when some files still exist.
    try {
      fileSystem.delete(path.getParent(), false);
      fileSystem.delete(new Path(basePath), false);
    } catch (IOException ignored) {}
  }
  catch (Exception e) {
    LOG.warn("Failed to delete blob at " + blobPath);
  }
}

代码示例来源：origin: com.alibaba.blink/flink-runtime

private boolean delete(String blobPath) {
  try {
    LOG.debug("Deleting {}.", blobPath);
    Path path = new Path(blobPath);
    boolean result = fileSystem.delete(path, true);
    // send a call to delete the directory containing the file. This will
    // fail (and be ignored) when some files still exist.
    try {
      fileSystem.delete(path.getParent(), false);
      fileSystem.delete(new Path(basePath), false);
    } catch (IOException ignored) {}
    return result;
  }
  catch (Exception e) {
    LOG.warn("Failed to delete blob at " + blobPath);
    return false;
  }
}

代码示例来源：origin: org.apache.flink/flink-runtime_2.11

private boolean delete(String blobPath) {
  try {
    LOG.debug("Deleting {}.", blobPath);
    Path path = new Path(blobPath);
    boolean result = fileSystem.delete(path, true);
    // send a call to delete the directory containing the file. This will
    // fail (and be ignored) when some files still exist.
    try {
      fileSystem.delete(path.getParent(), false);
      fileSystem.delete(new Path(basePath), false);
    } catch (IOException ignored) {}
    return result;
  }
  catch (Exception e) {
    LOG.warn("Failed to delete blob at " + blobPath);
    return false;
  }
}

代码示例来源：origin: org.apache.flink/flink-runtime

private boolean delete(String blobPath) {
  try {
    LOG.debug("Deleting {}.", blobPath);
    Path path = new Path(blobPath);
    boolean result = fileSystem.delete(path, true);
    // send a call to delete the directory containing the file. This will
    // fail (and be ignored) when some files still exist.
    try {
      fileSystem.delete(path.getParent(), false);
      fileSystem.delete(new Path(basePath), false);
    } catch (IOException ignored) {}
    return result;
  }
  catch (Exception e) {
    LOG.warn("Failed to delete blob at " + blobPath);
    return false;
  }
}

代码示例来源：origin: org.apache.flink/flink-runtime_2.10

/**
 * Stores the savepoint metadata file.
 *
 * @param <T>       Savepoint type
 * @param directory Target directory to store savepoint in
 * @param savepoint Savepoint to be stored
 * @return Path of stored savepoint
 * @throws IOException Failures during store are forwarded
 */
public static <T extends Savepoint> String storeSavepoint(String directory, T savepoint) throws IOException {
  // write and create the file handle
  FileStateHandle metadataFileHandle = storeSavepointToHandle(directory,
    SAVEPOINT_METADATA_FILE, savepoint);
  // we return the savepoint directory path here!
  // The directory path also works to resume from and is more elegant than the direct
  // metadata file pointer
  return metadataFileHandle.getFilePath().getParent().toString();
}

代码示例来源：origin: org.apache.flink/flink-runtime_2.10

/**
 * Discard the state by deleting the file that stores the state. If the parent directory
 * of the state is empty after deleting the state file, it is also deleted.
 * 
 * @throws Exception Thrown, if the file deletion (not the directory deletion) fails.
 */
@Override
public void discardState() throws Exception {
  getFileSystem().delete(filePath, false);
  try {
    FileUtils.deletePathIfEmpty(getFileSystem(), filePath.getParent());
  } catch (Exception ignored) {}
}

代码示例来源：origin: org.apache.flink/flink-core

@Override
public FSDataOutputStream create(final Path filePath, final WriteMode overwrite) throws IOException {
  checkNotNull(filePath, "filePath");
  if (exists(filePath) && overwrite == WriteMode.NO_OVERWRITE) {
    throw new FileAlreadyExistsException("File already exists: " + filePath);
  }
  final Path parent = filePath.getParent();
  if (parent != null && !mkdirs(parent)) {
    throw new IOException("Mkdirs failed to create " + parent);
  }
  final File file = pathToFile(filePath);
  return new LocalDataOutputStream(file);
}

代码示例来源：origin: com.alibaba.blink/flink-core

@Override
public FSDataOutputStream create(final Path filePath, final WriteMode overwrite) throws IOException {
  checkNotNull(filePath, "filePath");
  if (exists(filePath) && overwrite == WriteMode.NO_OVERWRITE) {
    throw new FileAlreadyExistsException("File already exists: " + filePath);
  }
  final Path parent = filePath.getParent();
  if (parent != null && !mkdirs(parent)) {
    throw new IOException("Mkdirs failed to create " + parent);
  }
  final File file = pathToFile(filePath);
  return new LocalDataOutputStream(file);
}

代码示例来源：origin: org.apache.flink/flink-runtime_2.10

/**
 * Discard the state by deleting the file that stores the state. If the parent directory
 * of the state is empty after deleting the state file, it is also deleted.
 *
 * @throws Exception Thrown, if the file deletion (not the directory deletion) fails.
 */
@Override
public void discardState() throws Exception {
  FileSystem fs = getFileSystem();
  fs.delete(filePath, false);
  if (fs.getKind() == FileSystemKind.FILE_SYSTEM) {
    try {
      FileUtils.deletePathIfEmpty(fs, filePath.getParent());
    } catch (Exception ignored) {}
  }
}

内容来源于网络，如有侵权，请联系作者删除！

Path

相关文章

    查看更多
    微信公众号

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com