com.netflix.metacat.common.QualifiedName.ofPartition()方法的使用及代码示例

x33g5p2x  于2022-01-28 转载在 其他  
字(11.7k)|赞(0)|评价(0)|浏览(101)

本文整理了Java中com.netflix.metacat.common.QualifiedName.ofPartition方法的一些代码示例，展示了QualifiedName.ofPartition的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。QualifiedName.ofPartition方法的具体详情如下：
包路径：com.netflix.metacat.common.QualifiedName
类名称：QualifiedName
方法名：ofPartition

QualifiedName.ofPartition介绍

[英]Creates the qualified name representing a partition.
[中]创建表示分区的限定名称。

代码示例

代码示例来源：origin: Netflix/metacat

/**
 * Creates the qualified name representing a partition.
 *
 * @param tableName    table name
 * @param partitionDto partition
 * @return qualified name
 */
public static QualifiedName ofPartition(
  @NonNull final QualifiedName tableName,
  @NonNull final PartitionDto partitionDto
) {
  return ofPartition(
    tableName.catalogName,
    tableName.databaseName,
    tableName.tableName,
    partitionDto.getName().getPartitionName()
  );
}

代码示例来源：origin: com.netflix.metacat/metacat-common

/**
 * Creates the qualified name representing a partition.
 *
 * @param tableName    table name
 * @param partitionDto partition
 * @return qualified name
 */
public static QualifiedName ofPartition(
  @NonNull final QualifiedName tableName,
  @NonNull final PartitionDto partitionDto
) {
  return ofPartition(
    tableName.catalogName,
    tableName.databaseName,
    tableName.tableName,
    partitionDto.getName().getPartitionName()
  );
}

代码示例来源：origin: Netflix/metacat

@Override
public Map<String, List<QualifiedName>> getPartitionNames(@Nonnull final ConnectorRequestContext context,
                             @Nonnull final List<String> uris,
                             final boolean prefixSearch) {
  return partitionDao.getByUris(uris, prefixSearch).stream().collect(Collectors.groupingBy(Partition::getUri,
    Collectors.mapping(p -> QualifiedName.ofPartition(
      catalogName, p.getTable().getDatabase().getName(), p.getTable().getName(), p.getName()),
      Collectors.toList())));
}

代码示例来源：origin: Netflix/metacat

/**
   * Constructor.
   *
   * @param tableName     table name
   * @param partitionName partition name
   * @param cause         error cause
   */
  public PartitionNotFoundException(
    final QualifiedName tableName,
    final String partitionName,
    @Nullable final Throwable cause
  ) {
    super(QualifiedName.ofPartition(tableName.getCatalogName(),
      tableName.getDatabaseName(), tableName.getTableName(), partitionName),
      String.format("Partition %s not found for table %s", partitionName, tableName),
      cause, false, false);
    this.tableName = tableName;
    this.partitionName = partitionName;
  }
}

代码示例来源：origin: Netflix/metacat

return ofView(parts[0], parts[1], parts[2], parts[3]);
} else {
  return ofPartition(parts[0], parts[1], parts[2], parts[3]);

代码示例来源：origin: com.netflix.metacat/metacat-common

return ofView(parts[0], parts[1], parts[2], parts[3]);
} else {
  return ofPartition(parts[0], parts[1], parts[2], parts[3]);

代码示例来源：origin: com.netflix.metacat/metacat-common-server

/**
   * Constructor.
   *
   * @param tableName     table name
   * @param partitionName partition name
   * @param cause         error cause
   */
  public PartitionNotFoundException(
    final QualifiedName tableName,
    final String partitionName,
    @Nullable final Throwable cause
  ) {
    super(QualifiedName.ofPartition(tableName.getCatalogName(),
      tableName.getDatabaseName(), tableName.getTableName(), partitionName),
      String.format("Partition %s not found for table %s", partitionName, tableName),
      cause, false, false);
    this.tableName = tableName;
    this.partitionName = partitionName;
  }
}

代码示例来源：origin: Netflix/metacat

final List<QualifiedName> partitionNames = result.get(uri);
final QualifiedName qualifiedName =
  QualifiedName.ofPartition(catalogName, schemaName, tableName, partitionName);
if (partitionNames == null) {
  result.put(uri, Lists.newArrayList(qualifiedName));

代码示例来源：origin: com.netflix.metacat/metacat-connector-hive

final List<QualifiedName> partitionNames = result.get(uri);
final QualifiedName qualifiedName =
  QualifiedName.ofPartition(catalogName, schemaName, tableName, partitionName);
if (partitionNames == null) {
  result.put(uri, Lists.newArrayList(qualifiedName));

代码示例来源：origin: Netflix/metacat

private void appendPartitionsCore(final String dbName, final String tblName, final String partName)
  throws TException {
  final PartitionsSaveRequestDto partitionsSaveRequestDto = new PartitionsSaveRequestDto();
  final PartitionDto partitionDto = new PartitionDto();
  partitionDto.setName(QualifiedName.ofPartition(catalogName, dbName, tblName, partName));
  partitionDto.setSerde(new StorageDto());
  partitionsSaveRequestDto.setPartitions(Lists.newArrayList(partitionDto));
  partV1.savePartitions(catalogName, dbName, tblName, partitionsSaveRequestDto);
}

代码示例来源：origin: com.netflix.metacat/metacat-thrift

private void appendPartitionsCore(final String dbName, final String tblName, final String partName)
  throws TException {
  final PartitionsSaveRequestDto partitionsSaveRequestDto = new PartitionsSaveRequestDto();
  final PartitionDto partitionDto = new PartitionDto();
  partitionDto.setName(QualifiedName.ofPartition(catalogName, dbName, tblName, partName));
  partitionDto.setSerde(new StorageDto());
  partitionsSaveRequestDto.setPartitions(Lists.newArrayList(partitionDto));
  partV1.savePartitions(catalogName, dbName, tblName, partitionsSaveRequestDto);
}

代码示例来源：origin: Netflix/metacat

partitionDtos.forEach(partitionDto ->
  partitionDto.setName(QualifiedName
    .ofPartition(viewQName.getCatalogName(), viewQName.getDatabaseName(), viewQName.getTableName(),
      partitionDto.getName().getPartitionName())));
final MetacatRequestContext metacatRequestContext = MetacatContextManager.getContext();

代码示例来源：origin: Netflix/metacat

.filter(partitionName -> partitionIds == null || partitionIds.contains(partitionName))
.map(partitionName -> PartitionInfo.builder().name(
  QualifiedName.ofPartition(tableName.getCatalogName(),
    tableName.getDatabaseName(),
    tableName.getTableName(),

代码示例来源：origin: Netflix/metacat

/**
 * {@inheritDoc}
 */
@Override
public PartitionDto hiveToMetacatPartition(final TableDto tableDto, final Partition partition) {
  final QualifiedName tableName = tableDto.getName();
  final QualifiedName partitionName = QualifiedName.ofPartition(tableName.getCatalogName(),
    tableName.getDatabaseName(),
    tableName.getTableName(), getNameFromPartVals(tableDto, partition.getValues()));
  final PartitionDto result = new PartitionDto();
  String owner = "";
  if (tableDto.getSerde() != null) {
    owner = tableDto.getSerde().getOwner();
  }
  //not setting Serde to view
  if (null == tableDto.getView() || Strings.isNullOrEmpty(tableDto.getView().getViewOriginalText())) {
    result.setSerde(toStorageDto(partition.getSd(), owner));
  }
  result.setMetadata(partition.getParameters());
  final AuditDto auditDto = new AuditDto();
  auditDto.setCreatedDate(epochSecondsToDate(partition.getCreateTime()));
  auditDto.setLastModifiedDate(epochSecondsToDate(partition.getLastAccessTime()));
  result.setAudit(auditDto);
  result.setName(partitionName);
  return result;
}

代码示例来源：origin: com.netflix.metacat/metacat-thrift

/**
 * {@inheritDoc}
 */
@Override
public PartitionDto hiveToMetacatPartition(final TableDto tableDto, final Partition partition) {
  final QualifiedName tableName = tableDto.getName();
  final QualifiedName partitionName = QualifiedName.ofPartition(tableName.getCatalogName(),
    tableName.getDatabaseName(),
    tableName.getTableName(), getNameFromPartVals(tableDto, partition.getValues()));
  final PartitionDto result = new PartitionDto();
  String owner = "";
  if (tableDto.getSerde() != null) {
    owner = tableDto.getSerde().getOwner();
  }
  //not setting Serde to view
  if (null == tableDto.getView() || Strings.isNullOrEmpty(tableDto.getView().getViewOriginalText())) {
    result.setSerde(toStorageDto(partition.getSd(), owner));
  }
  result.setMetadata(partition.getParameters());
  final AuditDto auditDto = new AuditDto();
  auditDto.setCreatedDate(epochSecondsToDate(partition.getCreateTime()));
  auditDto.setLastModifiedDate(epochSecondsToDate(partition.getLastAccessTime()));
  result.setAudit(auditDto);
  result.setName(partitionName);
  return result;
}

代码示例来源：origin: Netflix/metacat

@Override
public PartitionInfo toPartitionInfo(final TableInfo tableInfo, final Partition partition) {
  final QualifiedName tableName = tableInfo.getName();
  final StorageInfo storageInfo = tableInfo.getSerde();
  storageInfo.setUri(partition.getUri());
  final AuditInfo auditInfo = AuditInfo.builder().createdDate(partition.getCreatedDate())
    .lastModifiedDate(partition.getLastUpdatedDate())
    .build();
  final AuditInfo tableAuditInfo = tableInfo.getAudit();
  if (tableAuditInfo != null) {
    auditInfo.setCreatedBy(tableAuditInfo.getCreatedBy());
    auditInfo.setLastModifiedBy(tableAuditInfo.getLastModifiedBy());
  }
  return PartitionInfo.builder()
    .name(QualifiedName.ofPartition(tableName.getCatalogName(),
      tableName.getDatabaseName(), tableName.getTableName(), partition.getName()))
    .serde(storageInfo)
    .auditInfo(auditInfo)
    .build();
}

代码示例来源：origin: Netflix/metacat

/**
 * Returns a partition info.
 * @param tableName table name
 * @param table s3 table
 * @param partition partition
 * @return partition info
 */
PartitionInfo toPartitionInfo(final QualifiedName tableName, final Table table, final Partition partition) {
  final StorageInfo storageInfo = toStorageInfo(table);
  storageInfo.setUri(partition.getUri());
  final AuditInfo auditInfo = AuditInfo.builder().createdDate(partition.getCreatedDate())
    .lastModifiedDate(partition.getLastUpdatedDate())
    .build();
  final AuditInfo tableAuditInfo = toAuditInfo(table);
  if (tableAuditInfo != null) {
    auditInfo.setCreatedBy(tableAuditInfo.getCreatedBy());
    auditInfo.setLastModifiedBy(tableAuditInfo.getLastModifiedBy());
  }
  return PartitionInfo.builder()
    .name(QualifiedName.ofPartition(tableName.getCatalogName(),
      tableName.getDatabaseName(), tableName.getTableName(), partition.getName()))
    .serde(storageInfo)
    .auditInfo(auditInfo)
    .build();
}

代码示例来源：origin: com.netflix.metacat/metacat-converters

@Override
public PartitionDto hiveToMetacatPartition(final TableDto tableDto, final Partition partition) {
  final QualifiedName tableName = tableDto.getName();
  final QualifiedName partitionName = QualifiedName.ofPartition(tableName.getCatalogName(),
    tableName.getDatabaseName(),
    tableName.getTableName(), getNameFromPartVals(tableDto, partition.getValues()));
  final PartitionDto result = new PartitionDto();
  String owner = "";
  if (tableDto.getSerde() != null) {
    owner = tableDto.getSerde().getOwner();
  }
  result.setSerde(toStorageDto(partition.getSd(), owner));
  result.setMetadata(partition.getParameters());
  final AuditDto auditDto = new AuditDto();
  auditDto.setCreatedDate(epochSecondsToDate(partition.getCreateTime()));
  auditDto.setLastModifiedDate(epochSecondsToDate(partition.getLastAccessTime()));
  result.setAudit(auditDto);
  result.setName(partitionName);
  return result;
}

代码示例来源：origin: com.netflix.metacat/metacat-connector-hive

/**
 * Converts to PartitionDto.
 *
 * @param partition connector partition
 * @return Metacat partition Info
 */
@Override
public PartitionInfo toPartitionInfo(
  final TableInfo tableInfo,
  final Partition partition
) {
  final QualifiedName tableName = tableInfo.getName();
  final QualifiedName partitionName = QualifiedName.ofPartition(tableName.getCatalogName(),
    tableName.getDatabaseName(),
    tableName.getTableName(),
    getNameFromPartVals(tableInfo, partition.getValues()));
  final String owner = notNull(tableInfo.getSerde()) ? tableInfo.getSerde().getOwner() : "";
  final AuditInfo auditInfo = AuditInfo.builder()
    .createdDate(epochSecondsToDate(partition.getCreateTime()))
    .lastModifiedDate(epochSecondsToDate(partition.getLastAccessTime())).build();
  return PartitionInfo.builder()
    .serde(toStorageInfo(partition.getSd(), owner))
    .name(partitionName)
    .auditInfo(auditInfo)
    .metadata(partition.getParameters())
    .build();
}

代码示例来源：origin: Netflix/metacat

/**
 * Converts to PartitionDto.
 *
 * @param partition connector partition
 * @return Metacat partition Info
 */
@Override
public PartitionInfo toPartitionInfo(
  final TableInfo tableInfo,
  final Partition partition
) {
  final QualifiedName tableName = tableInfo.getName();
  final QualifiedName partitionName = QualifiedName.ofPartition(tableName.getCatalogName(),
    tableName.getDatabaseName(),
    tableName.getTableName(),
    getNameFromPartVals(tableInfo, partition.getValues()));
  final String owner = notNull(tableInfo.getSerde()) ? tableInfo.getSerde().getOwner() : "";
  final AuditInfo auditInfo = AuditInfo.builder()
    .createdDate(epochSecondsToDate(partition.getCreateTime()))
    .lastModifiedDate(epochSecondsToDate(partition.getLastAccessTime())).build();
  return PartitionInfo.builder()
    .serde(toStorageInfo(partition.getSd(), owner))
    .name(partitionName)
    .auditInfo(auditInfo)
    .metadata(partition.getParameters())
    .build();
}

内容来源于网络，如有侵权，请联系作者删除！

QualifiedName

相关文章

    查看更多
    微信公众号

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com