parquet.schema.MessageType.getMaxRepetitionLevel()方法的使用及代码示例

x33g5p2x  于2022-01-25 转载在 其他  
字(3.0k)|赞(0)|评价(0)|浏览(103)

本文整理了Java中parquet.schema.MessageType.getMaxRepetitionLevel()方法的一些代码示例,展示了MessageType.getMaxRepetitionLevel()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。MessageType.getMaxRepetitionLevel()方法的具体详情如下:
包路径:parquet.schema.MessageType
类名称:MessageType
方法名:getMaxRepetitionLevel

MessageType.getMaxRepetitionLevel介绍

暂无

代码示例

代码示例来源:origin: julienledem/redelm

/**
 * @return the max repetition level that might be needed to encode the
 * type at 'path'. 
 */
public int getMaxRepetitionLevel(String ... path) {
 return getMaxRepetitionLevel(path, 0) - 1;
}

代码示例来源:origin: com.facebook.presto.hive/hive-apache

/**
 * @return the max repetition level that might be needed to encode the
 * type at 'path'.
 */
public int getMaxRepetitionLevel(String ... path) {
 return getMaxRepetitionLevel(path, 0) - 1;
}

代码示例来源:origin: julienledem/redelm

public List<ColumnDescriptor> getColumns() {
 List<String[]> paths = this.getPaths(0);
 List<ColumnDescriptor> columns = new ArrayList<ColumnDescriptor>(paths.size());
 for (String[] path : paths) {
  // TODO: optimize this
  columns.add(new ColumnDescriptor(path, getType(path).asPrimitiveType().getPrimitiveTypeName(), getMaxRepetitionLevel(path), getMaxDefinitionLevel(path)));
 }
 return columns;
}

代码示例来源:origin: com.facebook.presto.hive/hive-apache

public List<ColumnDescriptor> getColumns() {
 List<String[]> paths = this.getPaths(0);
 List<ColumnDescriptor> columns = new ArrayList<ColumnDescriptor>(paths.size());
 for (String[] path : paths) {
  // TODO: optimize this
  PrimitiveType primitiveType = getType(path).asPrimitiveType();
  columns.add(new ColumnDescriptor(
          path,
          primitiveType.getPrimitiveTypeName(),
          primitiveType.getTypeLength(),
          getMaxRepetitionLevel(path),
          getMaxDefinitionLevel(path)));
 }
 return columns;
}

代码示例来源:origin: julienledem/redelm

public ColumnDescriptor getColumnDescription(String[] path) {
 int maxRep = getMaxRepetitionLevel(path);
 int maxDef = getMaxDefinitionLevel(path);
 PrimitiveTypeName type = getType(path).asPrimitiveType().getPrimitiveTypeName();
 return new ColumnDescriptor(path, type, maxRep, maxDef);
}

代码示例来源:origin: com.facebook.presto.hive/hive-apache

public ColumnDescriptor getColumnDescription(String[] path) {
 int maxRep = getMaxRepetitionLevel(path);
 int maxDef = getMaxDefinitionLevel(path);
 PrimitiveType type = getType(path).asPrimitiveType();
 return new ColumnDescriptor(path, type.getPrimitiveTypeName(),
               type.getTypeLength(), maxRep, maxDef);
}

代码示例来源:origin: julienledem/redelm

@Test
 public void testNestedTypes() {
  MessageType schema = MessageTypeParser.parseMessageType(Paper.schema.toString());
  Type type = schema.getType("Links", "Backward");
  assertEquals(PrimitiveTypeName.INT64,
    type.asPrimitiveType().getPrimitiveTypeName());
  assertEquals(0, schema.getMaxRepetitionLevel("DocId"));
  assertEquals(1, schema.getMaxRepetitionLevel("Name"));
  assertEquals(2, schema.getMaxRepetitionLevel("Name", "Language"));
  assertEquals(0, schema.getMaxDefinitionLevel("DocId"));
  assertEquals(1, schema.getMaxDefinitionLevel("Links"));
  assertEquals(2, schema.getMaxDefinitionLevel("Links", "Backward"));
 }
}

相关文章