本文整理了Java中parquet.schema.MessageType.toString()
方法的一些代码示例,展示了MessageType.toString()
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。MessageType.toString()
方法的具体详情如下:
包路径:parquet.schema.MessageType
类名称:MessageType
方法名:toString
暂无
代码示例来源:origin: apache/incubator-gobblin
private void testCase(String testCaseName)
throws SchemaConversionException, DataConversionException {
JsonObject test = testCases.get(testCaseName).getAsJsonObject();
parquetConverter = new JsonIntermediateToParquetGroupConverter();
MessageType schema = parquetConverter.convertSchema(test.get("schema").getAsJsonArray(), workUnit);
Group record =
parquetConverter.convertRecord(schema, test.get("record").getAsJsonObject(), workUnit).iterator().next();
assertEqualsIgnoreSpaces(schema.toString(), test.get("expectedSchema").getAsString());
assertEqualsIgnoreSpaces(record.toString(), test.get("expectedRecord").getAsString());
}
代码示例来源:origin: com.facebook.presto.hive/hive-apache
public static void setSchema(final MessageType schema, final Configuration configuration) {
configuration.set(PARQUET_HIVE_SCHEMA, schema.toString());
}
代码示例来源:origin: com.facebook.presto.hive/hive-apache
public static void setSchema(MessageType schema, Configuration configuration) {
configuration.set(PARQUET_EXAMPLE_SCHEMA, schema.toString());
}
代码示例来源:origin: julienledem/redelm
@Test
public void test() throws Exception {
System.out.println(Paper.schema.toString());
MessageType schema = MessageTypeParser.parseMessageType(Paper.schema.toString());
assertEquals(Paper.schema, schema);
assertEquals(schema.toString(), Paper.schema.toString());
}
代码示例来源:origin: com.facebook.presto.hive/hive-apache
contextMetadata.put(HIVE_TABLE_AS_PARQUET_SCHEMA, tableSchema.toString());
contextMetadata.put(HIVE_TABLE_AS_PARQUET_SCHEMA, fileSchema.toString());
return new ReadContext(fileSchema, contextMetadata);
代码示例来源:origin: julienledem/redelm
@Test
public void testSchema() {
assertEquals(schemaString, schema.toString());
}
代码示例来源:origin: com.facebook.presto.hive/hive-apache
fileBlockLocations,
fileStatus,
readContext.getRequestedSchema().toString(),
readContext.getReadSupportMetadata(),
minSplitSize,
代码示例来源:origin: com.facebook.presto.hive/hive-apache
((FileSplit) oldSplit).getLocations(),
filtedBlocks,
readContext.getRequestedSchema().toString(),
fileMetaData.getSchema().toString(),
fileMetaData.getKeyValueMetaData(),
readContext.getReadSupportMetadata());
代码示例来源:origin: julienledem/redelm
@Test
public void testNestedTypes() {
MessageType schema = MessageTypeParser.parseMessageType(Paper.schema.toString());
Type type = schema.getType("Links", "Backward");
assertEquals(PrimitiveTypeName.INT64,
type.asPrimitiveType().getPrimitiveTypeName());
assertEquals(0, schema.getMaxRepetitionLevel("DocId"));
assertEquals(1, schema.getMaxRepetitionLevel("Name"));
assertEquals(2, schema.getMaxRepetitionLevel("Name", "Language"));
assertEquals(0, schema.getMaxDefinitionLevel("DocId"));
assertEquals(1, schema.getMaxDefinitionLevel("Links"));
assertEquals(2, schema.getMaxDefinitionLevel("Links", "Backward"));
}
}
代码示例来源:origin: julienledem/redelm
assertEquals(manuallyMade, parsed);
MessageType parsedThenReparsed = MessageTypeParser.parseMessageType(parsed.toString());
parsedThenReparsed = MessageTypeParser.parseMessageType(parsed.toString());
内容来源于网络,如有侵权,请联系作者删除!