org.apache.gobblin.util.AvroUtils.parseSchemaFromFile()方法的使用及代码示例

x33g5p2x  于2022-01-16 转载在 其他  
字(2.7k)|赞(0)|评价(0)|浏览(96)

本文整理了Java中org.apache.gobblin.util.AvroUtils.parseSchemaFromFile()方法的一些代码示例,展示了AvroUtils.parseSchemaFromFile()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。AvroUtils.parseSchemaFromFile()方法的具体详情如下:
包路径:org.apache.gobblin.util.AvroUtils
类名称:AvroUtils
方法名:parseSchemaFromFile

AvroUtils.parseSchemaFromFile介绍

[英]Parse Avro schema from a schema file.
[中]从模式文件解析Avro模式。

代码示例

代码示例来源:origin: apache/incubator-gobblin

public static Schema getSchemaFromUrl(Path schemaUrl, FileSystem fs) throws IOException {
 return AvroUtils.parseSchemaFromFile(schemaUrl, fs);
}

代码示例来源:origin: apache/incubator-gobblin

log.info("Using attributes specified in schema file " + keySchemaFile + " for compaction");
try {
 keySchema = AvroUtils.parseSchemaFromFile(keySchemaFile, this.fs);
} catch (IOException e) {
 log.error("Failed to parse avro schema from " + keySchemaFile

代码示例来源:origin: apache/incubator-gobblin

@Test
public void testGetSchemaFromUrlUsingHiveSchema() throws IOException, HiveException {
 FileSystem fs = FileSystem.getLocal(new Configuration());
 String jobId = "123";
 State state = new State();
 state.setProp(ConfigurationKeys.JOB_ID_KEY, jobId);
 AvroSchemaManager asm = new AvroSchemaManager(fs, state);
 Partition partition = getTestPartition(new Table("testDb", "testTable"));
 Path schemaPath = asm.getSchemaUrl(partition);
 Schema actualSchema = AvroUtils.parseSchemaFromFile(schemaPath, fs);
 String expectedSchema = new String(Files.readAllBytes(
   Paths.get(getClass().getClassLoader().getResource("avroSchemaManagerTest/expectedSchema.avsc").getFile())));
 Assert.assertEquals(actualSchema.toString(), expectedSchema);
}

代码示例来源:origin: apache/incubator-gobblin

LOG.info("Using attributes specified in schema file " + keySchemaFile + " for compaction");
try {
 keySchema = AvroUtils.parseSchemaFromFile(keySchemaFile, this.fs);
} catch (IOException e) {
 LOG.error("Failed to parse avro schema from " + keySchemaFile

代码示例来源:origin: org.apache.gobblin/gobblin-data-management

public static Schema getSchemaFromUrl(Path schemaUrl, FileSystem fs) throws IOException {
 return AvroUtils.parseSchemaFromFile(schemaUrl, fs);
}

代码示例来源:origin: org.apache.gobblin/gobblin-compaction

log.info("Using attributes specified in schema file " + keySchemaFile + " for compaction");
try {
 keySchema = AvroUtils.parseSchemaFromFile(keySchemaFile, this.fs);
} catch (IOException e) {
 log.error("Failed to parse avro schema from " + keySchemaFile

代码示例来源:origin: org.apache.gobblin/gobblin-compaction

LOG.info("Using attributes specified in schema file " + keySchemaFile + " for compaction");
try {
 keySchema = AvroUtils.parseSchemaFromFile(keySchemaFile, this.fs);
} catch (IOException e) {
 LOG.error("Failed to parse avro schema from " + keySchemaFile

相关文章