org.apache.pig.ResourceSchema.<init>()方法的使用及代码示例

x33g5p2x  于2022-01-29 转载在 其他  
字(8.0k)|赞(0)|评价(0)|浏览(182)

本文整理了Java中org.apache.pig.ResourceSchema.<init>方法的一些代码示例，展示了ResourceSchema.<init>的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。ResourceSchema.<init>方法的具体详情如下：
包路径：org.apache.pig.ResourceSchema
类名称：ResourceSchema
方法名：<init>

ResourceSchema.<init>介绍

[英]Construct an empty ResourceSchema.
[中]构造一个空的ResourceSchema。

代码示例

代码示例来源：origin: apache/hive

public static ResourceSchema getResourceSchema(HCatSchema hcatSchema) throws IOException {
 List<ResourceFieldSchema> rfSchemaList = new ArrayList<ResourceFieldSchema>();
 for (HCatFieldSchema hfs : hcatSchema.getFields()) {
  ResourceFieldSchema rfSchema;
  rfSchema = getResourceSchemaFromFieldSchema(hfs);
  rfSchemaList.add(rfSchema);
 }
 ResourceSchema rSchema = new ResourceSchema();
 rSchema.setFields(rfSchemaList.toArray(new ResourceFieldSchema[rfSchemaList.size()]));
 return rSchema;
}

代码示例来源：origin: apache/hive

private static ResourceSchema getTupleSubSchema(HCatFieldSchema hfs) throws IOException {
 // for each struct subfield, create equivalent ResourceFieldSchema
 ResourceSchema s = new ResourceSchema();
 List<ResourceFieldSchema> lrfs = new ArrayList<ResourceFieldSchema>();
 for (HCatFieldSchema subField : hfs.getStructSubSchema().getFields()) {
  lrfs.add(getResourceSchemaFromFieldSchema(subField));
 }
 s.setFields(lrfs.toArray(new ResourceFieldSchema[lrfs.size()]));
 return s;
}

代码示例来源：origin: elastic/elasticsearch-hadoop

@SuppressWarnings({ "unchecked", "rawtypes" })
@Override
public void prepareToWrite(RecordWriter writer) throws IOException {
  this.writer = writer;
  Properties props = getUDFProperties();
  String s = props.getProperty(ResourceSchema.class.getName());
  if (!StringUtils.hasText(s)) {
    log.warn("No resource schema found; using an empty one....");
    this.schema = new ResourceSchema();
  }
  else {
    this.schema = IOUtils.deserializeFromBase64(s);
  }
  this.pigTuple = new PigTuple(schema);
}

代码示例来源：origin: elastic/elasticsearch-hadoop

private ResourceSchema createSchema(String schema) {
  try {
    return new ResourceSchema(Utils.getSchemaFromString(schema));
  } catch (Exception ex) {
    throw new RuntimeException(ex);
  }
}

代码示例来源：origin: elastic/elasticsearch-hadoop

private ResourceSchema createSchema(String schema) {
  try {
    return new ResourceSchema(Utils.getSchemaFromString(schema));
  } catch (Exception ex) {
    throw new RuntimeException(ex);
  }
}

代码示例来源：origin: elastic/elasticsearch-hadoop

private ResourceSchema createSchema(String schema) {
  try {
    return new ResourceSchema(Utils.getSchemaFromString(schema));
  } catch (Exception ex) {
    throw new RuntimeException(ex);
  }
}

代码示例来源：origin: elastic/elasticsearch-hadoop

private ResourceSchema createSchema(String schema) {
  try {
    return new ResourceSchema(Utils.getSchemaFromString(schema));
  } catch (Exception ex) {
    throw new RuntimeException(ex);
  }
}

代码示例来源：origin: apache/hive

bagSubFieldSchemas[0].setSchema(getTupleSubSchema(arrayElementFieldSchema));
} else if (arrayElementFieldSchema.getType() == Type.ARRAY) {
 ResourceSchema s = new ResourceSchema();
 List<ResourceFieldSchema> lrfs = Arrays.asList(getResourceSchemaFromFieldSchema(arrayElementFieldSchema));
 s.setFields(lrfs.toArray(new ResourceFieldSchema[lrfs.size()]));
  .setType(getPigType(arrayElementFieldSchema))
 bagSubFieldSchemas[0].setSchema(new ResourceSchema().setFields(innerTupleFieldSchemas));
return new ResourceSchema().setFields(bagSubFieldSchemas);

代码示例来源：origin: apache/phoenix

public static ResourceSchema getResourceSchema(final Configuration configuration, Dependencies dependencies) throws IOException {
  final ResourceSchema schema = new ResourceSchema();
  try {
    List<ColumnInfo> columns = null;

代码示例来源：origin: apache/phoenix

@Test
public void testSchema() throws SQLException, IOException {
  
  final Configuration configuration = mock(Configuration.class);
  when(configuration.get(PhoenixConfigurationUtil.SCHEMA_TYPE)).thenReturn(SchemaType.TABLE.name());
  final ResourceSchema actual = PhoenixPigSchemaUtil.getResourceSchema(
      configuration, new Dependencies() {
        List<ColumnInfo> getSelectColumnMetadataList(
            Configuration configuration) throws SQLException {
          return Lists.newArrayList(ID_COLUMN, NAME_COLUMN);
        }
      });        
  // expected schema.
  final ResourceFieldSchema[] fields = new ResourceFieldSchema[2];
  fields[0] = new ResourceFieldSchema().setName("ID")
                      .setType(DataType.LONG);
  fields[1] = new ResourceFieldSchema().setName("NAME")
                      .setType(DataType.CHARARRAY);
  final ResourceSchema expected = new ResourceSchema().setFields(fields);
  
  assertEquals(expected.toString(), actual.toString());
  
}

代码示例来源：origin: org.apache.pig/pig

@Override
public ResourceSchema getSchema(String location, Job job) throws IOException {
 init(location, job);
  return schema == null ? null : new ResourceSchema(schema);
}

代码示例来源：origin: com.cloudera.recordservice/recordservice-hcatalog-pig-adapter

public static ResourceSchema getResourceSchema(HCatSchema hcatSchema)
  throws IOException {
 List<ResourceFieldSchema> rfSchemaList = new ArrayList<ResourceFieldSchema>();
 for (HCatFieldSchema hfs : hcatSchema.getFields()) {
  ResourceFieldSchema rfSchema;
  rfSchema = getResourceSchemaFromFieldSchema(hfs);
  rfSchemaList.add(rfSchema);
 }
 ResourceSchema rSchema = new ResourceSchema();
 rSchema.setFields(rfSchemaList.toArray(new ResourceFieldSchema[rfSchemaList.size()]));
 return rSchema;
}

代码示例来源：origin: com.github.hyukjinkwon.hcatalog/hive-hcatalog-pig-adapter

public static ResourceSchema getResourceSchema(HCatSchema hcatSchema) throws IOException {
 List<ResourceFieldSchema> rfSchemaList = new ArrayList<ResourceFieldSchema>();
 for (HCatFieldSchema hfs : hcatSchema.getFields()) {
  ResourceFieldSchema rfSchema;
  rfSchema = getResourceSchemaFromFieldSchema(hfs);
  rfSchemaList.add(rfSchema);
 }
 ResourceSchema rSchema = new ResourceSchema();
 rSchema.setFields(rfSchemaList.toArray(new ResourceFieldSchema[rfSchemaList.size()]));
 return rSchema;
}

代码示例来源：origin: com.twitter/parquet-pig

@Override
public ResourceSchema getSchema(String location, Job job) throws IOException {
 if (DEBUG) LOG.debug("LoadMetadata.getSchema(" + location + ", " + job + ")");
 setInput(location, job);
 return new ResourceSchema(schema);
}

代码示例来源：origin: com.github.hyukjinkwon.hcatalog/hive-hcatalog-pig-adapter

private static ResourceSchema getTupleSubSchema(HCatFieldSchema hfs) throws IOException {
 // for each struct subfield, create equivalent ResourceFieldSchema
 ResourceSchema s = new ResourceSchema();
 List<ResourceFieldSchema> lrfs = new ArrayList<ResourceFieldSchema>();
 for (HCatFieldSchema subField : hfs.getStructSubSchema().getFields()) {
  lrfs.add(getResourceSchemaFromFieldSchema(subField));
 }
 s.setFields(lrfs.toArray(new ResourceFieldSchema[lrfs.size()]));
 return s;
}

代码示例来源：origin: com.cloudera.recordservice/recordservice-hcatalog-pig-adapter

private static ResourceSchema getTupleSubSchema(HCatFieldSchema hfs)
  throws IOException {
 // for each struct subfield, create equivalent ResourceFieldSchema
 ResourceSchema s = new ResourceSchema();
 List<ResourceFieldSchema> lrfs = new ArrayList<ResourceFieldSchema>();
 for (HCatFieldSchema subField : hfs.getStructSubSchema().getFields()) {
  lrfs.add(getResourceSchemaFromFieldSchema(subField));
 }
 s.setFields(lrfs.toArray(new ResourceFieldSchema[lrfs.size()]));
 return s;
}

代码示例来源：origin: Netflix/iceberg

public static ResourceSchema convert(Schema icebergSchema) throws IOException {
 ResourceSchema result = new ResourceSchema();
 result.setFields(convertFields(icebergSchema.columns()));
 return result;
}

代码示例来源：origin: com.twitter.elephantbird/elephant-bird-pig

@Override
public ResourceSchema getSchema(String filename, Job job) throws IOException {
 // getSchema usually should only be called after setLocation, but it is not always enforced.
 if (job != null) {
  ThriftToPig.setConversionProperties(HadoopCompat.getConfiguration(job));
 }
 return new ResourceSchema(ThriftToPig.toSchema(typeRef.getRawClass()));
}

代码示例来源：origin: org.apache.pig/pig

static public void storeCleanup(POStore store, Configuration conf)
    throws IOException {
  StoreFuncInterface storeFunc = store.getStoreFunc();
  if (storeFunc instanceof StoreMetadata) {
    Schema schema = store.getSchema();
    if (schema != null) {
      ((StoreMetadata) storeFunc).storeSchema(
          new ResourceSchema(schema, store.getSortInfo()), store.getSFile()
              .getFileName(), new Job(conf));
    }
  }
}

代码示例来源：origin: com.twitter.elephantbird/elephant-bird-pig

@Override
public ResourceSchema getSchema(String arg0, Job arg1) throws IOException {
 return new ResourceSchema(new Schema(new FieldSchema("data", DataType.MAP)));
}

内容来源于网络，如有侵权，请联系作者删除！

ResourceSchema

相关文章

    查看更多
    微信公众号

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com