org.talend.daikon.avro.AvroUtils.unwrapIfNullable()方法的使用及代码示例

x33g5p2x  于2022-01-16 转载在 其他  
字(9.0k)|赞(0)|评价(0)|浏览(77)

本文整理了Java中org.talend.daikon.avro.AvroUtils.unwrapIfNullable()方法的一些代码示例，展示了AvroUtils.unwrapIfNullable()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。AvroUtils.unwrapIfNullable()方法的具体详情如下：
包路径：org.talend.daikon.avro.AvroUtils
类名称：AvroUtils
方法名：unwrapIfNullable

AvroUtils.unwrapIfNullable介绍

暂无

代码示例

代码示例来源：origin: liferay/liferay-portal

/**
 * Initialize converters per each schema field
 *
 * @param schema design schema
 * @review
 */
protected void initConverters(Schema schema) {
  schemaFields = schema.getFields();
  avroConverters = new AvroConverter[schemaFields.size()];
  for (int i = 0; i < schemaFields.size(); i++) {
    Schema.Field field = schemaFields.get(i);
    Schema fieldSchema = AvroUtils.unwrapIfNullable(field.schema());
    if (LogicalTypeUtils.isLogicalTimestampMillis(fieldSchema)) {
      String datePattern = field.getProp(
        SchemaConstants.TALEND_COLUMN_PATTERN);
      avroConverters[i] = new StringTimestampConverter(datePattern);
    }
    else {
      Schema.Type type = fieldSchema.getType();
      avroConverters[i] = _converterRegistry.get(type);
    }
  }
}

代码示例来源：origin: liferay/liferay-portal

protected String getIndexedRecordId(IndexedRecord indexedRecord)
  throws IOException {
  Schema indexRecordSchema = indexedRecord.getSchema();
  List<Schema.Field> indexRecordFields = indexRecordSchema.getFields();
  Stream<Schema.Field> stream = indexRecordFields.stream();
  Schema.Field idField = stream.filter(
    field -> AvroConstants.ID.equals(field.name())
  ).findFirst(
  ).orElseThrow(
    () -> new IOException(
      String.format(
        "Unable to find '%s' field in the incoming indexed record",
        AvroConstants.ID))
  );
  Schema fieldSchema = idField.schema();
  Schema unwrappedSchema = AvroUtils.unwrapIfNullable(fieldSchema);
  Schema.Type fieldType = unwrappedSchema.getType();
  if (fieldType == Schema.Type.STRING) {
    return (String)indexedRecord.get(idField.pos());
  }
  throw new IOException(
    i18nMessages.getMessage(
      "error.unsupported.field.schema", idField.name(),
      fieldType.getName()));
}

代码示例来源：origin: liferay/liferay-portal

private ObjectNode _createApioExpectedForm(
    IndexedRecord indexedRecord, boolean excludeId)
  throws IOException {
  Schema indexRecordSchema = indexedRecord.getSchema();
  List<Schema.Field> indexRecordFields = indexRecordSchema.getFields();
  ObjectNode objectNode = _mapper.createObjectNode();
  for (Schema.Field field : indexRecordFields) {
    String fieldName = field.name();
    if (excludeId && fieldName.equals(AvroConstants.ID)) {
      continue;
    }
    Schema fieldSchema = field.schema();
    Schema unwrappedSchema = AvroUtils.unwrapIfNullable(fieldSchema);
    Schema.Type fieldType = unwrappedSchema.getType();
    if (fieldType == Schema.Type.STRING) {
      objectNode.put(
        fieldName, (String)indexedRecord.get(field.pos()));
    }
    else if (fieldType == Schema.Type.NULL) {
      objectNode.put(fieldName, "");
    }
    else {
      throw new IOException(
        i18nMessages.getMessage(
          "error.unsupported.field.schema", field.name(),
          fieldType.getName()));
    }
  }
  return objectNode;
}

代码示例来源：origin: org.talend.components/components-adapter-beam

public static Schema getUnwrappedSchema(Field field) {
  return AvroUtils.unwrapIfNullable(field.schema());
}

代码示例来源：origin: org.talend.components/components-adapter-beam

private static Schema getUnwrappedSchema(Field field) {
  return AvroUtils.unwrapIfNullable(field.schema());
}

代码示例来源：origin: org.talend.components/processing-runtime

public static Schema getUnwrappedSchema(Schema.Field field) {
  return AvroUtils.unwrapIfNullable(field.schema());
}

代码示例来源：origin: Talend/components

private static Schema getUnwrappedSchema(Field field) {
  return AvroUtils.unwrapIfNullable(field.schema());
}

代码示例来源：origin: Talend/components

public static Schema getUnwrappedSchema(Schema.Field field) {
  return AvroUtils.unwrapIfNullable(field.schema());
}

代码示例来源：origin: Talend/components

public static Schema getUnwrappedSchema(Field field) {
  return AvroUtils.unwrapIfNullable(field.schema());
}

代码示例来源：origin: org.talend.components/components-adapter-beam

public static Schema getUnwrappedSchema(IndexedRecord record) {
  return AvroUtils.unwrapIfNullable(record.getSchema());
}

代码示例来源：origin: Talend/components

public static Schema getUnwrappedSchema(IndexedRecord record) {
  return AvroUtils.unwrapIfNullable(record.getSchema());
}

代码示例来源：origin: org.talend.components/processing-runtime

/**
 * @param srcSchema THe schema to investigate.
 * @return The Date/Time output type that corresponds to the logical type of the schema, or null if none.
 */
public static TypeConverterOutputTypes getDateTimeTypeFromLogicalType(Schema srcSchema) {
  LogicalType srcLogicalType = AvroUtils.unwrapIfNullable(srcSchema).getLogicalType();
  if (srcLogicalType instanceof LogicalTypes.Date) {
    return TypeConverterOutputTypes.Date;
  } else if (srcLogicalType instanceof LogicalTypes.TimeMillis) {
    return TypeConverterOutputTypes.Time;
  } else if (srcLogicalType instanceof LogicalTypes.TimestampMillis) {
    return TypeConverterOutputTypes.DateTime;
  } else {
    return null;
  }
}

代码示例来源：origin: org.talend.components/processing-runtime

/**
 * Get the child schema of a field, and check if this is correctly a Record. If not, thow a TalendRuntimeException.
 *
 * @param parentSchema the schema of the parent element
 * @param field the field to extract
 * @return the schema of the element extracted
 */
public static Schema getChildSchemaAsRecord(Schema parentSchema, Schema.Field field) {
  Schema childSchema = AvroUtils.unwrapIfNullable(parentSchema.getField(field.name()).schema());
  if (childSchema.getType().equals(Schema.Type.RECORD)) {
    return childSchema;
  } else {
    throw new TalendRuntimeException(CommonErrorCodes.UNEXPECTED_EXCEPTION,
        new Throwable(String.format("The field %s has the type %s but should be a Record on the schema %s",
            field.name(), childSchema.getType(), parentSchema.toString())));
  }
}

代码示例来源：origin: org.talend.daikon/daikon

static VisitableStructure createVisitableStructure(Schema schema, Object value, TraversalPath path) {
  Schema unwrappedSchema = AvroUtils.unwrapIfNullable(schema);
  switch (unwrappedSchema.getType()) {
  case ARRAY:
    return new VisitableArray(ensureArray((List) value, unwrappedSchema), path);
  default:
    return createWrapperForType(unwrappedSchema.getType(), value, path);
  }
}

代码示例来源：origin: org.talend.daikon/daikon

@Override
public Iterable<AvroConverter<?, ?>> getNestedAvroConverters() {
  for (Schema.Field f : AvroUtils.unwrapIfNullable(getSchema()).getFields()) {
    int i = f.pos();
    if (fieldType[i] == null) {
      fieldType[i] = getFieldDataSpec(i);
    }
    if (fieldConverter[i] == null) {
      fieldConverter[i] = getConverter(fieldType[i], f.schema(), null);
    }
  }
  return Arrays.asList((AvroConverter<?, ?>[]) fieldConverter);
}

代码示例来源：origin: org.talend.components/components-common

public AvroConverter<String, ?> convertToString(Schema.Field f) {
  Schema fieldSchema = AvroUtils.unwrapIfNullable(f.schema());
  switch (fieldSchema.getType()) {
  case LONG:
    String pattern = f.getProp(SchemaConstants.TALEND_COLUMN_PATTERN);
    if (pattern != null && !pattern.isEmpty()) {
      fieldSchema.addProp(SchemaConstants.TALEND_COLUMN_PATTERN, pattern);
      return new DateToStringConvert(fieldSchema);
    } else {
      return super.getConverter(String.class);
    }
  default:
    return super.getConverter(String.class);
  }
}

代码示例来源：origin: Talend/components

public AvroConverter<String, ?> convertToString(Schema.Field f) {
  Schema fieldSchema = AvroUtils.unwrapIfNullable(f.schema());
  switch (fieldSchema.getType()) {
  case LONG:
    String pattern = f.getProp(SchemaConstants.TALEND_COLUMN_PATTERN);
    if (pattern != null && !pattern.isEmpty()) {
      fieldSchema.addProp(SchemaConstants.TALEND_COLUMN_PATTERN, pattern);
      return new DateToStringConvert(fieldSchema);
    } else {
      return super.getConverter(String.class);
    }
  default:
    return super.getConverter(String.class);
  }
}

代码示例来源：origin: org.talend.components/bigquery-runtime

private TableFieldSchema tryArrayFieldSchema(org.apache.avro.Schema.Field field) {
  String fieldName = field.name();
  TableFieldSchema tableFieldSchema = new TableFieldSchema().setName(fieldName);
  boolean nullable = AvroUtils.isNullable(field.schema());
  if (!nullable) {
    tableFieldSchema = tableFieldSchema.setMode(REQUIRED_MODE);
  }
  org.apache.avro.Schema fieldSchema = AvroUtils.unwrapIfNullable(field.schema());
  if (fieldSchema.getType() == org.apache.avro.Schema.Type.ARRAY) {
    return tryFieldSchema(tableFieldSchema.setMode(REPEATED_MODE), fieldSchema.getElementType());
  }
  return tryFieldSchema(tableFieldSchema, fieldSchema);
}

代码示例来源：origin: Talend/components

private TableFieldSchema tryArrayFieldSchema(org.apache.avro.Schema.Field field) {
  String fieldName = field.name();
  TableFieldSchema tableFieldSchema = new TableFieldSchema().setName(fieldName);
  boolean nullable = AvroUtils.isNullable(field.schema());
  if (!nullable) {
    tableFieldSchema = tableFieldSchema.setMode(REQUIRED_MODE);
  }
  org.apache.avro.Schema fieldSchema = AvroUtils.unwrapIfNullable(field.schema());
  if (fieldSchema.getType() == org.apache.avro.Schema.Type.ARRAY) {
    return tryFieldSchema(tableFieldSchema.setMode(REPEATED_MODE), fieldSchema.getElementType());
  }
  return tryFieldSchema(tableFieldSchema, fieldSchema);
}

代码示例来源：origin: Talend/components

@Override
public ValidationResult validate(RuntimeContainer arg0) {
  for (FilterDescriptor descriptor : filterDescriptors) {
    Schema.Field f = inputSchema.getField(descriptor.getColumnName());
    ValidationResult filteringValidationResult = new FilterPrerequisitesValidator().validate(descriptor.getFunctionType(),
        descriptor.getOperatorType(), AvroUtils.unwrapIfNullable(f.schema()).getType(),
        descriptor.getPredefinedValue());
    if (filteringValidationResult.getStatus() != Result.OK) {
      return filteringValidationResult;
    }
  }
  return ValidationResult.OK;
}

内容来源于网络，如有侵权，请联系作者删除！

AvroUtils

相关文章

    查看更多
    微信公众号

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com