com.google.api.services.bigquery.model.JobConfiguration类的使用及代码示例

x33g5p2x  于2022-01-22 转载在 其他  
字(12.1k)|赞(0)|评价(0)|浏览(113)

本文整理了Java中com.google.api.services.bigquery.model.JobConfiguration类的一些代码示例，展示了JobConfiguration类的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。JobConfiguration类的具体详情如下：
包路径：com.google.api.services.bigquery.model.JobConfiguration
类名称：JobConfiguration

JobConfiguration介绍

[英]Model definition for JobConfiguration.

This is the Java data model class that specifies how to parse/serialize into the JSON that is transmitted over HTTP when working with the BigQuery API. For a detailed explanation see: https://developers.google.com/api-client-library/java/google-http-java-client/json
[中]作业配置的模型定义。
这是Java数据模型类，指定在使用BigQueryAPI时如何解析/序列化为通过HTTP传输的JSON。有关详细说明，请参见：https://developers.google.com/api-client-library/java/google-http-java-client/json

代码示例

代码示例来源：origin: googleapis/google-cloud-java

loadConfigurationPb.setClustering(clustering.toPb());
return new com.google.api.services.bigquery.model.JobConfiguration()
  .setLoad(loadConfigurationPb);

代码示例来源：origin: googleapis/google-cloud-java

private static com.google.api.services.bigquery.model.Job newJobPb() {
 return new com.google.api.services.bigquery.model.Job()
   .setConfiguration(
     new com.google.api.services.bigquery.model.JobConfiguration()
       .setQuery(new JobConfigurationQuery().setQuery("FOO")));
}

代码示例来源：origin: googleapis/google-cloud-java

@Test
public void testIncomplete() {
 // https://github.com/googleapis/google-cloud-java/issues/2357
 com.google.api.services.bigquery.model.Job job =
   new com.google.api.services.bigquery.model.Job()
     .setStatistics(
       new com.google.api.services.bigquery.model.JobStatistics()
         .setCreationTime(1234L)
         .setStartTime(5678L));
 job.setConfiguration(
   new com.google.api.services.bigquery.model.JobConfiguration()
     .setCopy(new com.google.api.services.bigquery.model.JobConfigurationTableCopy()));
 assertThat(JobStatistics.fromPb(job)).isInstanceOf(CopyStatistics.class);
 job.setConfiguration(
   new com.google.api.services.bigquery.model.JobConfiguration()
     .setLoad(new com.google.api.services.bigquery.model.JobConfigurationLoad()));
 assertThat(JobStatistics.fromPb(job)).isInstanceOf(LoadStatistics.class);
 job.setConfiguration(
   new com.google.api.services.bigquery.model.JobConfiguration()
     .setExtract(new com.google.api.services.bigquery.model.JobConfigurationExtract()));
 assertThat(JobStatistics.fromPb(job)).isInstanceOf(ExtractStatistics.class);
 job.setConfiguration(
   new com.google.api.services.bigquery.model.JobConfiguration()
     .setQuery(new com.google.api.services.bigquery.model.JobConfigurationQuery()));
 assertThat(JobStatistics.fromPb(job)).isInstanceOf(QueryStatistics.class);
}

代码示例来源：origin: googleapis/google-cloud-java

@SuppressWarnings("unchecked")
 static <T extends JobConfiguration> T fromPb(
   com.google.api.services.bigquery.model.JobConfiguration configurationPb) {
  if (configurationPb.getCopy() != null) {
   return (T) CopyJobConfiguration.fromPb(configurationPb);
  } else if (configurationPb.getExtract() != null) {
   return (T) ExtractJobConfiguration.fromPb(configurationPb);
  } else if (configurationPb.getLoad() != null) {
   return (T) LoadJobConfiguration.fromPb(configurationPb);
  } else if (configurationPb.getQuery() != null) {
   return (T) QueryJobConfiguration.fromPb(configurationPb);
  } else {
   // never reached
   throw new IllegalArgumentException("Job configuration is not supported");
  }
 }
}

代码示例来源：origin: googleapis/google-cloud-java

@Override
com.google.api.services.bigquery.model.JobConfiguration toPb() {
 JobConfigurationExtract extractConfigurationPb = new JobConfigurationExtract();
 extractConfigurationPb.setDestinationUris(destinationUris);
 extractConfigurationPb.setSourceTable(sourceTable.toPb());
 extractConfigurationPb.setPrintHeader(printHeader);
 extractConfigurationPb.setFieldDelimiter(fieldDelimiter);
 extractConfigurationPb.setDestinationFormat(format);
 extractConfigurationPb.setCompression(compression);
 return new com.google.api.services.bigquery.model.JobConfiguration()
   .setExtract(extractConfigurationPb);
}

代码示例来源：origin: googleapis/google-cloud-java

@Override
com.google.api.services.bigquery.model.JobConfiguration toPb() {
 com.google.api.services.bigquery.model.JobConfiguration configurationPb =
   new com.google.api.services.bigquery.model.JobConfiguration();
 JobConfigurationQuery queryConfigurationPb = new JobConfigurationQuery();
 queryConfigurationPb.setQuery(query);
  queryConfigurationPb.setQueryParameters(queryParametersPb);
 configurationPb.setDryRun(dryRun());
 if (allowLargeResults != null) {
  queryConfigurationPb.setAllowLargeResults(allowLargeResults);
  queryConfigurationPb.setClustering(clustering.toPb());
 return configurationPb.setQuery(queryConfigurationPb);

代码示例来源：origin: googleapis/google-cloud-java

@Override
com.google.api.services.bigquery.model.JobConfiguration toPb() {
 JobConfigurationTableCopy configurationPb = new JobConfigurationTableCopy();
 configurationPb.setDestinationTable(destinationTable.toPb());
 if (sourceTables.size() == 1) {
  configurationPb.setSourceTable(sourceTables.get(0).toPb());
 } else {
  configurationPb.setSourceTables(Lists.transform(sourceTables, TableId.TO_PB_FUNCTION));
 }
 if (createDisposition != null) {
  configurationPb.setCreateDisposition(createDisposition.toString());
 }
 if (writeDisposition != null) {
  configurationPb.setWriteDisposition(writeDisposition.toString());
 }
 if (destinationEncryptionConfiguration != null) {
  configurationPb.setDestinationEncryptionConfiguration(
    destinationEncryptionConfiguration.toPb());
 }
 return new com.google.api.services.bigquery.model.JobConfiguration().setCopy(configurationPb);
}

代码示例来源：origin: com.spotify/scio-bigquery

.setConfiguration(new JobConfiguration()
    .setQuery(queryConfig)
    .setDryRun(true));
JobStatistics jobStats = executeWithBackOff(
  client.jobs().insert(projectId, dryRunJob),
JobConfiguration config = new JobConfiguration();
config.setQuery(queryConfig);
job.setConfiguration(config);
   return pollJob.getConfiguration().getQuery().getDestinationTable();
  } else {

代码示例来源：origin: googleapis/google-cloud-java

@Test
public void testToPbAndFromPb() {
 assertNull(LOAD_CONFIGURATION_CSV.toPb().getLoad().getSourceUris());
 compareLoadConfiguration(
   LOAD_CONFIGURATION_CSV, WriteChannelConfiguration.fromPb(LOAD_CONFIGURATION_CSV.toPb()));
 WriteChannelConfiguration configuration = WriteChannelConfiguration.of(TABLE_ID);
 compareLoadConfiguration(configuration, WriteChannelConfiguration.fromPb(configuration.toPb()));
}

代码示例来源：origin: googleapis/google-cloud-java

private Builder(com.google.api.services.bigquery.model.JobConfiguration configurationPb) {
 this();
 JobConfigurationQuery queryConfigurationPb = configurationPb.getQuery();
 this.query = queryConfigurationPb.getQuery();
 if (queryConfigurationPb.getQueryParameters() != null
  maximumBytesBilled = queryConfigurationPb.getMaximumBytesBilled();
 dryRun = configurationPb.getDryRun();
 if (queryConfigurationPb.getDestinationTable() != null) {
  destinationTable = TableId.fromPb(queryConfigurationPb.getDestinationTable());

代码示例来源：origin: stackoverflow.com

tableId, DateTime.now().toString("dd-MM-yyyy_HH-mm-ss-SSS")))
        .setProjectId(projectId))
.setConfiguration(new JobConfiguration().setLoad(loadConfig));

代码示例来源：origin: googleapis/google-cloud-java

.setJobReference(queryJob.toPb())
    .setId(JOB);
jobResponsePb1.getConfiguration().getQuery().setDestinationTable(TABLE_ID.toPb());

代码示例来源：origin: googleapis/google-cloud-java

private Builder(com.google.api.services.bigquery.model.JobConfiguration configurationPb) {
 this();
 JobConfigurationExtract extractConfigurationPb = configurationPb.getExtract();
 this.sourceTable = TableId.fromPb(extractConfigurationPb.getSourceTable());
 this.destinationUris = extractConfigurationPb.getDestinationUris();
 this.printHeader = extractConfigurationPb.getPrintHeader();
 this.fieldDelimiter = extractConfigurationPb.getFieldDelimiter();
 this.format = extractConfigurationPb.getDestinationFormat();
 this.compression = extractConfigurationPb.getCompression();
}

代码示例来源：origin: googleapis/google-cloud-java

private Builder(com.google.api.services.bigquery.model.JobConfiguration configurationPb) {
 this();
 JobConfigurationTableCopy copyConfigurationPb = configurationPb.getCopy();
 this.destinationTable = TableId.fromPb(copyConfigurationPb.getDestinationTable());
 if (copyConfigurationPb.getSourceTables() != null) {
  this.sourceTables =
    Lists.transform(copyConfigurationPb.getSourceTables(), TableId.FROM_PB_FUNCTION);
 } else {
  this.sourceTables = ImmutableList.of(TableId.fromPb(copyConfigurationPb.getSourceTable()));
 }
 if (copyConfigurationPb.getCreateDisposition() != null) {
  this.createDisposition =
    JobInfo.CreateDisposition.valueOf(copyConfigurationPb.getCreateDisposition());
 }
 if (copyConfigurationPb.getWriteDisposition() != null) {
  this.writeDisposition =
    JobInfo.WriteDisposition.valueOf(copyConfigurationPb.getWriteDisposition());
 }
 if (copyConfigurationPb.getDestinationEncryptionConfiguration() != null) {
  this.destinationEncryptionConfiguration =
    new EncryptionConfiguration.Builder(
        copyConfigurationPb.getDestinationEncryptionConfiguration())
      .build();
 }
}

代码示例来源：origin: googleapis/google-cloud-java

@SuppressWarnings("unchecked")
 static <T extends JobStatistics> T fromPb(com.google.api.services.bigquery.model.Job jobPb) {
  JobConfiguration jobConfigPb = jobPb.getConfiguration();
  com.google.api.services.bigquery.model.JobStatistics statisticPb = jobPb.getStatistics();
  if (jobConfigPb.getLoad() != null) {
   return (T) LoadStatistics.fromPb(statisticPb);
  } else if (jobConfigPb.getExtract() != null) {
   return (T) ExtractStatistics.fromPb(statisticPb);
  } else if (jobConfigPb.getQuery() != null) {
   return (T) QueryStatistics.fromPb(statisticPb);
  } else if (jobConfigPb.getCopy() != null) {
   return (T) CopyStatistics.fromPb(statisticPb);
  } else {
   throw new IllegalArgumentException("unknown job configuration: " + jobConfigPb);
  }
 }
}

代码示例来源：origin: org.apache.beam/beam-sdks-java-io-google-cloud-platform

@Override
public JobStatistics dryRunQuery(
  String projectId, JobConfigurationQuery queryConfig, String location)
  throws InterruptedException, IOException {
 JobReference jobRef = new JobReference().setLocation(location).setProjectId(projectId);
 Job job =
   new Job()
     .setJobReference(jobRef)
     .setConfiguration(new JobConfiguration().setQuery(queryConfig).setDryRun(true));
 return executeWithRetries(
     client.jobs().insert(projectId, job),
     String.format(
       "Unable to dry run query: %s, aborting after %d retries.",
       queryConfig, MAX_RPC_RETRIES),
     Sleeper.DEFAULT,
     createDefaultBackoff(),
     ALWAYS_RETRY)
   .getStatistics();
}

代码示例来源：origin: org.apache.beam/beam-sdks-java-io-google-cloud-platform

/**
 * {@inheritDoc}
 *
 * <p>Tries executing the RPC for at most {@code MAX_RPC_RETRIES} times until it succeeds.
 *
 * @throws IOException if it exceeds {@code MAX_RPC_RETRIES} attempts.
 */
@Override
public void startExtractJob(JobReference jobRef, JobConfigurationExtract extractConfig)
  throws InterruptedException, IOException {
 Job job =
   new Job()
     .setJobReference(jobRef)
     .setConfiguration(new JobConfiguration().setExtract(extractConfig));
 startJob(job, errorExtractor, client);
}

代码示例来源：origin: org.apache.beam/beam-sdks-java-io-google-cloud-platform

/**
 * {@inheritDoc}
 *
 * <p>Tries executing the RPC for at most {@code MAX_RPC_RETRIES} times until it succeeds.
 *
 * @throws IOException if it exceeds {@code MAX_RPC_RETRIES} attempts.
 */
@Override
public void startCopyJob(JobReference jobRef, JobConfigurationTableCopy copyConfig)
  throws IOException, InterruptedException {
 Job job =
   new Job()
     .setJobReference(jobRef)
     .setConfiguration(new JobConfiguration().setCopy(copyConfig));
 startJob(job, errorExtractor, client);
}

代码示例来源：origin: googleapis/google-cloud-java

private Builder(com.google.api.services.bigquery.model.JobConfiguration configurationPb) {
 this();
 JobConfigurationLoad loadConfigurationPb = configurationPb.getLoad();
 this.destinationTable = TableId.fromPb(loadConfigurationPb.getDestinationTable());
 if (loadConfigurationPb.getCreateDisposition() != null) {
 this.projectionFields = loadConfigurationPb.getProjectionFields();
 if (loadConfigurationPb.getSourceUris() != null) {
  this.sourceUris = ImmutableList.copyOf(configurationPb.getLoad().getSourceUris());

代码示例来源：origin: com.google.gcloud/gcloud-java-bigquery

private Builder(com.google.api.services.bigquery.model.JobConfiguration configurationPb) {
 this();
 JobConfigurationQuery queryConfigurationPb = configurationPb.getQuery();
 this.query = queryConfigurationPb.getQuery();
 allowLargeResults = queryConfigurationPb.getAllowLargeResults();
 useQueryCache = queryConfigurationPb.getUseQueryCache();
 flattenResults = queryConfigurationPb.getFlattenResults();
 dryRun = configurationPb.getDryRun();
 if (queryConfigurationPb.getDestinationTable() != null) {
  destinationTable = TableId.fromPb(queryConfigurationPb.getDestinationTable());

内容来源于网络，如有侵权，请联系作者删除！

JobConfiguration

相关文章

    查看更多
    微信公众号

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com