org.apache.spark.executor.TaskMetrics.resultSize()方法的使用及代码示例

x33g5p2x  于2022-01-30 转载在 其他  
字(3.4k)|赞(0)|评价(0)|浏览(107)

本文整理了Java中org.apache.spark.executor.TaskMetrics.resultSize()方法的一些代码示例,展示了TaskMetrics.resultSize()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。TaskMetrics.resultSize()方法的具体详情如下:
包路径:org.apache.spark.executor.TaskMetrics
类名称:TaskMetrics
方法名:resultSize

TaskMetrics.resultSize介绍

暂无

代码示例

代码示例来源:origin: apache/hive

public Metrics(TaskMetrics metrics, TaskInfo taskInfo) {
 this(
  metrics.executorDeserializeTime(),
  TimeUnit.NANOSECONDS.toMillis(metrics.executorDeserializeCpuTime()),
  metrics.executorRunTime(),
  TimeUnit.NANOSECONDS.toMillis(metrics.executorCpuTime()),
  metrics.resultSize(),
  metrics.jvmGCTime(),
  metrics.resultSerializationTime(),
  metrics.memoryBytesSpilled(),
  metrics.diskBytesSpilled(),
  taskInfo.duration(),
  optionalInputMetric(metrics),
  optionalShuffleReadMetric(metrics),
  optionalShuffleWriteMetrics(metrics),
  optionalOutputMetrics(metrics));
}

代码示例来源:origin: com.facebook.presto.hive/hive-apache

executorDeserializeTime += taskMetrics.executorDeserializeTime();
executorRunTime += taskMetrics.executorRunTime();
resultSize += taskMetrics.resultSize();
jvmGCTime += taskMetrics.jvmGCTime();
resultSerializationTime += taskMetrics.resultSerializationTime();

代码示例来源:origin: org.apache.pig/pig

executorDeserializeTime += taskMetrics.executorDeserializeTime();
executorRunTime += taskMetrics.executorRunTime();
resultSize += taskMetrics.resultSize();
jvmGCTime += taskMetrics.jvmGCTime();
resultSerializationTime += taskMetrics.resultSerializationTime();

代码示例来源:origin: com.github.hyukjinkwon/spark-client

public Metrics(TaskMetrics metrics) {
 this(
  metrics.executorDeserializeTime(),
  metrics.executorRunTime(),
  metrics.resultSize(),
  metrics.jvmGCTime(),
  metrics.resultSerializationTime(),
  metrics.memoryBytesSpilled(),
  metrics.diskBytesSpilled(),
  optionalInputMetric(metrics),
  optionalShuffleReadMetric(metrics),
  optionalShuffleWriteMetrics(metrics));
}

代码示例来源:origin: org.spark-project.hive/spark-client

public Metrics(TaskMetrics metrics) {
 this(
  metrics.executorDeserializeTime(),
  metrics.executorRunTime(),
  metrics.resultSize(),
  metrics.jvmGCTime(),
  metrics.resultSerializationTime(),
  metrics.memoryBytesSpilled(),
  metrics.diskBytesSpilled(),
  optionalInputMetric(metrics),
  optionalShuffleReadMetric(metrics),
  optionalShuffleWriteMetrics(metrics));
}

代码示例来源:origin: com.criteo.java/garmadon-frameworks-spark

tryToSet(() -> taskEventBuilder.setExecutorDeserializeTime(taskEnd.taskMetrics().executorDeserializeTime()));
tryToSet(() -> taskEventBuilder.setResultSerializationTime(taskEnd.taskMetrics().resultSerializationTime()));
tryToSet(() -> taskEventBuilder.setResultSize(taskEnd.taskMetrics().resultSize()));
tryToSet(() -> taskEventBuilder.setPeakExecutionMemory(taskEnd.taskMetrics().peakExecutionMemory()));
tryToSet(() -> taskEventBuilder.setDiskBytesSpilled(taskEnd.taskMetrics().diskBytesSpilled()));

代码示例来源:origin: com.criteo.java/garmadon-frameworks-spark

tryToSet(() -> stageEventBuilder.setExecutorDeserializeTime(stageCompleted.stageInfo().taskMetrics().executorDeserializeTime()));
tryToSet(() -> stageEventBuilder.setResultSerializationTime(stageCompleted.stageInfo().taskMetrics().resultSerializationTime()));
tryToSet(() -> stageEventBuilder.setResultSize(stageCompleted.stageInfo().taskMetrics().resultSize()));
tryToSet(() -> stageEventBuilder.setPeakExecutionMemory(stageCompleted.stageInfo().taskMetrics().peakExecutionMemory()));
tryToSet(() -> stageEventBuilder.setDiskBytesSpilled(stageCompleted.stageInfo().taskMetrics().diskBytesSpilled()));

相关文章