org.apache.spark.executor.TaskMetrics.executorRunTime()方法的使用及代码示例

x33g5p2x  于2022-01-30 转载在 其他  
字(3.3k)|赞(0)|评价(0)|浏览(86)

本文整理了Java中org.apache.spark.executor.TaskMetrics.executorRunTime()方法的一些代码示例,展示了TaskMetrics.executorRunTime()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。TaskMetrics.executorRunTime()方法的具体详情如下:
包路径:org.apache.spark.executor.TaskMetrics
类名称:TaskMetrics
方法名:executorRunTime

TaskMetrics.executorRunTime介绍

暂无

代码示例

代码示例来源:origin: apache/hive

public Metrics(TaskMetrics metrics, TaskInfo taskInfo) {
 this(
  metrics.executorDeserializeTime(),
  TimeUnit.NANOSECONDS.toMillis(metrics.executorDeserializeCpuTime()),
  metrics.executorRunTime(),
  TimeUnit.NANOSECONDS.toMillis(metrics.executorCpuTime()),
  metrics.resultSize(),
  metrics.jvmGCTime(),
  metrics.resultSerializationTime(),
  metrics.memoryBytesSpilled(),
  metrics.diskBytesSpilled(),
  taskInfo.duration(),
  optionalInputMetric(metrics),
  optionalShuffleReadMetric(metrics),
  optionalShuffleWriteMetrics(metrics),
  optionalOutputMetrics(metrics));
}

代码示例来源:origin: com.facebook.presto.hive/hive-apache

if (taskMetrics != null) {
 executorDeserializeTime += taskMetrics.executorDeserializeTime();
 executorRunTime += taskMetrics.executorRunTime();
 resultSize += taskMetrics.resultSize();
 jvmGCTime += taskMetrics.jvmGCTime();

代码示例来源:origin: org.apache.pig/pig

if (taskMetrics != null) {
  executorDeserializeTime += taskMetrics.executorDeserializeTime();
  executorRunTime += taskMetrics.executorRunTime();
  resultSize += taskMetrics.resultSize();
  jvmGCTime += taskMetrics.jvmGCTime();

代码示例来源:origin: com.github.hyukjinkwon/spark-client

public Metrics(TaskMetrics metrics) {
 this(
  metrics.executorDeserializeTime(),
  metrics.executorRunTime(),
  metrics.resultSize(),
  metrics.jvmGCTime(),
  metrics.resultSerializationTime(),
  metrics.memoryBytesSpilled(),
  metrics.diskBytesSpilled(),
  optionalInputMetric(metrics),
  optionalShuffleReadMetric(metrics),
  optionalShuffleWriteMetrics(metrics));
}

代码示例来源:origin: org.spark-project.hive/spark-client

public Metrics(TaskMetrics metrics) {
 this(
  metrics.executorDeserializeTime(),
  metrics.executorRunTime(),
  metrics.resultSize(),
  metrics.jvmGCTime(),
  metrics.resultSerializationTime(),
  metrics.memoryBytesSpilled(),
  metrics.diskBytesSpilled(),
  optionalInputMetric(metrics),
  optionalShuffleReadMetric(metrics),
  optionalShuffleWriteMetrics(metrics));
}

代码示例来源:origin: com.criteo.java/garmadon-frameworks-spark

tryToSet(() -> taskEventBuilder.setExecutorCpuTime(taskEnd.taskMetrics().executorCpuTime()));
tryToSet(() -> taskEventBuilder.setExecutorDeserializeCpuTime(taskEnd.taskMetrics().executorDeserializeCpuTime()));
tryToSet(() -> taskEventBuilder.setExecutorRunTime(taskEnd.taskMetrics().executorRunTime()));
tryToSet(() -> taskEventBuilder.setJvmGcTime(taskEnd.taskMetrics().jvmGCTime()));
tryToSet(() -> taskEventBuilder.setExecutorDeserializeTime(taskEnd.taskMetrics().executorDeserializeTime()));

代码示例来源:origin: com.criteo.java/garmadon-frameworks-spark

tryToSet(() -> stageEventBuilder.setExecutorCpuTime(stageCompleted.stageInfo().taskMetrics().executorCpuTime()));
tryToSet(() -> stageEventBuilder.setExecutorDeserializeCpuTime(stageCompleted.stageInfo().taskMetrics().executorDeserializeCpuTime()));
tryToSet(() -> stageEventBuilder.setExecutorRunTime(stageCompleted.stageInfo().taskMetrics().executorRunTime()));
tryToSet(() -> stageEventBuilder.setJvmGcTime(stageCompleted.stageInfo().taskMetrics().jvmGCTime()));
tryToSet(() -> stageEventBuilder.setExecutorDeserializeTime(stageCompleted.stageInfo().taskMetrics().executorDeserializeTime()));

相关文章