本文整理了Java中org.apache.spark.executor.TaskMetrics.shuffleReadMetrics()方法的一些代码示例，展示了TaskMetrics.shuffleReadMetrics()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。TaskMetrics.shuffleReadMetrics()方法的具体详情如下：
包路径：org.apache.spark.executor.TaskMetrics
类名称：TaskMetrics
方法名：shuffleReadMetrics

TaskMetrics.shuffleReadMetrics介绍

暂无

代码示例

代码示例来源：origin: apache/hive

public ShuffleReadMetrics(TaskMetrics metrics) {
 this(metrics.shuffleReadMetrics().remoteBlocksFetched(),
  metrics.shuffleReadMetrics().localBlocksFetched(),
  metrics.shuffleReadMetrics().fetchWaitTime(),
  metrics.shuffleReadMetrics().remoteBytesRead(),
  metrics.shuffleReadMetrics().localBytesRead(),
  metrics.shuffleReadMetrics().remoteBytesReadToDisk(),
  metrics.shuffleReadMetrics().recordsRead());
}

代码示例来源：origin: apache/hive

private static ShuffleReadMetrics optionalShuffleReadMetric(TaskMetrics metrics) {
 return (metrics.shuffleReadMetrics() != null) ? new ShuffleReadMetrics(metrics) : null;
}

代码示例来源：origin: com.github.hyukjinkwon/spark-client

public ShuffleReadMetrics(TaskMetrics metrics) {
 this(metrics.shuffleReadMetrics().get().remoteBlocksFetched(),
  metrics.shuffleReadMetrics().get().localBlocksFetched(),
  metrics.shuffleReadMetrics().get().fetchWaitTime(),
  metrics.shuffleReadMetrics().get().remoteBytesRead());
}

代码示例来源：origin: org.spark-project.hive/spark-client

public ShuffleReadMetrics(TaskMetrics metrics) {
 this(metrics.shuffleReadMetrics().get().remoteBlocksFetched(),
  metrics.shuffleReadMetrics().get().localBlocksFetched(),
  metrics.shuffleReadMetrics().get().fetchWaitTime(),
  metrics.shuffleReadMetrics().get().remoteBytesRead());
}

代码示例来源：origin: com.github.hyukjinkwon/spark-client

private static ShuffleReadMetrics optionalShuffleReadMetric(TaskMetrics metrics) {
 return metrics.shuffleReadMetrics().isDefined() ? new ShuffleReadMetrics(metrics) : null;
}

代码示例来源：origin: org.spark-project.hive/spark-client

private static ShuffleReadMetrics optionalShuffleReadMetric(TaskMetrics metrics) {
 return metrics.shuffleReadMetrics().isDefined() ? new ShuffleReadMetrics(metrics) : null;
}

代码示例来源：origin: com.facebook.presto.hive/hive-apache

bytesRead += taskMetrics.inputMetrics().get().bytesRead();
Option<ShuffleReadMetrics> shuffleReadMetricsOption = taskMetrics.shuffleReadMetrics();
if (!shuffleReadMetricsOption.isEmpty()) {
 shuffleReadMetricExist = true;

代码示例来源：origin: org.apache.pig/pig

Option<ShuffleReadMetrics> shuffleReadMetricsOption = taskMetrics.shuffleReadMetrics();
if (!shuffleReadMetricsOption.isEmpty()) {
  shuffleReadMetricExist = true;

代码示例来源：origin: com.criteo.java/garmadon-frameworks-spark

tryToSet(() -> taskEventBuilder.setDiskBytesSpilled(taskEnd.taskMetrics().diskBytesSpilled()));
tryToSet(() -> taskEventBuilder.setMemoryBytesSpilled(taskEnd.taskMetrics().memoryBytesSpilled()));
tryToSet(() -> taskEventBuilder.setShuffleReadRecords(taskEnd.taskMetrics().shuffleReadMetrics().recordsRead()));
tryToSet(() -> taskEventBuilder.setShuffleReadFetchWaitTime(taskEnd.taskMetrics().shuffleReadMetrics().fetchWaitTime()));
tryToSet(() -> taskEventBuilder.setShuffleReadLocalBytes(taskEnd.taskMetrics().shuffleReadMetrics().localBytesRead()));
tryToSet(() -> taskEventBuilder.setShuffleReadRemoteBytes(taskEnd.taskMetrics().shuffleReadMetrics().remoteBytesRead()));
tryToSet(() -> taskEventBuilder.setShuffleReadTotalBytes(taskEnd.taskMetrics().shuffleReadMetrics().totalBytesRead()));
tryToSet(() -> taskEventBuilder.setShuffleReadLocalBlocksFetched(taskEnd.taskMetrics().shuffleReadMetrics().localBlocksFetched()));
tryToSet(() -> taskEventBuilder.setShuffleReadRemoteBlocksFetched(taskEnd.taskMetrics().shuffleReadMetrics().remoteBlocksFetched()));
tryToSet(() -> taskEventBuilder.setShuffleReadTotalBlocksFetched(taskEnd.taskMetrics().shuffleReadMetrics().totalBlocksFetched()));
tryToSet(() -> taskEventBuilder.setShuffleWriteShuffleRecords(taskEnd.taskMetrics().shuffleWriteMetrics().shuffleRecordsWritten()));
tryToSet(() -> taskEventBuilder.setShuffleWriteShuffleTime(taskEnd.taskMetrics().shuffleWriteMetrics().shuffleWriteTime()));

代码示例来源：origin: com.criteo.java/garmadon-frameworks-spark

tryToSet(() -> stageEventBuilder.setDiskBytesSpilled(stageCompleted.stageInfo().taskMetrics().diskBytesSpilled()));
tryToSet(() -> stageEventBuilder.setMemoryBytesSpilled(stageCompleted.stageInfo().taskMetrics().memoryBytesSpilled()));
tryToSet(() -> stageEventBuilder.setShuffleReadRecords(stageCompleted.stageInfo().taskMetrics().shuffleReadMetrics().recordsRead()));
tryToSet(() -> stageEventBuilder.setShuffleReadFetchWaitTime(stageCompleted.stageInfo().taskMetrics().shuffleReadMetrics().fetchWaitTime()));
tryToSet(() -> stageEventBuilder.setShuffleReadLocalBytes(stageCompleted.stageInfo().taskMetrics().shuffleReadMetrics().localBytesRead()));
tryToSet(() -> stageEventBuilder.setShuffleReadRemoteBytes(stageCompleted.stageInfo().taskMetrics().shuffleReadMetrics().remoteBytesRead()));
tryToSet(() -> stageEventBuilder.setShuffleReadTotalBytes(stageCompleted.stageInfo().taskMetrics().shuffleReadMetrics().totalBytesRead()));
tryToSet(() -> stageEventBuilder.setShuffleReadLocalBlocksFetched(stageCompleted.stageInfo().taskMetrics().shuffleReadMetrics()
    .localBlocksFetched()));
tryToSet(() -> stageEventBuilder.setShuffleReadRemoteBlocksFetched(stageCompleted.stageInfo().taskMetrics().shuffleReadMetrics()
    .remoteBlocksFetched()));
tryToSet(() -> stageEventBuilder.setShuffleReadTotalBlocksFetched(stageCompleted.stageInfo().taskMetrics().shuffleReadMetrics()
    .totalBlocksFetched()));
tryToSet(() -> stageEventBuilder.setShuffleWriteShuffleRecords(stageCompleted.stageInfo().taskMetrics().shuffleWriteMetrics()