org.apache.hadoop.mapred.Task.calculateOutputSize()方法的使用及代码示例

x33g5p2x  于2022-01-30 转载在 其他  
字(2.2k)|赞(0)|评价(0)|浏览(91)

本文整理了Java中org.apache.hadoop.mapred.Task.calculateOutputSize()方法的一些代码示例,展示了Task.calculateOutputSize()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Task.calculateOutputSize()方法的具体详情如下:
包路径:org.apache.hadoop.mapred.Task
类名称:Task
方法名:calculateOutputSize

Task.calculateOutputSize介绍

[英]Calculates the size of output for this task.
[中]

代码示例

代码示例来源:origin: ch.cern.hadoop/hadoop-mapreduce-client-core

/**
 * Sends last status update before sending umbilical.done(); 
 */
private void sendLastUpdate(TaskUmbilicalProtocol umbilical) 
throws IOException {
 taskStatus.setOutputSize(calculateOutputSize());
 // send a final status report
 taskStatus.statusUpdate(taskProgress.get(),
             taskProgress.toString(), 
             counters);
 statusUpdate(umbilical);
}

代码示例来源:origin: io.hops/hadoop-mapreduce-client-core

/**
 * Sends last status update before sending umbilical.done(); 
 */
private void sendLastUpdate(TaskUmbilicalProtocol umbilical) 
throws IOException {
 taskStatus.setOutputSize(calculateOutputSize());
 // send a final status report
 taskStatus.statusUpdate(taskProgress.get(),
             taskProgress.toString(), 
             counters);
 statusUpdate(umbilical);
}

代码示例来源:origin: com.github.jiayuhan-it/hadoop-mapreduce-client-core

/**
 * Sends last status update before sending umbilical.done(); 
 */
private void sendLastUpdate(TaskUmbilicalProtocol umbilical) 
throws IOException {
 taskStatus.setOutputSize(calculateOutputSize());
 // send a final status report
 taskStatus.statusUpdate(taskProgress.get(),
             taskProgress.toString(), 
             counters);
 statusUpdate(umbilical);
}

代码示例来源:origin: org.apache.hadoop/hadoop-mapred

/**
 * Sends last status update before sending umbilical.done(); 
 */
private void sendLastUpdate(TaskUmbilicalProtocol umbilical) 
throws IOException {
 taskStatus.setOutputSize(calculateOutputSize());
 // send a final status report
 taskStatus.statusUpdate(taskProgress.get(),
             taskProgress.toString(), 
             counters);
 statusUpdate(umbilical);
}

代码示例来源:origin: io.prestosql.hadoop/hadoop-apache

/**
 * Sends last status update before sending umbilical.done(); 
 */
private void sendLastUpdate(TaskUmbilicalProtocol umbilical) 
throws IOException {
 taskStatus.setOutputSize(calculateOutputSize());
 // send a final status report
 taskStatus.statusUpdate(taskProgress.get(),
             taskProgress.toString(), 
             counters);
 statusUpdate(umbilical);
}

相关文章

微信公众号

最新文章

更多