org.apache.hadoop.hive.ql.exec.Utilities.createCompressedStream()方法的使用及代码示例

x33g5p2x  于2022-02-01 转载在 其他  
字(3.4k)|赞(0)|评价(0)|浏览(72)

本文整理了Java中org.apache.hadoop.hive.ql.exec.Utilities.createCompressedStream()方法的一些代码示例,展示了Utilities.createCompressedStream()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Utilities.createCompressedStream()方法的具体详情如下:
包路径:org.apache.hadoop.hive.ql.exec.Utilities
类名称:Utilities
方法名:createCompressedStream

Utilities.createCompressedStream介绍

[英]Convert an output stream to a compressed output stream based on codecs and compression options specified in the Job Configuration.
[中]根据作业配置中指定的编解码器和压缩选项,将输出流转换为压缩输出流。

代码示例

代码示例来源:origin: apache/hive

/**
 * Convert an output stream to a compressed output stream based on codecs and compression options
 * specified in the Job Configuration.
 *
 * @param jc
 *          Job Configuration
 * @param out
 *          Output Stream to be converted into compressed output stream
 * @return compressed output stream
 */
public static OutputStream createCompressedStream(JobConf jc, OutputStream out)
  throws IOException {
 boolean isCompressed = FileOutputFormat.getCompressOutput(jc);
 return createCompressedStream(jc, out, isCompressed);
}

代码示例来源:origin: apache/drill

/**
 * Convert an output stream to a compressed output stream based on codecs and compression options
 * specified in the Job Configuration.
 *
 * @param jc
 *          Job Configuration
 * @param out
 *          Output Stream to be converted into compressed output stream
 * @return compressed output stream
 */
public static OutputStream createCompressedStream(JobConf jc, OutputStream out)
  throws IOException {
 boolean isCompressed = FileOutputFormat.getCompressOutput(jc);
 return createCompressedStream(jc, out, isCompressed);
}

代码示例来源:origin: apache/hive

boolean isCompressed, Properties tableProperties, Progressable progress) throws IOException {
FileSystem fs = outPath.getFileSystem(jc);
final OutputStream outStream = Utilities.createCompressedStream(jc, fs.create(outPath, progress), isCompressed);
return new RecordWriter() {
 @Override public void write(Writable r) throws IOException {

代码示例来源:origin: apache/hive

final OutputStream outStream = Utilities.createCompressedStream(jc,
fs.create(outPath, progress), isCompressed);
return new RecordWriter() {

代码示例来源:origin: apache/drill

final OutputStream outStream = Utilities.createCompressedStream(jc,
fs.create(outPath, progress), isCompressed);
return new RecordWriter() {

代码示例来源:origin: com.facebook.presto.hive/hive-apache

/**
 * Convert an output stream to a compressed output stream based on codecs and compression options
 * specified in the Job Configuration.
 *
 * @param jc
 *          Job Configuration
 * @param out
 *          Output Stream to be converted into compressed output stream
 * @return compressed output stream
 */
public static OutputStream createCompressedStream(JobConf jc, OutputStream out)
  throws IOException {
 boolean isCompressed = FileOutputFormat.getCompressOutput(jc);
 return createCompressedStream(jc, out, isCompressed);
}

代码示例来源:origin: org.apache.hadoop.hive/hive-exec

/**
 * Convert an output stream to a compressed output stream based on codecs and compression options
 * specified in the Job Configuration.
 *
 * @param jc
 *          Job Configuration
 * @param out
 *          Output Stream to be converted into compressed output stream
 * @return compressed output stream
 */
public static OutputStream createCompressedStream(JobConf jc, OutputStream out)
  throws IOException {
 boolean isCompressed = FileOutputFormat.getCompressOutput(jc);
 return createCompressedStream(jc, out, isCompressed);
}

代码示例来源:origin: org.apache.hadoop.hive/hive-exec

final OutputStream outStream = Utilities.createCompressedStream(jc, fs
  .create(outPath), isCompressed);
return new RecordWriter() {

代码示例来源:origin: com.facebook.presto.hive/hive-apache

final OutputStream outStream = Utilities.createCompressedStream(jc,
fs.create(outPath, progress), isCompressed);
return new RecordWriter() {

相关文章

微信公众号

最新文章

更多

Utilities类方法