本文整理了Java中org.apache.hadoop.hive.ql.exec.Utilities.createCompressedStream()
方法的一些代码示例,展示了Utilities.createCompressedStream()
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Utilities.createCompressedStream()
方法的具体详情如下:
包路径:org.apache.hadoop.hive.ql.exec.Utilities
类名称:Utilities
方法名:createCompressedStream
[英]Convert an output stream to a compressed output stream based on codecs and compression options specified in the Job Configuration.
[中]根据作业配置中指定的编解码器和压缩选项,将输出流转换为压缩输出流。
代码示例来源:origin: apache/hive
/**
* Convert an output stream to a compressed output stream based on codecs and compression options
* specified in the Job Configuration.
*
* @param jc
* Job Configuration
* @param out
* Output Stream to be converted into compressed output stream
* @return compressed output stream
*/
public static OutputStream createCompressedStream(JobConf jc, OutputStream out)
throws IOException {
boolean isCompressed = FileOutputFormat.getCompressOutput(jc);
return createCompressedStream(jc, out, isCompressed);
}
代码示例来源:origin: apache/drill
/**
* Convert an output stream to a compressed output stream based on codecs and compression options
* specified in the Job Configuration.
*
* @param jc
* Job Configuration
* @param out
* Output Stream to be converted into compressed output stream
* @return compressed output stream
*/
public static OutputStream createCompressedStream(JobConf jc, OutputStream out)
throws IOException {
boolean isCompressed = FileOutputFormat.getCompressOutput(jc);
return createCompressedStream(jc, out, isCompressed);
}
代码示例来源:origin: apache/hive
boolean isCompressed, Properties tableProperties, Progressable progress) throws IOException {
FileSystem fs = outPath.getFileSystem(jc);
final OutputStream outStream = Utilities.createCompressedStream(jc, fs.create(outPath, progress), isCompressed);
return new RecordWriter() {
@Override public void write(Writable r) throws IOException {
代码示例来源:origin: apache/hive
final OutputStream outStream = Utilities.createCompressedStream(jc,
fs.create(outPath, progress), isCompressed);
return new RecordWriter() {
代码示例来源:origin: apache/drill
final OutputStream outStream = Utilities.createCompressedStream(jc,
fs.create(outPath, progress), isCompressed);
return new RecordWriter() {
代码示例来源:origin: com.facebook.presto.hive/hive-apache
/**
* Convert an output stream to a compressed output stream based on codecs and compression options
* specified in the Job Configuration.
*
* @param jc
* Job Configuration
* @param out
* Output Stream to be converted into compressed output stream
* @return compressed output stream
*/
public static OutputStream createCompressedStream(JobConf jc, OutputStream out)
throws IOException {
boolean isCompressed = FileOutputFormat.getCompressOutput(jc);
return createCompressedStream(jc, out, isCompressed);
}
代码示例来源:origin: org.apache.hadoop.hive/hive-exec
/**
* Convert an output stream to a compressed output stream based on codecs and compression options
* specified in the Job Configuration.
*
* @param jc
* Job Configuration
* @param out
* Output Stream to be converted into compressed output stream
* @return compressed output stream
*/
public static OutputStream createCompressedStream(JobConf jc, OutputStream out)
throws IOException {
boolean isCompressed = FileOutputFormat.getCompressOutput(jc);
return createCompressedStream(jc, out, isCompressed);
}
代码示例来源:origin: org.apache.hadoop.hive/hive-exec
final OutputStream outStream = Utilities.createCompressedStream(jc, fs
.create(outPath), isCompressed);
return new RecordWriter() {
代码示例来源:origin: com.facebook.presto.hive/hive-apache
final OutputStream outStream = Utilities.createCompressedStream(jc,
fs.create(outPath, progress), isCompressed);
return new RecordWriter() {
内容来源于网络,如有侵权,请联系作者删除!