本文整理了Java中org.apache.hadoop.hive.ql.io.orc.Reader.getCompressionSize
方法的一些代码示例,展示了Reader.getCompressionSize
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Reader.getCompressionSize
方法的具体详情如下:
包路径:org.apache.hadoop.hive.ql.io.orc.Reader
类名称:Reader
方法名:getCompressionSize
[英]Get the buffer size for the compression.
[中]获取压缩的缓冲区大小。
代码示例来源:origin: apache/hive
writerOptions.bufferSize(reader.getCompressionSize()).enforceBufferSize();
代码示例来源:origin: apache/hive
keyWrapper.setCompressBufferSize(reader.getCompressionSize());
keyWrapper.setFileVersion(reader.getFileVersion());
keyWrapper.setWriterVersion(reader.getWriterVersion());
代码示例来源:origin: apache/drill
keyWrapper.setCompressBufferSize(reader.getCompressionSize());
keyWrapper.setVersion(reader.getFileVersion());
keyWrapper.setRowIndexStride(reader.getRowIndexStride());
代码示例来源:origin: apache/hive
@Test
public void emptyFile() throws Exception {
ObjectInspector inspector;
synchronized (TestOrcFile.class) {
inspector = ObjectInspectorFactory.getReflectionObjectInspector
(BigRow.class, ObjectInspectorFactory.ObjectInspectorOptions.JAVA);
}
Writer writer = OrcFile.createWriter(testFilePath,
OrcFile.writerOptions(conf)
.inspector(inspector)
.stripeSize(1000)
.compress(CompressionKind.NONE)
.bufferSize(100));
writer.close();
Reader reader = OrcFile.createReader(testFilePath,
OrcFile.readerOptions(conf).filesystem(fs));
assertEquals(false, reader.rows().hasNext());
assertEquals(CompressionKind.NONE, reader.getCompression());
assertEquals(0, reader.getNumberOfRows());
assertEquals(0, reader.getCompressionSize());
assertEquals(false, reader.getMetadataKeys().iterator().hasNext());
assertEquals(3, reader.getContentLength());
assertEquals(false, reader.getStripes().iterator().hasNext());
}
代码示例来源:origin: com.facebook.presto.hive/hive-apache
System.out.println("Compression: " + reader.getCompression());
if (reader.getCompression() != CompressionKind.NONE) {
System.out.println("Compression size: " + reader.getCompressionSize());
代码示例来源:origin: com.facebook.presto.hive/hive-apache
keyWrapper.setCompressBufferSize(reader.getCompressionSize());
keyWrapper.setVersion(reader.getFileVersion());
keyWrapper.setRowIndexStride(reader.getRowIndexStride());
内容来源于网络,如有侵权,请联系作者删除!