org.apache.hadoop.hive.ql.io.orc.Reader.getCompressionSize()方法的使用及代码示例

x33g5p2x  于2022-01-29 转载在 其他  
字(2.2k)|赞(0)|评价(0)|浏览(105)

本文整理了Java中org.apache.hadoop.hive.ql.io.orc.Reader.getCompressionSize方法的一些代码示例,展示了Reader.getCompressionSize的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Reader.getCompressionSize方法的具体详情如下:
包路径:org.apache.hadoop.hive.ql.io.orc.Reader
类名称:Reader
方法名:getCompressionSize

Reader.getCompressionSize介绍

[英]Get the buffer size for the compression.
[中]获取压缩的缓冲区大小。

代码示例

代码示例来源:origin: apache/hive

writerOptions.bufferSize(reader.getCompressionSize()).enforceBufferSize();

代码示例来源:origin: apache/hive

keyWrapper.setCompressBufferSize(reader.getCompressionSize());
keyWrapper.setFileVersion(reader.getFileVersion());
keyWrapper.setWriterVersion(reader.getWriterVersion());

代码示例来源:origin: apache/drill

keyWrapper.setCompressBufferSize(reader.getCompressionSize());
keyWrapper.setVersion(reader.getFileVersion());
keyWrapper.setRowIndexStride(reader.getRowIndexStride());

代码示例来源:origin: apache/hive

@Test
public void emptyFile() throws Exception {
 ObjectInspector inspector;
 synchronized (TestOrcFile.class) {
  inspector = ObjectInspectorFactory.getReflectionObjectInspector
    (BigRow.class, ObjectInspectorFactory.ObjectInspectorOptions.JAVA);
 }
 Writer writer = OrcFile.createWriter(testFilePath,
                    OrcFile.writerOptions(conf)
                    .inspector(inspector)
                    .stripeSize(1000)
                    .compress(CompressionKind.NONE)
                    .bufferSize(100));
 writer.close();
 Reader reader = OrcFile.createReader(testFilePath,
   OrcFile.readerOptions(conf).filesystem(fs));
 assertEquals(false, reader.rows().hasNext());
 assertEquals(CompressionKind.NONE, reader.getCompression());
 assertEquals(0, reader.getNumberOfRows());
 assertEquals(0, reader.getCompressionSize());
 assertEquals(false, reader.getMetadataKeys().iterator().hasNext());
 assertEquals(3, reader.getContentLength());
 assertEquals(false, reader.getStripes().iterator().hasNext());
}

代码示例来源:origin: com.facebook.presto.hive/hive-apache

System.out.println("Compression: " + reader.getCompression());
if (reader.getCompression() != CompressionKind.NONE) {
 System.out.println("Compression size: " + reader.getCompressionSize());

代码示例来源:origin: com.facebook.presto.hive/hive-apache

keyWrapper.setCompressBufferSize(reader.getCompressionSize());
keyWrapper.setVersion(reader.getFileVersion());
keyWrapper.setRowIndexStride(reader.getRowIndexStride());

相关文章