org.apache.hadoop.hive.ql.io.orc.Reader.getCompression()方法的使用及代码示例

x33g5p2x  于2022-01-29 转载在 其他  
字(2.9k)|赞(0)|评价(0)|浏览(112)

本文整理了Java中org.apache.hadoop.hive.ql.io.orc.Reader.getCompression方法的一些代码示例,展示了Reader.getCompression的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Reader.getCompression方法的具体详情如下:
包路径:org.apache.hadoop.hive.ql.io.orc.Reader
类名称:Reader
方法名:getCompression

Reader.getCompression介绍

[英]Get the Compression kind in the compatibility mode.
[中]在兼容模式下获取压缩类型。

代码示例

代码示例来源:origin: apache/hive

Reader reader = OrcFile.createReader(outputFilePath,
  OrcFile.readerOptions(conf).filesystem(localFs));
assertEquals(reader.getCompression(), CompressionKind.SNAPPY);

代码示例来源:origin: apache/hive

.compress(reader.getCompression())
  .version(reader.getFileVersion())
  .rowIndexStride(reader.getRowIndexStride())
  .inspector(reader.getObjectInspector());
if (reader.getCompression() != org.apache.hadoop.hive.ql.io.orc.CompressionKind.NONE) {
 writerOptions.bufferSize(reader.getCompressionSize()).enforceBufferSize();

代码示例来源:origin: apache/hive

@Test
public void emptyFile() throws Exception {
 ObjectInspector inspector;
 synchronized (TestOrcFile.class) {
  inspector = ObjectInspectorFactory.getReflectionObjectInspector
    (BigRow.class, ObjectInspectorFactory.ObjectInspectorOptions.JAVA);
 }
 Writer writer = OrcFile.createWriter(testFilePath,
                    OrcFile.writerOptions(conf)
                    .inspector(inspector)
                    .stripeSize(1000)
                    .compress(CompressionKind.NONE)
                    .bufferSize(100));
 writer.close();
 Reader reader = OrcFile.createReader(testFilePath,
   OrcFile.readerOptions(conf).filesystem(fs));
 assertEquals(false, reader.rows().hasNext());
 assertEquals(CompressionKind.NONE, reader.getCompression());
 assertEquals(0, reader.getNumberOfRows());
 assertEquals(0, reader.getCompressionSize());
 assertEquals(false, reader.getMetadataKeys().iterator().hasNext());
 assertEquals(3, reader.getContentLength());
 assertEquals(false, reader.getStripes().iterator().hasNext());
}

代码示例来源:origin: apache/hive

OrcFile.readerOptions(conf).filesystem(localFs));
assertTrue(reader.getNumberOfRows() == rownum);
assertEquals(reader.getCompression(), CompressionKind.ZLIB);
StructObjectInspector soi =
  (StructObjectInspector)reader.getObjectInspector();

代码示例来源:origin: com.facebook.presto.hive/hive-apache

RecordReaderImpl rows = (RecordReaderImpl) reader.rows();
System.out.println("Rows: " + reader.getNumberOfRows());
System.out.println("Compression: " + reader.getCompression());
if (reader.getCompression() != CompressionKind.NONE) {
 System.out.println("Compression size: " + reader.getCompressionSize());

代码示例来源:origin: com.facebook.presto/presto-raptor

.memory(new NullMemoryManager(CONFIGURATION))
.fileSystem(fileSystem)
.compress(reader.getCompression())
.inspector(reader.getObjectInspector());

代码示例来源:origin: com.facebook.presto.hive/hive-apache

keyWrapper.setCompression(reader.getCompression());
keyWrapper.setCompressBufferSize(reader.getCompressionSize());
keyWrapper.setVersion(reader.getFileVersion());

代码示例来源:origin: prestosql/presto

.memory(new NullMemoryManager())
.fileSystem(fileSystem)
.compress(reader.getCompression())
.inspector(reader.getObjectInspector());

相关文章