本文整理了Java中org.apache.hadoop.hive.ql.io.orc.Reader.getCompression
方法的一些代码示例,展示了Reader.getCompression
的具体用法。这些代码示例主要来源于Github
/Stackoverflow
/Maven
等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Reader.getCompression
方法的具体详情如下:
包路径:org.apache.hadoop.hive.ql.io.orc.Reader
类名称:Reader
方法名:getCompression
[英]Get the Compression kind in the compatibility mode.
[中]在兼容模式下获取压缩类型。
代码示例来源:origin: apache/hive
Reader reader = OrcFile.createReader(outputFilePath,
OrcFile.readerOptions(conf).filesystem(localFs));
assertEquals(reader.getCompression(), CompressionKind.SNAPPY);
代码示例来源:origin: apache/hive
.compress(reader.getCompression())
.version(reader.getFileVersion())
.rowIndexStride(reader.getRowIndexStride())
.inspector(reader.getObjectInspector());
if (reader.getCompression() != org.apache.hadoop.hive.ql.io.orc.CompressionKind.NONE) {
writerOptions.bufferSize(reader.getCompressionSize()).enforceBufferSize();
代码示例来源:origin: apache/hive
@Test
public void emptyFile() throws Exception {
ObjectInspector inspector;
synchronized (TestOrcFile.class) {
inspector = ObjectInspectorFactory.getReflectionObjectInspector
(BigRow.class, ObjectInspectorFactory.ObjectInspectorOptions.JAVA);
}
Writer writer = OrcFile.createWriter(testFilePath,
OrcFile.writerOptions(conf)
.inspector(inspector)
.stripeSize(1000)
.compress(CompressionKind.NONE)
.bufferSize(100));
writer.close();
Reader reader = OrcFile.createReader(testFilePath,
OrcFile.readerOptions(conf).filesystem(fs));
assertEquals(false, reader.rows().hasNext());
assertEquals(CompressionKind.NONE, reader.getCompression());
assertEquals(0, reader.getNumberOfRows());
assertEquals(0, reader.getCompressionSize());
assertEquals(false, reader.getMetadataKeys().iterator().hasNext());
assertEquals(3, reader.getContentLength());
assertEquals(false, reader.getStripes().iterator().hasNext());
}
代码示例来源:origin: apache/hive
OrcFile.readerOptions(conf).filesystem(localFs));
assertTrue(reader.getNumberOfRows() == rownum);
assertEquals(reader.getCompression(), CompressionKind.ZLIB);
StructObjectInspector soi =
(StructObjectInspector)reader.getObjectInspector();
代码示例来源:origin: com.facebook.presto.hive/hive-apache
RecordReaderImpl rows = (RecordReaderImpl) reader.rows();
System.out.println("Rows: " + reader.getNumberOfRows());
System.out.println("Compression: " + reader.getCompression());
if (reader.getCompression() != CompressionKind.NONE) {
System.out.println("Compression size: " + reader.getCompressionSize());
代码示例来源:origin: com.facebook.presto/presto-raptor
.memory(new NullMemoryManager(CONFIGURATION))
.fileSystem(fileSystem)
.compress(reader.getCompression())
.inspector(reader.getObjectInspector());
代码示例来源:origin: com.facebook.presto.hive/hive-apache
keyWrapper.setCompression(reader.getCompression());
keyWrapper.setCompressBufferSize(reader.getCompressionSize());
keyWrapper.setVersion(reader.getFileVersion());
代码示例来源:origin: prestosql/presto
.memory(new NullMemoryManager())
.fileSystem(fileSystem)
.compress(reader.getCompression())
.inspector(reader.getObjectInspector());
内容来源于网络,如有侵权,请联系作者删除!