cascading.flow.Flow.resourceExists()方法的使用及代码示例

x33g5p2x  于2022-01-19 转载在 其他  
字(13.2k)|赞(0)|评价(0)|浏览(112)

本文整理了Java中cascading.flow.Flow.resourceExists()方法的一些代码示例，展示了Flow.resourceExists()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。Flow.resourceExists()方法的具体详情如下：
包路径：cascading.flow.Flow
类名称：Flow
方法名：resourceExists

Flow.resourceExists介绍

[英]Method resourceExists returns true if the resource represented by the given Tap instance exists.
[中]如果给定Tap实例表示的资源存在，则resourceExists方法返回true。

代码示例

代码示例来源：origin: cwensel/cascading

@Test
public void testSourceConfInit() throws IOException
 {
 getPlatform().copyFromLocal( inputFileNums20 );
 Scheme scheme = new SchemeWithProperties( new Fields( "line" ) );
 Tap source = getPlatform().getTap( scheme, inputFileNums20, SinkMode.KEEP );
 Pipe pipe = new Pipe( "test" );
 Tap sink = getPlatform().getTextFile( getOutputPath( "sourceconfinit" ), SinkMode.REPLACE );
 Properties properties = new Properties();
 properties.setProperty( "default", "connector-default" );
 properties.setProperty( "replace", "connector-replace" );
 Flow flow = getPlatform().getFlowConnector( properties ).connect( source, sink, pipe );
 flow.complete();
 assertTrue( flow.resourceExists( sink ) );
 }

代码示例来源：origin: cwensel/cascading

@Test
public void testSinkConfInit() throws IOException
 {
 getPlatform().copyFromLocal( inputFileNums20 );
 Tap source = getPlatform().getTextFile( new Fields( "line" ), inputFileNums20, SinkMode.KEEP );
 Pipe pipe = new Pipe( "test" );
 Scheme scheme = new SchemeWithProperties( new Fields( "line" ) );
 Tap sink = getPlatform().getTap( scheme, getOutputPath( "sinkconfinit" ), SinkMode.REPLACE );
 Properties properties = new Properties();
 properties.setProperty( "default", "connector-default" );
 properties.setProperty( "replace", "connector-replace" );
 Flow flow = getPlatform().getFlowConnector( properties ).connect( source, sink, pipe );
 flow.complete();
 assertTrue( flow.resourceExists( sink ) );
 }

代码示例来源：origin: cwensel/cascading

@Test
public void testSubAssemblyConfigDef() throws IOException
 {
 getPlatform().copyFromLocal( inputFileNums20 );
 Tap source = getPlatform().getTextFile( new Fields( "line" ), inputFileNums20 );
 Pipe pipe = new Pipe( "test" );
 pipe = new ConfigSubAssembly( pipe, getPlatform().isDAG() );
 pipe.getConfigDef().setProperty( Mode.DEFAULT, "default", "pipe-default" );
 // steps on above value
 pipe.getStepConfigDef().setProperty( Mode.DEFAULT, "default", "process-default" );
 pipe.getConfigDef().setProperty( Mode.DEFAULT, "replace", "pipe-default" );
 pipe.getConfigDef().setProperty( Mode.REPLACE, "replace", "pipe-replace" );
 pipe.getNodeConfigDef().setProperty( Mode.REPLACE, "default-node", "node-replace" );
 pipe.getStepConfigDef().setProperty( Mode.DEFAULT, "replace", "process-default" );
 pipe.getStepConfigDef().setProperty( Mode.REPLACE, "replace", "process-replace" );
 pipe.getStepConfigDef().setProperty( Mode.DEFAULT, "default-node", "process-default" );
 Tap sink = getPlatform().getTextFile( getOutputPath( "subassembly-configdef" ), SinkMode.REPLACE );
 Flow flow = getPlatform().getFlowConnector().connect( source, sink, pipe );
 flow.complete();
 assertTrue( flow.resourceExists( sink ) );
 }
}

代码示例来源：origin: cascading/cascading-platform

@Test
public void testSubAssemblyConfigDef() throws IOException
 {
 getPlatform().copyFromLocal( inputFileNums20 );
 Tap source = getPlatform().getTextFile( new Fields( "line" ), inputFileNums20 );
 Pipe pipe = new Pipe( "test" );
 pipe = new ConfigSubAssembly( pipe, getPlatform().isDAG() );
 pipe.getConfigDef().setProperty( Mode.DEFAULT, "default", "pipe-default" );
 // steps on above value
 pipe.getStepConfigDef().setProperty( Mode.DEFAULT, "default", "process-default" );
 pipe.getConfigDef().setProperty( Mode.DEFAULT, "replace", "pipe-default" );
 pipe.getConfigDef().setProperty( Mode.REPLACE, "replace", "pipe-replace" );
 pipe.getNodeConfigDef().setProperty( Mode.REPLACE, "default-node", "node-replace" );
 pipe.getStepConfigDef().setProperty( Mode.DEFAULT, "replace", "process-default" );
 pipe.getStepConfigDef().setProperty( Mode.REPLACE, "replace", "process-replace" );
 pipe.getStepConfigDef().setProperty( Mode.DEFAULT, "default-node", "process-default" );
 Tap sink = getPlatform().getTextFile( getOutputPath( "subassembly-configdef" ), SinkMode.REPLACE );
 Flow flow = getPlatform().getFlowConnector().connect( source, sink, pipe );
 flow.complete();
 assertTrue( flow.resourceExists( sink ) );
 }
}

代码示例来源：origin: cwensel/cascading

@Test
public void testPipeConfigDef() throws IOException
 {
 getPlatform().copyFromLocal( inputFileNums20 );
 Tap source = getPlatform().getTextFile( new Fields( "line" ), inputFileNums20 );
 Pipe pipe = new Pipe( "test" );
 pipe = new Each( pipe, new IterateInsert( new Fields( "value" ), getPlatform().isDAG() ), Fields.ALL );
 pipe.getConfigDef().setProperty( Mode.DEFAULT, "default", "pipe-default" );
 // steps on above value
 pipe.getStepConfigDef().setProperty( Mode.DEFAULT, "default", "process-default" );
 pipe.getConfigDef().setProperty( Mode.DEFAULT, "replace", "pipe-default" );
 pipe.getConfigDef().setProperty( Mode.REPLACE, "replace", "pipe-replace" );
 pipe.getNodeConfigDef().setProperty( Mode.REPLACE, "default-node", "node-replace" );
 pipe.getStepConfigDef().setProperty( Mode.DEFAULT, "replace", "process-default" );
 pipe.getStepConfigDef().setProperty( Mode.REPLACE, "replace", "process-replace" );
 pipe.getStepConfigDef().setProperty( Mode.DEFAULT, "default-node", "process-default" );
 Tap sink = getPlatform().getTextFile( getOutputPath( "configdef" ), SinkMode.REPLACE );
 Flow flow = getPlatform().getFlowConnector().connect( source, sink, pipe );
 flow.complete();
 assertTrue( flow.resourceExists( sink ) );
 }

代码示例来源：origin: cascading/cascading-platform

@Test
public void testTapSourceConfigDef() throws IOException
 {
 getPlatform().copyFromLocal( inputFileNums20 );
 Scheme scheme = getPlatform().getTestConfigDefScheme();
 Tap source = getPlatform().getTap( scheme, inputFileNums20, SinkMode.KEEP );
 // process -> after sink/sourceConfInit are called
 // default -> Wrapper for all cluster side calls
 source.getConfigDef().setProperty( Mode.DEFAULT, "default", "source-default" );
 // steps on above value
 source.getStepConfigDef().setProperty( Mode.DEFAULT, "default", "process-default" );
 source.getConfigDef().setProperty( Mode.DEFAULT, "replace", "source-default" );
 source.getConfigDef().setProperty( Mode.REPLACE, "replace", "source-replace" );
 source.getNodeConfigDef().setProperty( Mode.REPLACE, "default-node", "node-replace" );
 source.getStepConfigDef().setProperty( Mode.DEFAULT, "replace", "process-default" );
 source.getStepConfigDef().setProperty( Mode.REPLACE, "replace", "process-replace" );
 source.getStepConfigDef().setProperty( Mode.DEFAULT, "default-node", "process-default" );
 Pipe pipe = new Pipe( "test" );
 pipe = new Each( pipe, new Insert( new Fields( "value" ), "nada" ), Fields.ALL );
 Tap sink = getPlatform().getTextFile( getOutputPath( "tapsourceconfigdef" ), SinkMode.REPLACE );
 Flow flow = getPlatform().getFlowConnector().connect( source, sink, pipe );
 flow.complete();
 assertTrue( flow.resourceExists( sink ) );
 }

代码示例来源：origin: cwensel/cascading

@Test
public void testTapSinkConfigDef() throws IOException
 {
 getPlatform().copyFromLocal( inputFileNums20 );
 Tap source = getPlatform().getTextFile( new Fields( "line" ), inputFileNums20, SinkMode.KEEP );
 Pipe pipe = new Pipe( "test" );
 pipe = new Each( pipe, new Insert( new Fields( "value" ), "nada" ), Fields.ALL );
 Scheme scheme = getPlatform().getTestConfigDefScheme();
 Tap sink = getPlatform().getTap( scheme, getOutputPath( "tapsinkconfigdef" ), SinkMode.REPLACE );
 // process -> after sink/sourceConfInit are called
 // default -> Wrapper for all cluster side calls
 sink.getConfigDef().setProperty( Mode.DEFAULT, "default", "sink-default" );
 // steps on above value
 sink.getStepConfigDef().setProperty( Mode.DEFAULT, "default", "process-default" );
 sink.getConfigDef().setProperty( Mode.DEFAULT, "replace", "sink-default" );
 sink.getConfigDef().setProperty( Mode.REPLACE, "replace", "sink-replace" );
 sink.getNodeConfigDef().setProperty( Mode.REPLACE, "default-node", "node-replace" );
 sink.getStepConfigDef().setProperty( Mode.DEFAULT, "replace", "process-default" );
 sink.getStepConfigDef().setProperty( Mode.REPLACE, "replace", "process-replace" );
 sink.getStepConfigDef().setProperty( Mode.DEFAULT, "default-node", "process-default" );
 Flow flow = getPlatform().getFlowConnector().connect( source, sink, pipe );
 flow.complete();
 assertTrue( flow.resourceExists( sink ) );
 }

代码示例来源：origin: cwensel/cascading

@Test
public void testTapSourceConfigDef() throws IOException
 {
 getPlatform().copyFromLocal( inputFileNums20 );
 Scheme scheme = getPlatform().getTestConfigDefScheme();
 Tap source = getPlatform().getTap( scheme, inputFileNums20, SinkMode.KEEP );
 // process -> after sink/sourceConfInit are called
 // default -> Wrapper for all cluster side calls
 source.getConfigDef().setProperty( Mode.DEFAULT, "default", "source-default" );
 // steps on above value
 source.getStepConfigDef().setProperty( Mode.DEFAULT, "default", "process-default" );
 source.getConfigDef().setProperty( Mode.DEFAULT, "replace", "source-default" );
 source.getConfigDef().setProperty( Mode.REPLACE, "replace", "source-replace" );
 source.getNodeConfigDef().setProperty( Mode.REPLACE, "default-node", "node-replace" );
 source.getStepConfigDef().setProperty( Mode.DEFAULT, "replace", "process-default" );
 source.getStepConfigDef().setProperty( Mode.REPLACE, "replace", "process-replace" );
 source.getStepConfigDef().setProperty( Mode.DEFAULT, "default-node", "process-default" );
 Pipe pipe = new Pipe( "test" );
 pipe = new Each( pipe, new Insert( new Fields( "value" ), "nada" ), Fields.ALL );
 Tap sink = getPlatform().getTextFile( getOutputPath( "tapsourceconfigdef" ), SinkMode.REPLACE );
 Flow flow = getPlatform().getFlowConnector().connect( source, sink, pipe );
 flow.complete();
 assertTrue( flow.resourceExists( sink ) );
 }

代码示例来源：origin: cascading/cascading-platform

@Test
public void testPipeConfigDef() throws IOException
 {
 getPlatform().copyFromLocal( inputFileNums20 );
 Tap source = getPlatform().getTextFile( new Fields( "line" ), inputFileNums20 );
 Pipe pipe = new Pipe( "test" );
 pipe = new Each( pipe, new IterateInsert( new Fields( "value" ), getPlatform().isDAG() ), Fields.ALL );
 pipe.getConfigDef().setProperty( Mode.DEFAULT, "default", "pipe-default" );
 // steps on above value
 pipe.getStepConfigDef().setProperty( Mode.DEFAULT, "default", "process-default" );
 pipe.getConfigDef().setProperty( Mode.DEFAULT, "replace", "pipe-default" );
 pipe.getConfigDef().setProperty( Mode.REPLACE, "replace", "pipe-replace" );
 pipe.getNodeConfigDef().setProperty( Mode.REPLACE, "default-node", "node-replace" );
 pipe.getStepConfigDef().setProperty( Mode.DEFAULT, "replace", "process-default" );
 pipe.getStepConfigDef().setProperty( Mode.REPLACE, "replace", "process-replace" );
 pipe.getStepConfigDef().setProperty( Mode.DEFAULT, "default-node", "process-default" );
 Tap sink = getPlatform().getTextFile( getOutputPath( "configdef" ), SinkMode.REPLACE );
 Flow flow = getPlatform().getFlowConnector().connect( source, sink, pipe );
 flow.complete();
 assertTrue( flow.resourceExists( sink ) );
 }

代码示例来源：origin: cascading/cascading-platform

@Test
public void testTapSinkConfigDef() throws IOException
 {
 getPlatform().copyFromLocal( inputFileNums20 );
 Tap source = getPlatform().getTextFile( new Fields( "line" ), inputFileNums20, SinkMode.KEEP );
 Pipe pipe = new Pipe( "test" );
 pipe = new Each( pipe, new Insert( new Fields( "value" ), "nada" ), Fields.ALL );
 Scheme scheme = getPlatform().getTestConfigDefScheme();
 Tap sink = getPlatform().getTap( scheme, getOutputPath( "tapsinkconfigdef" ), SinkMode.REPLACE );
 // process -> after sink/sourceConfInit are called
 // default -> Wrapper for all cluster side calls
 sink.getConfigDef().setProperty( Mode.DEFAULT, "default", "sink-default" );
 // steps on above value
 sink.getStepConfigDef().setProperty( Mode.DEFAULT, "default", "process-default" );
 sink.getConfigDef().setProperty( Mode.DEFAULT, "replace", "sink-default" );
 sink.getConfigDef().setProperty( Mode.REPLACE, "replace", "sink-replace" );
 sink.getNodeConfigDef().setProperty( Mode.REPLACE, "default-node", "node-replace" );
 sink.getStepConfigDef().setProperty( Mode.DEFAULT, "replace", "process-default" );
 sink.getStepConfigDef().setProperty( Mode.REPLACE, "replace", "process-replace" );
 sink.getStepConfigDef().setProperty( Mode.DEFAULT, "default-node", "process-default" );
 Flow flow = getPlatform().getFlowConnector().connect( source, sink, pipe );
 flow.complete();
 assertTrue( flow.resourceExists( sink ) );
 }

内容来源于网络，如有侵权，请联系作者删除！

Flow

相关文章

    查看更多
    微信公众号

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com