cascading.flow.Flow.getRunID()方法的使用及代码示例

x33g5p2x  于2022-01-19 转载在 其他  
字(2.3k)|赞(0)|评价(0)|浏览(128)

本文整理了Java中cascading.flow.Flow.getRunID()方法的一些代码示例,展示了Flow.getRunID()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Flow.getRunID()方法的具体详情如下:
包路径:cascading.flow.Flow
类名称:Flow
方法名:getRunID

Flow.getRunID介绍

[英]Returns the run ID given when this Flow instance was defined in the FlowDef.
[中]返回在FlowDef中定义此流实例时给定的运行ID。

代码示例

代码示例来源:origin: cwensel/cascading

protected boolean isSkipFlowStep() throws IOException
 {
 // if runID is not set, never skip a step
 if( flowStep.getFlow().getRunID() == null )
  return false;
 return flowStep.allSourcesExist() && !flowStep.areSourcesNewer( flowStep.getSinkModified() );
 }

代码示例来源:origin: cascading/cascading-hadoop2-mr1

protected void cleanIntermediateData( JobConf config, Tap sink )
 {
 if( sink.isTemporary() && ( getFlow().getFlowStats().isSuccessful() || getFlow().getRunID() == null ) )
  {
  try
   {
   sink.deleteResource( config );
   }
  catch( Exception exception )
   {
   // sink all exceptions, don't fail app
   logWarn( "unable to remove temporary file: " + sink, exception );
   }
  }
 else
  {
  cleanTapMetaData( config, sink );
  }
 }

代码示例来源:origin: cwensel/cascading

protected void cleanIntermediateData( JobConf config, Tap sink )
 {
 if( sink.isTemporary() && ( getFlow().getFlowStats().isSuccessful() || getFlow().getRunID() == null ) )
  {
  try
   {
   sink.deleteResource( config );
   }
  catch( Exception exception )
   {
   // sink all exceptions, don't fail app
   logWarn( "unable to remove temporary file: " + sink, exception );
   }
  }
 else
  {
  cleanTapMetaData( config, sink );
  }
 }

代码示例来源:origin: cwensel/cascading

@Override
public void clean( TezConfiguration config )
 {
 for( Tap sink : getSinkTaps() )
  {
  if( sink.isTemporary() && ( getFlow().getFlowStats().isSuccessful() || getFlow().getRunID() == null ) )
   {
   try
    {
    sink.deleteResource( config );
    }
   catch( Exception exception )
    {
    // sink all exceptions, don't fail app
    logWarn( "unable to remove temporary file: " + sink, exception );
    }
   }
  else
   {
   cleanTapMetaData( config, sink );
   }
  }
 for( Tap tap : getTraps() )
  cleanTapMetaData( config, tap );
 }

代码示例来源:origin: cascading/cascading-hadoop2-tez

@Override
public void clean( TezConfiguration config )
 {
 for( Tap sink : getSinkTaps() )
  {
  if( sink.isTemporary() && ( getFlow().getFlowStats().isSuccessful() || getFlow().getRunID() == null ) )
   {
   try
    {
    sink.deleteResource( config );
    }
   catch( Exception exception )
    {
    // sink all exceptions, don't fail app
    logWarn( "unable to remove temporary file: " + sink, exception );
    }
   }
  else
   {
   cleanTapMetaData( config, sink );
   }
  }
 for( Tap tap : getTraps() )
  cleanTapMetaData( config, tap );
 }

相关文章