cascading.tuple.TupleEntry类的使用及代码示例

x33g5p2x  于2022-01-29 转载在 其他  
字(10.2k)|赞(0)|评价(0)|浏览(121)

本文整理了Java中cascading.tuple.TupleEntry类的一些代码示例，展示了TupleEntry类的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。TupleEntry类的具体详情如下：
包路径：cascading.tuple.TupleEntry
类名称：TupleEntry

TupleEntry介绍

[英]Class TupleEntry allows a Tuple instance and its declaring Fields instance to be used as a single object.

Once a TupleEntry is created, its Fields cannot be changed, but the Tuple instance it holds can be replaced or modified. The managed Tuple should not have elements added or removed, as this will break the relationship with the associated Fields instance.

If type information is provided on the Fields instance, all setters on this class will use that information to coerce the given object to the expected type.

For example, if position is is of type long, then entry.setString(0, "9" ) will coerce the "9" to a long 9. Thus, entry.getObject(0) == 9l.

No coercion is performed with the #getObject(Comparable) and #getObject(int) methods.

To set a value without coercion, see the #setRaw(Comparable,Object) and #setRaw(int,Object)methods.
[中]类TupleEntry允许将元组实例及其声明字段实例用作单个对象。
一旦创建了TupleEntry，就不能更改其字段，但可以替换或修改其持有的元组实例。托管元组不应添加或删除元素，因为这将破坏与关联字段实例的关系。
如果Fields实例上提供了类型信息，则该类上的所有setter都将使用该信息将给定对象强制为预期类型。
例如，如果position类型为long，则输入。setString（0，“9”）将强制“9”为长9。因此，进入。getObject（0）==9l。
#getObject（Comparable）和#getObject（int）方法不执行强制。
要在不强制的情况下设置值，请参阅#setRaw（Comparable，Object）和#setRaw（int，Object）方法。

代码示例

代码示例来源：origin: elastic/elasticsearch-hadoop

static Tuple coerceToString(SinkCall<?, ?> sinkCall) {
    TupleEntry entry = sinkCall.getOutgoingEntry();
    Fields fields = entry.getFields();
    Tuple tuple = entry.getTuple();
    if (fields.hasTypes()) {
      Type types[] = new Type[fields.size()];
      for (int index = 0; index < fields.size(); index++) {
        Type type = fields.getType(index);
        if (type instanceof CoercibleType<?>) {
          types[index] = String.class;
        }
        else {
          types[index] = type;
        }
      }
      tuple = entry.getCoercedTuple(types);
    }
    return tuple;
  }
}

代码示例来源：origin: elastic/elasticsearch-hadoop

@SuppressWarnings({ "rawtypes" })
@Override
protected Object extractField(Object target) {
  List<String> fieldNames = getFieldNames();
  for (int i = 0; i < fieldNames.size(); i++) {
    if (target instanceof SinkCall) {
      target = ((SinkCall) target).getOutgoingEntry().getObject(fieldNames.get(i));
      if (target == null) {
        return NOT_FOUND;
      }
    }
    else {
      return NOT_FOUND;
    }
  }
  return target;
}

代码示例来源：origin: elastic/elasticsearch-hadoop

if (entry.getFields().isDefined()) {
  for (Comparable<?> field : entry.getFields()) {
    Object result = data;
    entry.setObject(field, result);
  List<Object> elements = Tuple.elements(entry.getTuple());
  elements.clear();
  elements.addAll(data.values());

代码示例来源：origin: elastic/elasticsearch-hadoop

static void setObject(TupleEntry entry, Comparable<?> field, Object object) {
  if (object != null && entry.getFields().getType(field) instanceof CoercibleType) {
    entry.setObject(field, object.toString());
  }
  else {
    entry.setObject(field, object);
  }
}

代码示例来源：origin: elastic/elasticsearch-hadoop

if (entry.getFields().isDefined()) {
  for (Comparable<?> field : entry.getFields()) {
  List<Object> elements = Tuple.elements(entry.getTuple());
  elements.clear();
  elements.addAll(data.values());

代码示例来源：origin: cwensel/cascading

@Test
public void testAverageBy() throws IOException
 {
 getPlatform().copyFromLocal( inputFileLhs );
 Tap source = getPlatform().getDelimitedFile( new Fields( "num", "char" ), " ", inputFileLhs );
 Tap sink = getPlatform().getDelimitedFile( new Fields( "char", "average" ), "\t",
  new Class[]{String.class, Double.TYPE}, getOutputPath( "average" ), SinkMode.REPLACE );
 Pipe pipe = new Pipe( "average" );
 pipe = new AverageBy( pipe, new Fields( "char" ), new Fields( "num" ), new Fields( "average" ), 2 );
 Flow flow = getPlatform().getFlowConnector().connect( source, sink, pipe );
 flow.complete();
 validateLength( flow, 5, 2, Pattern.compile( "^\\w+\\s[\\d.]+$" ) );
 Tuple[] results = new Tuple[]{
  new Tuple( "a", (double) 6 / 2 ),
  new Tuple( "b", (double) 12 / 4 ),
  new Tuple( "c", (double) 10 / 4 ),
  new Tuple( "d", (double) 6 / 2 ),
  new Tuple( "e", (double) 5 / 1 ),
  };
 TupleEntryIterator iterator = flow.openSink();
 int count = 0;
 while( iterator.hasNext() )
  assertEquals( results[ count++ ], iterator.next().getTuple() );
 iterator.close();
 }

代码示例来源：origin: Big-Data-Manning/big-data-code

public void operate(FlowProcess process, FunctionCall call) {
    String url = call.getArguments().getString(0);
    String gran = call.getArguments().getString(1);
    Integer bucket = call.getArguments().getInteger(2);
    String keyStr = url + "/" + gran + "-" + bucket;
    try {
      call.getOutputCollector().add(
        new Tuple(keyStr.getBytes("UTF-8")));
    } catch(UnsupportedEncodingException e) {
      throw new RuntimeException(e);
    }
  }
}

代码示例来源：origin: cwensel/cascading

@Test(expected = OperationException.class)
public void testGetMissingFail() throws Exception
 {
 TupleEntry entry = new TupleEntry( new Fields( "json", JSONCoercibleType.TYPE ), Tuple.size( 1 ) );
 entry.setObject( 0, JSONData.nested );
 JSONGetFunction function = new JSONGetFunction( new Fields( "result" ), true, "/person/foobar" );
 invokeFunction( function, entry, new Fields( "result" ) );
 }

代码示例来源：origin: Big-Data-Manning/big-data-code

public void operate(FlowProcess process, FunctionCall call) {
    Object node1 = call.getArguments().getObject(0);
    Object node2 = call.getArguments().getObject(1);
    if(!node1.equals(node2)) {
      call.getOutputCollector().add(
        new Tuple(node1, node2));
      call.getOutputCollector().add(
        new Tuple(node2, node1));
    }
  }
}

代码示例来源：origin: cwensel/cascading

public void operate( FlowProcess flowProcess, FunctionCall functionCall )
 {
 TupleEntry input = functionCall.getArguments();
 functionCall.getOutputCollector().add( new Tuple( Math.pow( input.getTuple().getDouble( 0 ) - input.getTuple().getDouble( 1 ), 2 ) ) );
 }
};

代码示例来源：origin: cwensel/cascading

@Test
public void testSinkUnknown() throws IOException
 {
 getPlatform().copyFromLocal( inputFileCross );
 Tap source = getPlatform().getTextFile( new Fields( "line" ), inputFileCross );
 Pipe pipe = new Pipe( "test" );
 pipe = new Each( pipe, new RegexSplitter( new Fields( "first", "second", "third" ), "\\s" ), Fields.RESULTS );
 Tap sink = getPlatform().getTabDelimitedFile( Fields.UNKNOWN, getOutputPath( "unknownsinks" ), SinkMode.REPLACE );
 Flow flow = getPlatform().getFlowConnector().connect( source, sink, pipe );
 flow.complete();
 validateLength( flow, 37, null );
 TupleEntryIterator iterator = flow.openSink();
 String line = iterator.next().getTuple().toString();
 assertTrue( "not equal: wrong values: " + line, line.matches( "[0-9]\t[a-z]\t[A-Z]" ) );
 iterator.close();
 }

代码示例来源：origin: cwensel/cascading

@Test
public void testNullsFromScheme() throws IOException
 {
 getPlatform().copyFromLocal( inputFileComments );
 Tap source = new Hfs( new CommentScheme( new Fields( "line" ) ), inputFileComments );
 Pipe pipe = new Pipe( "test" );
 pipe = new Each( pipe, new Identity() );
 Tap sink = new Hfs( new TextLine( 1 ), getOutputPath( "testnulls" ), SinkMode.REPLACE );
 Flow flow = getPlatform().getFlowConnector( getProperties() ).connect( source, sink, pipe );
 flow.complete();
 validateLength( flow, 5, null );
 TupleEntryIterator iterator = flow.openSink();
 assertEquals( "not equal: tuple.get(1)", "1 a", iterator.next().getObject( 1 ) );
 iterator.close();
 // confirm the tuple iterator can handle nulls from the source
 validateLength( flow.openSource(), 5 );
 }

代码示例来源：origin: cwensel/cascading

private TupleEntry getEntry( Comparable lhs, Comparable rhs )
 {
 Fields fields = new Fields( "a", "b" );
 Tuple parameters = new Tuple( lhs, rhs );
 return new TupleEntry( fields, parameters );
 }

代码示例来源：origin: cwensel/cascading

@Test
public void testSinkDeclaredFields() throws IOException
 {
 getPlatform().copyFromLocal( inputFileCross );
 Tap source = getPlatform().getTextFile( new Fields( "line" ), inputFileCross );
 Pipe pipe = new Pipe( "test" );
 pipe = new Each( pipe, new RegexSplitter( new Fields( "first", "second", "third" ), "\\s" ), Fields.ALL );
 Tap sink = getPlatform().getTextFile( new Fields( "line" ), new Fields( "second", "first", "third" ), getOutputPath( "declaredsinks" ), SinkMode.REPLACE );
 Flow flow = getPlatform().getFlowConnector().connect( source, sink, pipe );
 flow.complete();
 validateLength( flow, 37, null );
 TupleEntryIterator iterator = flow.openSink();
 String line = iterator.next().getString( 0 );
 assertTrue( "not equal: wrong values", line.matches( "[a-z]\t[0-9]\t[A-Z]" ) );
 iterator.close();
 }

代码示例来源：origin: LiveRamp/cascading_ext

protected void emitTuple(CombinerAggregatorContext context, AggregatorCall aggregatorCall) {
  TupleEntry output = new TupleEntry(outputFields);
  output.setTuple(Tuple.size(outputFields.size()));

  Tuple result = context.getAggregateTuple();
  MultiCombiner.populateOutputTupleEntry(context.getDefinition(), output, result);

  aggregatorCall.getOutputCollector().add(output);
 }
}

代码示例来源：origin: cwensel/cascading

private void useSize( TupleEntry input, TupleEntryCollector outputCollector )
 {
 LOG.debug( "using size: {}", size );
 Tuple tuple = new Tuple( input.getTuple() ); // make clone
 Tuple group = tuple.remove( input.getFields(), groupFieldSelector );
 for( int i = 0; i < tuple.size(); i = i + size )
  {
  Tuple result = new Tuple( group );
  result.addAll( tuple.get( Fields.offsetSelector( size, i ).getPos() ) );
  outputCollector.add( result );
  }
 }

代码示例来源：origin: cwensel/cascading

@Test
public void testSetNull()
 {
 TupleEntry entryA = new TupleEntry( new Fields( "a", "b", "c" ), new Tuple( "a", "b", "c" ) );
 entryA.setTuple( null );
 assertTrue( entryA.getTuple() == null );
 }

代码示例来源：origin: cwensel/cascading

public void operate( FlowProcess flowProcess, FunctionCall functionCall )
 {
 Set<Tuple> set = new TreeSet<Tuple>();
 TupleEntry input = functionCall.getArguments();
 for( Fields field : fields )
  set.add( input.selectTuple( field ) );
 int i = 0;
 Tuple inputCopy = new Tuple( input.getTuple() );
 for( Tuple tuple : set )
  inputCopy.put( input.getFields(), fields[ i++ ], tuple );
 functionCall.getOutputCollector().add( inputCopy );
 }

代码示例来源：origin: cwensel/cascading

@Override
public void doAssert( FlowProcess flowProcess, ValueAssertionCall assertionCall )
 {
 TupleEntry input = assertionCall.getArguments();
 int pos = 0;
 for( Object element : input.getTuple() )
  {
  if( !value.equals( element ) )
   fail( input.getFields().get( pos ), element, value, input.getTuple().print() );
  pos++;
  }
 }

代码示例来源：origin: com.hotels/plunger

public Builder<C> addTuple(Object... values) {
 values = FieldTypeValidator.validateValues(fieldMask, values);
 TupleEntry newTuple = new TupleEntry(fields, Tuple.size(fields.size()));
 newTuple.setTuple(fieldMask, new Tuple(values));
 tuples.add(newTuple);
 return this;
}

内容来源于网络，如有侵权，请联系作者删除！

TupleEntry

相关文章

    查看更多
    微信公众号

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多
    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com