com.facebook.presto.spi.Node.getNodeIdentifier()方法的使用及代码示例

x33g5p2x  于2022-01-25 转载在 其他  
字(9.1k)|赞(0)|评价(0)|浏览(78)

本文整理了Java中com.facebook.presto.spi.Node.getNodeIdentifier()方法的一些代码示例,展示了Node.getNodeIdentifier()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。Node.getNodeIdentifier()方法的具体详情如下:
包路径:com.facebook.presto.spi.Node
类名称:Node
方法名:getNodeIdentifier

Node.getNodeIdentifier介绍

暂无

代码示例

代码示例来源:origin: prestodb/presto

public int getQueuedSplitCountForStage(Node node)
{
  return queuedSplitCountByNode.getOrDefault(node.getNodeIdentifier(), 0) + assignmentCount.getOrDefault(node, 0);
}

代码示例来源:origin: prestodb/presto

@Inject
public JmxRecordSetProvider(MBeanServer mbeanServer, NodeManager nodeManager, JmxHistoricalData jmxHistoricalData)
{
  this.mbeanServer = requireNonNull(mbeanServer, "mbeanServer is null");
  this.nodeId = requireNonNull(nodeManager, "nodeManager is null").getCurrentNode().getNodeIdentifier();
  this.jmxHistoricalData = requireNonNull(jmxHistoricalData, "jmxHistoryHolder is null");
}

代码示例来源:origin: prestodb/presto

@Override
public URI createTaskLocation(Node node, TaskId taskId)
{
  return URI.create("http://fake.invalid/task/" + node.getNodeIdentifier() + "/" + taskId);
}

代码示例来源:origin: prestodb/presto

@Override
  public URI createMemoryInfoLocation(Node node)
  {
    return URI.create("http://fake.invalid/" + node.getNodeIdentifier() + "/memory");
  }
}

代码示例来源:origin: prestodb/presto

public static ResettableRandomizedIterator<Node> randomizedNodes(NodeMap nodeMap, boolean includeCoordinator, Set<Node> excludedNodes)
{
  ImmutableList<Node> nodes = nodeMap.getNodesByHostAndPort().values().stream()
      .filter(node -> includeCoordinator || !nodeMap.getCoordinatorNodeIds().contains(node.getNodeIdentifier()))
      .filter(node -> !excludedNodes.contains(node))
      .collect(toImmutableList());
  return new ResettableRandomizedIterator<>(nodes);
}

代码示例来源:origin: prestodb/presto

private synchronized void updateNodes(MemoryPoolAssignmentsRequest assignments)
{
  ImmutableSet.Builder<Node> builder = ImmutableSet.builder();
  Set<Node> aliveNodes = builder
      .addAll(nodeManager.getNodes(ACTIVE))
      .addAll(nodeManager.getNodes(SHUTTING_DOWN))
      .build();
  ImmutableSet<String> aliveNodeIds = aliveNodes.stream()
      .map(Node::getNodeIdentifier)
      .collect(toImmutableSet());
  // Remove nodes that don't exist anymore
  // Make a copy to materialize the set difference
  Set<String> deadNodes = ImmutableSet.copyOf(difference(nodes.keySet(), aliveNodeIds));
  nodes.keySet().removeAll(deadNodes);
  // Add new nodes
  for (Node node : aliveNodes) {
    if (!nodes.containsKey(node.getNodeIdentifier())) {
      nodes.put(node.getNodeIdentifier(), new RemoteNodeMemory(node, httpClient, memoryInfoCodec, assignmentsRequestJsonCodec, locationFactory.createMemoryInfoLocation(node)));
    }
  }
  // If work isn't scheduled on the coordinator (the current node) there is no point
  // in polling or updating (when moving queries to the reserved pool) its memory pools
  if (!isWorkScheduledOnCoordinator) {
    nodes.remove(nodeManager.getCurrentNode().getNodeIdentifier());
  }
  // Schedule refresh
  for (RemoteNodeMemory node : nodes.values()) {
    node.asyncRefresh(assignments);
  }
}

代码示例来源:origin: prestodb/presto

private void addRows(Builder table, Set<Node> nodes, NodeState state)
{
  for (Node node : nodes) {
    table.addRow(node.getNodeIdentifier(), node.getHttpUri().toString(), getNodeVersion(node), isCoordinator(node), state.toString().toLowerCase(Locale.ENGLISH));
  }
}

代码示例来源:origin: prestodb/presto

private Response proxyJsonResponse(String nodeId, String workerPath)
{
  Set<Node> nodes = nodeManager.getNodes(NodeState.ACTIVE);
  Node node = nodes.stream()
      .filter(n -> n.getNodeIdentifier().equals(nodeId))
      .findFirst()
      .orElseThrow(() -> new WebApplicationException(NOT_FOUND));
  Request request = prepareGet()
      .setUri(uriBuilderFrom(node.getHttpUri())
          .appendPath(workerPath)
          .build())
      .build();
  InputStream responseStream = httpClient.execute(request, new StreamingJsonResponseHandler());
  return Response.ok(responseStream, APPLICATION_JSON_TYPE).build();
}

代码示例来源:origin: prestodb/presto

private void pollWorkers()
{
  AllNodes allNodes = getAllNodes();
  Set<Node> aliveNodes = ImmutableSet.<Node>builder()
      .addAll(allNodes.getActiveNodes())
      .addAll(allNodes.getShuttingDownNodes())
      .build();
  ImmutableSet<String> aliveNodeIds = aliveNodes.stream()
      .map(Node::getNodeIdentifier)
      .collect(toImmutableSet());
  // Remove nodes that don't exist anymore
  // Make a copy to materialize the set difference
  Set<String> deadNodes = difference(nodeStates.keySet(), aliveNodeIds).immutableCopy();
  nodeStates.keySet().removeAll(deadNodes);
  // Add new nodes
  for (Node node : aliveNodes) {
    nodeStates.putIfAbsent(node.getNodeIdentifier(),
        new RemoteNodeState(httpClient, uriBuilderFrom(node.getHttpUri()).appendPath("/v1/info/state").build()));
  }
  // Schedule refresh
  nodeStates.values().forEach(RemoteNodeState::asyncRefresh);
  // update indexes
  refreshNodesInternal();
}

代码示例来源:origin: prestodb/presto

.filter(node -> includeCoordinator || !coordinatorIds.contains(node.getNodeIdentifier()))
.forEach(chosen::add);
  .filter(node -> includeCoordinator || !coordinatorIds.contains(node.getNodeIdentifier()))
  .forEach(chosen::add);

代码示例来源:origin: prestodb/presto

node.getNodeIdentifier(),
locationFactory.createTaskLocation(node, taskId),
fragment,

代码示例来源:origin: prestodb/presto

@Override
  public ConnectorSplitSource getSplits(ConnectorTransactionHandle transaction, ConnectorSession session, ConnectorTableLayoutHandle layout, SplitSchedulingStrategy splitSchedulingStrategy)
  {
    JmxTableLayoutHandle jmxLayout = (JmxTableLayoutHandle) layout;
    JmxTableHandle tableHandle = jmxLayout.getTable();
    TupleDomain<ColumnHandle> predicate = jmxLayout.getConstraint();

    //TODO is there a better way to get the node column?
    Optional<JmxColumnHandle> nodeColumnHandle = tableHandle.getColumnHandles().stream()
        .filter(jmxColumnHandle -> jmxColumnHandle.getColumnName().equals(NODE_COLUMN_NAME))
        .findFirst();
    checkState(nodeColumnHandle.isPresent(), "Failed to find %s column", NODE_COLUMN_NAME);

    List<ConnectorSplit> splits = nodeManager.getAllNodes().stream()
        .filter(node -> {
          NullableValue value = NullableValue.of(createUnboundedVarcharType(), utf8Slice(node.getNodeIdentifier()));
          return predicate.overlaps(fromFixedValues(ImmutableMap.of(nodeColumnHandle.get(), value)));
        })
        .map(node -> new JmxSplit(tableHandle, ImmutableList.of(node.getHostAndPort())))
        .collect(toList());

    return new FixedSplitSource(splits);
  }
}

代码示例来源:origin: prestodb/presto

private SimpleConsumer createConsumer(HostAddress host)
  {
    log.info("Creating new Consumer for %s", host);
    return new SimpleConsumer(host.getHostText(),
        host.getPort(),
        connectTimeoutMillis,
        bufferSizeBytes,
        format("presto-kafka-%s-%s", connectorId, nodeManager.getCurrentNode().getNodeIdentifier()));
  }
}

代码示例来源:origin: prestodb/presto

log.info("Previously active node is missing: %s (last seen at %s)", missingNode.getNodeIdentifier(), missingNode.getHostAndPort());

代码示例来源:origin: prestodb/presto

@Test
public void testPredicatePushdown()
    throws Exception
{
  for (Node node : nodes) {
    String nodeIdentifier = node.getNodeIdentifier();
    TupleDomain<ColumnHandle> nodeTupleDomain = TupleDomain.fromFixedValues(ImmutableMap.of(columnHandle, NullableValue.of(createUnboundedVarcharType(), utf8Slice(nodeIdentifier))));
    ConnectorTableLayoutHandle layout = new JmxTableLayoutHandle(tableHandle, nodeTupleDomain);
    ConnectorSplitSource splitSource = splitManager.getSplits(JmxTransactionHandle.INSTANCE, SESSION, layout, UNGROUPED_SCHEDULING);
    List<ConnectorSplit> allSplits = getAllSplits(splitSource);
    assertEquals(allSplits.size(), 1);
    assertEquals(allSplits.get(0).getAddresses().size(), 1);
    assertEquals(allSplits.get(0).getAddresses().get(0).getHostText(), nodeIdentifier);
  }
}

代码示例来源:origin: prestodb/presto

boolean summarizeTaskInfo)
return new MockRemoteTask(taskId, fragment, node.getNodeIdentifier(), executor, scheduledExecutor, initialSplits, totalPartitions, partitionedSplitCountTracker);

代码示例来源:origin: prestodb/presto

@Test
public void testGetCurrentNode()
{
  Node expected = activeNodes.get(0);
  NodeInfo nodeInfo = new NodeInfo(new NodeConfig()
      .setEnvironment("test")
      .setNodeId(expected.getNodeIdentifier()));
  DiscoveryNodeManager manager = new DiscoveryNodeManager(selector, nodeInfo, new NoOpFailureDetector(), expectedVersion, testHttpClient, internalCommunicationConfig);
  assertEquals(manager.getCurrentNode(), expected);
}

代码示例来源:origin: prestodb/presto

if (useNetworkTopology && (includeCoordinator || !coordinatorNodeIds.contains(node.getNodeIdentifier()))) {
  NetworkLocation location = networkLocationCache.get(node.getHostAndPort());
  for (int i = 0; i <= location.getSegments().size(); i++) {

代码示例来源:origin: uk.co.nichesolutions.presto/presto-main

public static ResettableRandomizedIterator<Node> randomizedNodes(NodeMap nodeMap, boolean includeCoordinator)
{
  ImmutableList<Node> nodes = nodeMap.getNodesByHostAndPort().values().stream()
      .filter(node -> includeCoordinator || !nodeMap.getCoordinatorNodeIds().contains(node.getNodeIdentifier()))
      .collect(toImmutableList());
  return new ResettableRandomizedIterator<>(nodes);
}

代码示例来源:origin: uk.co.nichesolutions.presto/presto-main

@Test
public void testGetCurrentNode()
{
  Node expected = activeNodes.get(0);
  NodeInfo nodeInfo = new NodeInfo(new NodeConfig()
      .setEnvironment("test")
      .setNodeId(expected.getNodeIdentifier()));
  DiscoveryNodeManager manager = new DiscoveryNodeManager(selector, nodeInfo, new NoOpFailureDetector(), expectedVersion, testHttpClient);
  assertEquals(manager.getCurrentNode(), expected);
}

相关文章

微信公众号

最新文章

更多