org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore.createWithRetries()方法的使用及代码示例

x33g5p2x  于2022-02-05 转载在 其他  
字(10.1k)|赞(0)|评价(0)|浏览(86)

本文整理了Java中org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore.createWithRetries()方法的一些代码示例，展示了ZKRMStateStore.createWithRetries()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台，是从一些精选项目中提取出来的代码，具有较强的参考意义，能在一定程度帮忙到你。ZKRMStateStore.createWithRetries()方法的具体详情如下：
包路径：org.apache.hadoop.yarn.server.resourcemanager.recovery.ZKRMStateStore
类名称：ZKRMStateStore
方法名：createWithRetries

ZKRMStateStore.createWithRetries介绍

暂无

代码示例

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

@Override
protected synchronized void storeRMDTMasterKeyState(
  DelegationKey delegationKey) throws Exception {
 String nodeCreatePath =
   getNodePath(dtMasterKeysRootPath, DELEGATION_KEY_PREFIX
     + delegationKey.getKeyId());
 ByteArrayOutputStream os = new ByteArrayOutputStream();
 DataOutputStream fsOut = new DataOutputStream(os);
 if (LOG.isDebugEnabled()) {
  LOG.debug("Storing RMDelegationKey_" + delegationKey.getKeyId());
 }
 delegationKey.write(fsOut);
 try {
  createWithRetries(nodeCreatePath, os.toByteArray(), zkAcl,
    CreateMode.PERSISTENT);
 } finally {
  os.close();
 }
}

代码示例来源：origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

@Override
protected synchronized void storeRMDTMasterKeyState(
  DelegationKey delegationKey) throws Exception {
 String nodeCreatePath =
   getNodePath(dtMasterKeysRootPath, DELEGATION_KEY_PREFIX
     + delegationKey.getKeyId());
 ByteArrayOutputStream os = new ByteArrayOutputStream();
 DataOutputStream fsOut = new DataOutputStream(os);
 if (LOG.isDebugEnabled()) {
  LOG.debug("Storing RMDelegationKey_" + delegationKey.getKeyId());
 }
 delegationKey.write(fsOut);
 try {
  createWithRetries(nodeCreatePath, os.toByteArray(), zkAcl,
    CreateMode.PERSISTENT);
 } finally {
  os.close();
 }
}

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

@Override
public synchronized void storeApplicationStateInternal(ApplicationId appId,
  ApplicationStateData appStateDataPB) throws Exception {
 String nodeCreatePath = getNodePath(rmAppRoot, appId.toString());
 if (LOG.isDebugEnabled()) {
  LOG.debug("Storing info for app: " + appId + " at: " + nodeCreatePath);
 }
 byte[] appStateData = appStateDataPB.getProto().toByteArray();
 createWithRetries(nodeCreatePath, appStateData, zkAcl,
  CreateMode.PERSISTENT);
}

代码示例来源：origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

@Override
public synchronized void storeApplicationStateInternal(ApplicationId appId,
  ApplicationStateData appStateDataPB) throws Exception {
 String nodeCreatePath = getNodePath(rmAppRoot, appId.toString());
 if (LOG.isDebugEnabled()) {
  LOG.debug("Storing info for app: " + appId + " at: " + nodeCreatePath);
 }
 byte[] appStateData = appStateDataPB.getProto().toByteArray();
 createWithRetries(nodeCreatePath, appStateData, zkAcl,
  CreateMode.PERSISTENT);
}

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

@Override
public synchronized void updateApplicationStateInternal(ApplicationId appId,
  ApplicationStateData appStateDataPB) throws Exception {
 String nodeUpdatePath = getNodePath(rmAppRoot, appId.toString());
 if (LOG.isDebugEnabled()) {
  LOG.debug("Storing final state info for app: " + appId + " at: "
    + nodeUpdatePath);
 }
 byte[] appStateData = appStateDataPB.getProto().toByteArray();
 if (existsWithRetries(nodeUpdatePath, false) != null) {
  setDataWithRetries(nodeUpdatePath, appStateData, -1);
 } else {
  createWithRetries(nodeUpdatePath, appStateData, zkAcl,
   CreateMode.PERSISTENT);
  LOG.debug(appId + " znode didn't exist. Created a new znode to"
    + " update the application state.");
 }
}

代码示例来源：origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

@Override
public synchronized void updateApplicationStateInternal(ApplicationId appId,
  ApplicationStateData appStateDataPB) throws Exception {
 String nodeUpdatePath = getNodePath(rmAppRoot, appId.toString());
 if (LOG.isDebugEnabled()) {
  LOG.debug("Storing final state info for app: " + appId + " at: "
    + nodeUpdatePath);
 }
 byte[] appStateData = appStateDataPB.getProto().toByteArray();
 if (existsWithRetries(nodeUpdatePath, false) != null) {
  setDataWithRetries(nodeUpdatePath, appStateData, -1);
 } else {
  createWithRetries(nodeUpdatePath, appStateData, zkAcl,
   CreateMode.PERSISTENT);
  LOG.debug(appId + " znode didn't exist. Created a new znode to"
    + " update the application state.");
 }
}

代码示例来源：origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

@Override
public synchronized void storeApplicationAttemptStateInternal(
  ApplicationAttemptId appAttemptId,
  ApplicationAttemptStateData attemptStateDataPB)
  throws Exception {
 String appDirPath = getNodePath(rmAppRoot,
   appAttemptId.getApplicationId().toString());
 String nodeCreatePath = getNodePath(appDirPath, appAttemptId.toString());
 if (LOG.isDebugEnabled()) {
  LOG.debug("Storing info for attempt: " + appAttemptId + " at: "
    + nodeCreatePath);
 }
 byte[] attemptStateData = attemptStateDataPB.getProto().toByteArray();
 createWithRetries(nodeCreatePath, attemptStateData, zkAcl,
  CreateMode.PERSISTENT);
}

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

@Override
public synchronized void storeApplicationAttemptStateInternal(
  ApplicationAttemptId appAttemptId,
  ApplicationAttemptStateData attemptStateDataPB)
  throws Exception {
 String appDirPath = getNodePath(rmAppRoot,
   appAttemptId.getApplicationId().toString());
 String nodeCreatePath = getNodePath(appDirPath, appAttemptId.toString());
 if (LOG.isDebugEnabled()) {
  LOG.debug("Storing info for attempt: " + appAttemptId + " at: "
    + nodeCreatePath);
 }
 byte[] attemptStateData = attemptStateDataPB.getProto().toByteArray();
 createWithRetries(nodeCreatePath, attemptStateData, zkAcl,
  CreateMode.PERSISTENT);
}

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

@Override
protected synchronized void storeVersion() throws Exception {
 String versionNodePath = getNodePath(zkRootNodePath, VERSION_NODE);
 byte[] data =
   ((VersionPBImpl) CURRENT_VERSION_INFO).getProto().toByteArray();
 if (existsWithRetries(versionNodePath, false) != null) {
  setDataWithRetries(versionNodePath, data, -1);
 } else {
  createWithRetries(versionNodePath, data, zkAcl, CreateMode.PERSISTENT);
 }
}

代码示例来源：origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

@Override
protected synchronized void storeVersion() throws Exception {
 String versionNodePath = getNodePath(zkRootNodePath, VERSION_NODE);
 byte[] data =
   ((VersionPBImpl) CURRENT_VERSION_INFO).getProto().toByteArray();
 if (existsWithRetries(versionNodePath, false) != null) {
  setDataWithRetries(versionNodePath, data, -1);
 } else {
  createWithRetries(versionNodePath, data, zkAcl, CreateMode.PERSISTENT);
 }
}

代码示例来源：origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

@Override
public synchronized void updateApplicationAttemptStateInternal(
  ApplicationAttemptId appAttemptId,
  ApplicationAttemptStateData attemptStateDataPB)
  throws Exception {
 String appIdStr = appAttemptId.getApplicationId().toString();
 String appAttemptIdStr = appAttemptId.toString();
 String appDirPath = getNodePath(rmAppRoot, appIdStr);
 String nodeUpdatePath = getNodePath(appDirPath, appAttemptIdStr);
 if (LOG.isDebugEnabled()) {
  LOG.debug("Storing final state info for attempt: " + appAttemptIdStr
    + " at: " + nodeUpdatePath);
 }
 byte[] attemptStateData = attemptStateDataPB.getProto().toByteArray();
 if (existsWithRetries(nodeUpdatePath, false) != null) {
  setDataWithRetries(nodeUpdatePath, attemptStateData, -1);
 } else {
  createWithRetries(nodeUpdatePath, attemptStateData, zkAcl,
   CreateMode.PERSISTENT);
  LOG.debug(appAttemptId + " znode didn't exist. Created a new znode to"
    + " update the application attempt state.");
 }
}

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

@Override
public synchronized void updateApplicationAttemptStateInternal(
  ApplicationAttemptId appAttemptId,
  ApplicationAttemptStateData attemptStateDataPB)
  throws Exception {
 String appIdStr = appAttemptId.getApplicationId().toString();
 String appAttemptIdStr = appAttemptId.toString();
 String appDirPath = getNodePath(rmAppRoot, appIdStr);
 String nodeUpdatePath = getNodePath(appDirPath, appAttemptIdStr);
 if (LOG.isDebugEnabled()) {
  LOG.debug("Storing final state info for attempt: " + appAttemptIdStr
    + " at: " + nodeUpdatePath);
 }
 byte[] attemptStateData = attemptStateDataPB.getProto().toByteArray();
 if (existsWithRetries(nodeUpdatePath, false) != null) {
  setDataWithRetries(nodeUpdatePath, attemptStateData, -1);
 } else {
  createWithRetries(nodeUpdatePath, attemptStateData, zkAcl,
   CreateMode.PERSISTENT);
  LOG.debug(appAttemptId + " znode didn't exist. Created a new znode to"
    + " update the application attempt state.");
 }
}

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

@Override
public synchronized long getAndIncrementEpoch() throws Exception {
 String epochNodePath = getNodePath(zkRootNodePath, EPOCH_NODE);
 long currentEpoch = 0;
 if (existsWithRetries(epochNodePath, false) != null) {
  // load current epoch
  byte[] data = getDataWithRetries(epochNodePath, false);
  Epoch epoch = new EpochPBImpl(EpochProto.parseFrom(data));
  currentEpoch = epoch.getEpoch();
  // increment epoch and store it
  byte[] storeData = Epoch.newInstance(currentEpoch + 1).getProto()
    .toByteArray();
  setDataWithRetries(epochNodePath, storeData, -1);
 } else {
  // initialize epoch node with 1 for the next time.
  byte[] storeData = Epoch.newInstance(currentEpoch + 1).getProto()
    .toByteArray();
  createWithRetries(epochNodePath, storeData, zkAcl, CreateMode.PERSISTENT);
 }
 return currentEpoch;
}

代码示例来源：origin: com.github.jiayuhan-it/hadoop-yarn-server-resourcemanager

@Override
public synchronized long getAndIncrementEpoch() throws Exception {
 String epochNodePath = getNodePath(zkRootNodePath, EPOCH_NODE);
 long currentEpoch = 0;
 if (existsWithRetries(epochNodePath, false) != null) {
  // load current epoch
  byte[] data = getDataWithRetries(epochNodePath, false);
  Epoch epoch = new EpochPBImpl(EpochProto.parseFrom(data));
  currentEpoch = epoch.getEpoch();
  // increment epoch and store it
  byte[] storeData = Epoch.newInstance(currentEpoch + 1).getProto()
    .toByteArray();
  setDataWithRetries(epochNodePath, storeData, -1);
 } else {
  // initialize epoch node with 1 for the next time.
  byte[] storeData = Epoch.newInstance(currentEpoch + 1).getProto()
    .toByteArray();
  createWithRetries(epochNodePath, storeData, zkAcl, CreateMode.PERSISTENT);
 }
 return currentEpoch;
}

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

store.createWithRetries(path, null, ZooDefs.Ids.OPEN_ACL_UNSAFE,
  CreateMode.PERSISTENT);
store.getDataWithRetries(path, true);

代码示例来源：origin: ch.cern.hadoop/hadoop-yarn-server-resourcemanager

store.createWithRetries(path, null, ZooDefs.Ids.OPEN_ACL_UNSAFE,
  CreateMode.PERSISTENT);
store.getDataWithRetries(path, true);

内容来源于网络，如有侵权，请联系作者删除！

ZKRMStateStore

相关文章

    查看更多
    微信公众号

    热门标签

    更多
    JavaquerypythonNode开发语言requestUtil数据库Table后端算法LoggerMessageElementParser

    最新文章

    更多

    ZKRMStateStore类方法

    • 蜀ICP备13028337号-1 大数据知识库 https://www.saoniuhuo.com © All rights reserved
    • 本站内容来源互联网,如果侵犯您的权益请联系我们删除, 联系方式：448109455@qq.com