org.apache.spark.network.yarn.YarnShuffleService.dbAppKey()方法的使用及代码示例

x33g5p2x  于2022-02-05 转载在 其他  
字(4.0k)|赞(0)|评价(0)|浏览(115)

本文整理了Java中org.apache.spark.network.yarn.YarnShuffleService.dbAppKey()方法的一些代码示例,展示了YarnShuffleService.dbAppKey()的具体用法。这些代码示例主要来源于Github/Stackoverflow/Maven等平台,是从一些精选项目中提取出来的代码,具有较强的参考意义,能在一定程度帮忙到你。YarnShuffleService.dbAppKey()方法的具体详情如下:
包路径:org.apache.spark.network.yarn.YarnShuffleService
类名称:YarnShuffleService
方法名:dbAppKey

YarnShuffleService.dbAppKey介绍

暂无

代码示例

代码示例来源:origin: io.snappydata/snappy-spark-network-yarn

@Override
public void initializeApplication(ApplicationInitializationContext context) {
 String appId = context.getApplicationId().toString();
 try {
  ByteBuffer shuffleSecret = context.getApplicationDataForService();
  logger.info("Initializing application {}", appId);
  if (isAuthenticationEnabled()) {
   AppId fullId = new AppId(appId);
   if (db != null) {
    byte[] key = dbAppKey(fullId);
    byte[] value = mapper.writeValueAsString(shuffleSecret).getBytes(StandardCharsets.UTF_8);
    db.put(key, value);
   }
   secretManager.registerApp(appId, shuffleSecret);
  }
 } catch (Exception e) {
  logger.error("Exception when initializing application {}", appId, e);
 }
}

代码示例来源:origin: org.apache.spark/spark-network-yarn_2.10

@Override
public void initializeApplication(ApplicationInitializationContext context) {
 String appId = context.getApplicationId().toString();
 try {
  ByteBuffer shuffleSecret = context.getApplicationDataForService();
  if (isAuthenticationEnabled()) {
   AppId fullId = new AppId(appId);
   if (db != null) {
    byte[] key = dbAppKey(fullId);
    byte[] value = mapper.writeValueAsString(shuffleSecret).getBytes(StandardCharsets.UTF_8);
    db.put(key, value);
   }
   secretManager.registerApp(appId, shuffleSecret);
  }
 } catch (Exception e) {
  logger.error("Exception when initializing application {}", appId, e);
 }
}

代码示例来源:origin: org.apache.spark/spark-network-yarn_2.11

@Override
public void initializeApplication(ApplicationInitializationContext context) {
 String appId = context.getApplicationId().toString();
 try {
  ByteBuffer shuffleSecret = context.getApplicationDataForService();
  if (isAuthenticationEnabled()) {
   AppId fullId = new AppId(appId);
   if (db != null) {
    byte[] key = dbAppKey(fullId);
    byte[] value = mapper.writeValueAsString(shuffleSecret).getBytes(StandardCharsets.UTF_8);
    db.put(key, value);
   }
   secretManager.registerApp(appId, shuffleSecret);
  }
 } catch (Exception e) {
  logger.error("Exception when initializing application {}", appId, e);
 }
}

代码示例来源:origin: io.snappydata/snappy-spark-network-yarn

@Override
public void stopApplication(ApplicationTerminationContext context) {
 String appId = context.getApplicationId().toString();
 try {
  logger.info("Stopping application {}", appId);
  if (isAuthenticationEnabled()) {
   AppId fullId = new AppId(appId);
   if (db != null) {
    try {
     db.delete(dbAppKey(fullId));
    } catch (IOException e) {
     logger.error("Error deleting {} from executor state db", appId, e);
    }
   }
   secretManager.unregisterApp(appId);
  }
  blockHandler.applicationRemoved(appId, false /* clean up local dirs */);
 } catch (Exception e) {
  logger.error("Exception when stopping application {}", appId, e);
 }
}

代码示例来源:origin: org.apache.spark/spark-network-yarn_2.11

@Override
public void stopApplication(ApplicationTerminationContext context) {
 String appId = context.getApplicationId().toString();
 try {
  if (isAuthenticationEnabled()) {
   AppId fullId = new AppId(appId);
   if (db != null) {
    try {
     db.delete(dbAppKey(fullId));
    } catch (IOException e) {
     logger.error("Error deleting {} from executor state db", appId, e);
    }
   }
   secretManager.unregisterApp(appId);
  }
  blockHandler.applicationRemoved(appId, false /* clean up local dirs */);
 } catch (Exception e) {
  logger.error("Exception when stopping application {}", appId, e);
 }
}

代码示例来源:origin: org.apache.spark/spark-network-yarn_2.10

@Override
public void stopApplication(ApplicationTerminationContext context) {
 String appId = context.getApplicationId().toString();
 try {
  if (isAuthenticationEnabled()) {
   AppId fullId = new AppId(appId);
   if (db != null) {
    try {
     db.delete(dbAppKey(fullId));
    } catch (IOException e) {
     logger.error("Error deleting {} from executor state db", appId, e);
    }
   }
   secretManager.unregisterApp(appId);
  }
  blockHandler.applicationRemoved(appId, false /* clean up local dirs */);
 } catch (Exception e) {
  logger.error("Exception when stopping application {}", appId, e);
 }
}

相关文章