我有一个spark作业，我使用spark submit命令行工具用shell脚本调用它。我需要将db2连接用户名和密码的凭据传递到jar文件。要求用户名和密码不可读。有人能帮忙吗？
t8e9dugd1#
我会尝试使用hadoop认证apihadoop从hadoop2.6版本开始就引入了keystore。您可以将密钥存储路径和别名传递给spark程序，并在运行时从keystore获取密码https://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-common/commandsmanual.html#credential下面是示例java程序https://apache.googlesource.com/hadoop-common/+/refs/heads/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/alias/javakeystoreprovider.java
1条答案
按热度按时间t8e9dugd1#
我会尝试使用hadoop认证api
hadoop从hadoop2.6版本开始就引入了keystore。您可以将密钥存储路径和别名传递给spark程序，并在运行时从keystore获取密码
https://hadoop.apache.org/docs/r2.6.0/hadoop-project-dist/hadoop-common/commandsmanual.html#credential
下面是示例java程序https://apache.googlesource.com/hadoop-common/+/refs/heads/trunk/hadoop-common-project/hadoop-common/src/main/java/org/apache/hadoop/security/alias/javakeystoreprovider.java