若您的集群开启了kerberos认证，请先参考之前的《配置集群客户端教程》：
5.【华为 FusionInsight MRS】配置集群客户端教程
当您部署好集群客户端后，可以按照如下教程在执行代理服务器上进行配置。
sudo yum install krb5-server krb5-libs krb5-workstation
根据下载的keytab查询对应的Principal
klist -ket /etc/security/keytabs/user.keytab 结果如下： Keytab name: FILE:/etc/security/keytabs/user.keytab KVNO Timestamp Principal ---- ------------------- ------------------------------------------------------ 7 03/27/2019 20:16:46 test1@HADOOP.COM (aes256-cts-hmac-sha1-96) 7 03/27/2019 20:16:46 test1@HADOOP.COM (aes128-cts-hmac-sha1-96)
使用keytab验证Principal的权限
kinit -kt /etc/security/keytabs/user.keytab test1@HADOOP.COM
验证
# 进入spark目录,请注意：spark目录可能因集群版本而改变 cd /opt/client/Spark2x/spark # 执行sparkPi，指定调度队列为dev，请注意：spark-examples的jar包版本可能因集群版本而改变 ./bin/spark-submit --class org.apache.spark.examples.SparkPi --master yarn --queue root.dev --name sparkPi examples/jars/spark-examples_2.11-2.1.0.jar 100 # 结果: ...... 17/10/14 14:52:30 INFO Submitted application application_1507947630013_0003 17/10/14 14:53:12 INFO scheduler.DAGScheduler: Job 0 finished: reduce at SparkPi.scala:38, took 1.976050 s Pi is roughly 3.1411539141153915 ......
