All Questions
430 questions
0
votes
1
answer
54
views
Error: `callbackHandler` may not be null when connecting to HDFS using Kerberos in Jakarta EE
I am trying to connect to HDFS using Kerberos authentication in a JakartaEE application. The connection code appears to be set up correctly, but I am encountering the following error when attempting ...
0
votes
0
answers
39
views
Hivemetastore - create external db failing due to kerberos authentication
I have a hive metastore setup on derby. I want to create an external table. The data sits on a remote hdfs location. I am using kerberos auth. My hive-site and core-site and hdfs-site have all the ...
1
vote
1
answer
127
views
Is it possible to disable Hadoop yarn PTR check when kerberos is enabled?
We have a hadoop cluster which currenty is running on Public IP. We want to change the cluster ip to Private IP addresses. So it doesnt be routable from internet. But the main problem is that When the ...
- 395
1
vote
1
answer
990
views
Connect to HDFS using ticket cache instead of keytab file
I have two clusters(cluster 1 and cluster 2) and both are secured with kerberos authentication. I can only read the data from both clusters and cannot change configuration files on any of these ...
- 29
1
vote
1
answer
214
views
How to kill YARN job using Resource Manager REST API
we have a kerberos enabled EMR cluster. I would like to kill yarn jobs using RM API through an other application.
curl -v -X PUT -H "Content-Type: application/json" -d '{"state": &...
- 5
1
vote
0
answers
360
views
Standalone Spark cluster can't access secure Hadoop by Kerberos
The symptom is similar to standalone spark cluster unable to read hdfs from executor on kerberized cluster but have different error messages.
The setup is a Spark 3.3.1 based standalone cluster (1 ...
- 427
0
votes
0
answers
102
views
Java HDFS listStatus: AccessControlException: Client cannot authenticate via:[TOKEN, KERBEROS]
I'm trying to list files from Name Node.
My application is run at Data Node with following Hdfs configuration:
Configuration config = new Configuration();
System.setProperty("java.security....
- 1,374
0
votes
1
answer
778
views
Web interface login Apache Hadoop Cluster with Kerberos
I've a Docker stack with an Apache Hadoop (version 3.3.4) cluster, composed by one namenode and two datanodes, and a container with both Kerberos admin server and Kerberos kdc.
I'm trying to configure ...
- 179
0
votes
1
answer
179
views
Kerberos HTTP service Using GSS shows No valid credentials due to domain name or host name mismatch
I am having a Micro-Service Platform having multiple Micro-Services connected to each other, Platform uses Kerberos for authentication of Micro-Services. In One of Micro-Service Node hadoop is ...
- 53
0
votes
1
answer
436
views
How to configure Hive Cli to automatically get the kerberos ticket and renew/request new if expires by it own
Hi I am new to Hive and kerberos.
I have some hive jobs which run more then life time of ticket. how can I configure hive so that when I start hive shell if ticket is not cached it automatically ...
- 53
1
vote
0
answers
96
views
What happens if some hadoop map-reduce Job or some hdfs command is running and in the between kerberos ticket expires?
Lets say we have kerberos secured Hadoop Cluster. ( For example Kdc is configured to provide kerberos tickets with validity of 2 hour and renewal period of 3 hours after this so total 5 hours. )
...
- 53
0
votes
0
answers
503
views
Jobs are failing due to Kerberos issues
I'm getting the following error in my cluster (HDP 3.1, NameNode HA, Kerberos security via AD integration):
23/01/12 05:03:13 INFO HiveMetaStoreClient: HMSC::open(): Could not find delegation token. ...
- 1
0
votes
0
answers
197
views
How to get Kerberos Authentication on my HDFS Web UI?
Wanting to secure the Hadoop web UI. NOT USING AMBARI. RHEL 7 single node cluster. Parameters are shown in images from my core-site.xml and security auth error on web UI shown in image as well. My ...
- 1
0
votes
0
answers
364
views
How to do kerberos authentication for Clickhouse HDFS disk?
In clickhouse documentation it is explained how to add hdfs disk by providing URL
<clickhouse>
<storage_configuration>
<disks>
<hdfs>
&...
- 261
0
votes
1
answer
862
views
NameNode Format error "failure to login for principal: X from keytab Y: Unable to obtain password from user" with Kerberos in a Hadoop cluster
I've been setting up Kerberos with my Hadoop cluster on Ubuntu 20.04.1 LTS and when I try to reformat the namenode in command line after changing all config files and setting everything up (including ...
- 3