关于GCP Dataproc是否支持WebHCat及端点URL的技术咨询

Hey there! Let's clear this up for you right away:

GCP Dataproc does include and support WebHCat (also known as Templeton) — this REST API service for submitting Hive, Pig, and MapReduce jobs is installed and enabled by default when you deploy a Dataproc cluster.

WebHCat URL Endpoint Format #

The default endpoint for WebHCat on your Dataproc cluster follows this structure:

http://<CLUSTER_MASTER_HOSTNAME>:50111/templeton/v1

Replace <CLUSTER_MASTER_HOSTNAME> with your cluster's master node external IP or internal hostname. You can find this info in the Dataproc cluster details page in the GCP Console, or run this gcloud command to retrieve it:

gcloud dataproc clusters describe <YOUR_CLUSTER_NAME> --region <YOUR_REGION>

Look for the config.masterConfig.hostname field in the output.

Quick Validation Tip #

To confirm WebHCat is running, you can send a simple curl request to check the version:

curl http://<CLUSTER_MASTER_HOSTNAME>:50111/templeton/v1/version

If it's working, you'll get a JSON response with WebHCat version details. Just make sure your network/firewall rules allow access to port 50111 on the master node!

内容的提问来源于stack exchange，提问作者jamiet