Cloud Run 实例化 SecretManagerServiceClient 凭证报错问题
我在Google Cloud Shell环境下,无需密钥文件即可成功初始化SecretManagerServiceClient,实现代码如下:
from google.cloud import secretmanager from google.oauth2 import service_account from google.auth.exceptions import DefaultCredentialsError import logging import sys import os def list_secrets(client, project_id): """ Retrieve all secrets associated with a project :param project_id: the alpha-numeric name of the project :return: a generator of Secrets """ try: secret_list = client.list_secrets(request={"parent": "projects/{}".format(project_id)}) except Exception as e: sys.exit("Did not successfully retrieve secret list.") return secret_list def set_env_secrets(client, secret_ids, label=None): """ Sets secrets retrieved from Google Secret Manager in the runtime environment of the Python process :param secret_ids: a generator of Secrets :param label: Secrets with this label will be set in the environment """ for s in secret_ids: # we only want secrets with matching labels (or all of them if label wasn't specified) if not label or label in s.labels: version = client.access_secret_version(request={'name': '{}/versions/latest'.format(s.name)}) payload_str = version.payload.data.decode("UTF-8") os.environ[s.name.split('/')[-1]] = payload_str if __name__ == "__main__": client = secretmanager.SecretManagerServiceClient() secrets = list_secrets(client, "myprojectid-123456") set_env_secrets(client, secrets) print(os.getenv("DATA_DB_HOST"))
将同类代码作为Google Cloud Run容器的入口程序运行时,尝试通过默认服务账号凭证创建上述客户端的操作执行失败,报错信息如下:
File "entry_point.py", line 27, in get_client client = secretmanager.SecretManagerServiceClient() File "/usr/local/lib/python3.6/site-packages/google/cloud/secretmanager_v1/services/secret_manager_service/client.py", line 274, in __init__ client_info=client_info, File "/usr/local/lib/python3.6/site-packages/google/cloud/secretmanager_v1/services/secret_manager_service/transports/grpc.py", line 162, in __init__ scopes=self.AUTH_SCOPES, quota_project_id=quota_project_id File "/usr/local/lib/python3.6/site-packages/google/auth/_default.py", line 340, in default credentials, project_id = checker() File "/usr/local/lib/python3.6/site-packages/google/auth/_default.py", line 186, in _get_explicit_environ_credentials os.environ[environment_vars.CREDENTIALS] File "/usr/local/lib/python3.6/site-packages/google/auth/_default.py", line 97, in load_credentials_from_file "File {} was not found.".format(filename) google.auth.exceptions.DefaultCredentialsError: File was not found.
项目默认服务账号已被授予Editor、Secret Manager Admin角色(感谢@DanielOcando提出的相关提示)。按照官方文档说明,应用默认凭证(ADC)库应当自动识别运行环境内默认服务账号的权限,完成客户端实例化,但实际运行时该逻辑并未生效。
排查更新1
针对依赖版本匹配的疑问,当前容器基于Python 3.6.12构建,所用依赖版本如下:
Django==2.1.15 django-admin-rangefilter==0.3.7 django-extensions==2.1.2 django-ipware==1.1.6 pytz==2017.3 psycopg2==2.7.3.2 waitress==1.4.1 geoip2==2.6 gunicorn==19.9.0 social-auth-app-django==3.1.0 semver==2.8.1 sentry-sdk==0.6.9 google-api-core==1.23.0 google-auth==1.23.0 google-cloud-secret-manager==2.0.0
后续创建了自定义服务账号,为其配置Editor、Secret Manager Admin角色,通过控制台部署绑定该服务账号的Cloud Run新修订版本,仍出现相同报错。
排查更新2
考虑到可能是Python版本与Cloud Shell环境不匹配导致问题,将镜像重构为基于Python 3.7版本构建,问题仍未解决。
排查更新3
调整排查思路,为项目默认服务账号新增Service Account Token Creator角色,编写Terraform配置实现服务账号模拟授权,同时在执行Terraform前先在Shell环境运行gcloud auth application-default login完成本地认证,对应Terraform配置代码如下:
provider "google" { alias = "tokengen" } data "google_client_config" "default" { provider = google.tokengen } data "google_service_account_access_token" "sa" { provider = "google.tokengen" target_service_account = "XXXXXXXXXXXX-compute@developer.gserviceaccount.com" lifetime = "600s" scopes = [ "https://www.googleapis.com/auth/cloud-platform", ] } provider "google" { project = "myprojectid-123456" region = "us-central1" zone = "us-central1-f" #impersonate_service_account = "XXXXXXXXXXXX-compute@developer.gserviceaccount.com } resource "google_cloud_run_service" "default" { name = "myprojectid-123456" location = "us-central1" template { spec { containers { image = "us.gcr.io/myprojectid-123456/testimage" } } } traffic { percent = 100 latest_revision = true } }
上述配置可正常创建Cloud Run服务,但当服务端点尝试实例化SecretManagerServiceClient时,仍返回相同的凭证找不到报错。
内容的提问来源于stack exchange,提问作者chb

