使用AWS SageMaker create-training-job CLI命令遇参数验证错误求助

The error you're hitting stems from your shell incorrectly parsing the nested dictionary structure in the --input-data-config parameter. It’s splitting the S3DataSource properties into separate entries in the InputDataConfig list instead of treating them as a single nested dictionary. Here’s how to fix it:

Corrected Command #

Wrap the entire value of --input-data-config in double quotes to block shell expansion of curly braces, while keeping your variable injections intact:

aws sagemaker create-training-job \
  --training-job-name $(DEPLOYMENT_NAME)-$(BUILD_ID) \
  --hyper-parameters file://sagemaker/hyperparameters.json \
  --algorithm-specification TrainingImage=$(IMAGE_NAME),TrainingInputMode="File" \
  --role-arn $(ROLE) \
  --input-data-config "ChannelName=training,DataSource={S3DataSource={S3DataType=S3Prefix,S3Uri=$(S3_INPUT),S3DataDistributionType=FullyReplicated}},ContentType=string,CompressionType=None,RecordWrapperType=None" \
  --output-data-config S3OutputPath=$(S3_OUTPUT) \
  --resource-config file://sagemaker/train-resource-config.json \
  --stopping-condition file://sagemaker/stopping-conditions.json

Why This Fixes the Problem #

• Shell Parsing Quirk: Without quotes, your shell interprets {} as glob expansion characters, breaking apart the S3DataSource properties into invalid separate elements. The CLI then sees these as standalone entries in InputDataConfig instead of a single nested dictionary.
• Proper Shorthand Structure: Wrapping the parameter value in quotes preserves the nested hierarchy the SageMaker CLI expects. The format DataSource={S3DataSource={Key=Value,...}} correctly represents the nested object structure required for input data configuration.

Quick Validation Trick #

If you want to double-check the expected syntax before running the job, use this flag to output the official structure:

aws sagemaker create-training-job --generate-cli-skeleton input

This will show you the exact shorthand or JSON format for all parameters, helping you confirm nested structures are formatted correctly.

内容的提问来源于stack exchange，提问作者tlanigan