Alright, let's break down exactly how to fetch that test.py file from your S3 bucket and execute it within an AWS Lambda function. I’ve implemented this pattern a few times, so here’s a step-by-step guide that should work for you:

First things first—your Lambda function needs permission to access the target S3 bucket and file. Don’t just attach a broad AmazonS3ReadOnlyAccess policy unless you have to; it’s better to use a least-privilege custom policy to limit access only to the specific file:

{
    "Version": "2012-10-17",
    "Statement": [
        {
            "Effect": "Allow",
            "Action": "s3:GetObject",
            "Resource": "arn:aws:s3:::your-bucket-name/path/to/test.py"
        }
    ]
}

Attach this policy to your Lambda’s execution role, and you’re good to go on the permissions front.

Here’s the full code to fetch the test.py content and execute it. I’ve included two common use cases—directly running the script, and loading it as a module to use classes/functions from it:

import boto3
import sys
from io import StringIO

def lambda_handler(event, context):
    # Replace these with your actual bucket name and file path
    s3_bucket = "your-bucket-name"
    s3_key = "path/to/test.py"
    
    # Initialize S3 client
    s3 = boto3.client('s3')
    
    try:
        # Fetch the file from S3
        s3_response = s3.get_object(Bucket=s3_bucket, Key=s3_key)
        # Read the content as a UTF-8 string (adjust encoding if needed)
        code_content = s3_response['Body'].read().decode('utf-8')
        
        # --- Option 1: Directly execute the entire test.py script ---
        # Use this if test.py has top-level executable code (e.g., print statements, immediate logic)
        exec(code_content)
        
        # --- Option 2: Load test.py as a module to use classes/functions ---
        # Use this if you want to import and use specific components from test.py
        module_name = "test_dynamic"
        # Create a new module object
        test_module = sys.modules.setdefault(module_name, type(sys)(module_name))
        # Execute the code in the module's namespace
        exec(code_content, test_module.__dict__)
        
        # Example: If test.py has a class called TestClass, instantiate it
        if hasattr(test_module, 'TestClass'):
            test_instance = test_module.TestClass()
            # Call methods from the class, e.g., test_instance.run()
            print("Successfully loaded and used TestClass from test.py")
        
        return {
            'statusCode': 200,
            'body': "Successfully fetched and processed test.py from S3"
        }
    
    except Exception as e:
        print(f"Error occurred: {str(e)}")
        return {
            'statusCode': 500,
            'body': f"Failed to process test.py: {str(e)}"
        }

• Encoding Issues: I’ve been burned by this before—make sure test.py is saved in UTF-8 encoding. If it uses a different encoding (like GBK for Chinese), update the decode() call to match, otherwise you’ll get a UnicodeDecodeError.
• Dependencies: If test.py relies on third-party libraries (like requests, pandas), you’ll need to package those dependencies with your Lambda function or use a Lambda Layer. Without them, you’ll get import errors.
• Security Risks: Executing dynamic code from S3 can be risky. Ensure only trusted users have write access to the S3 bucket/path, and avoid running unvetted code to prevent injection attacks.
• Cold Start Optimization: If your Lambda runs frequently, consider caching the test.py content in Lambda’s /tmp directory (you get 512MB of temporary storage). Check if the file exists locally first before fetching from S3 to reduce cold start time.

内容的提问来源于stack exchange，提问作者user2249827