Node.js环境下不使用Lambda函数，同步为AWS上传视频生成并存储缩略图的方法及ffmpeg路径配置疑问

Great question! Let's break this down clearly:

Can you pass an AWS S3 path directly to the thumbnail function's second parameter? #

No, you can't. The second parameter in fluent-ffmpeg's thumbnail() method expects a local filesystem path—ffmpeg itself doesn't support writing output directly to S3. It can only generate files on your server's local storage first.

How to fix this (step-by-step solution) #

Your current workflow (upload video to S3 → generate thumbnail from S3 video) is valid, but you need to adjust the thumbnail step to:

1. Generate the thumbnail locally (use a temporary directory to avoid clutter)
2. Upload the local thumbnail file to AWS S3
3. Clean up the local temporary file afterward

Here's how to modify your code to implement this:

First, add dependencies you'll need (if you don't have them already):

npm install aws-sdk tmp

Then update your code:

const ffmpegPath = require('@ffmpeg-installer/ffmpeg').path;
const ffmpeg = require('fluent-ffmpeg');
ffmpeg.setFfmpegPath(ffmpegPath);
const ffprobe = require('ffprobe-static');
ffmpeg.setFfprobePath(ffprobe.path);
const AWS = require('aws-sdk');
const fs = require('fs');
const path = require('path');
const tmp = require('tmp');

// Initialize AWS S3 client
const s3 = new AWS.S3({
  accessKeyId: process.env.AWS_ACCESS_KEY_ID,
  secretAccessKey: process.env.AWS_SECRET_ACCESS_KEY,
  region: process.env.AWS_REGION
});

// ... your existing upload logic ...

// Generate thumbnail and upload to S3
let thumbnailFilename;

// Create a temporary directory to store the thumbnail
tmp.dir({ unsafeCleanup: true }, (err, tmpDir, cleanupTmp) => {
  if (err) {
    console.error("Failed to create temp directory:", err);
    return res.status(500).json({ success: false, message: "Thumbnail generation failed" });
  }

  ffmpeg({ source: req.files[k].location })
    .on('filenames', (filenames) => {
      console.log("Generated thumbnail filename:", filenames[0]);
      thumbnailFilename = filenames[0];
    })
    .on('end', () => {
      const localThumbnailPath = path.join(tmpDir, thumbnailFilename);
      
      // Prepare S3 upload parameters
      const s3UploadParams = {
        Bucket: process.env.AWS_S3_BUCKET_NAME, // Replace with your bucket name
        Key: `thumbnails/${thumbnailFilename}`, // Customize your S3 path here
        Body: fs.createReadStream(localThumbnailPath),
        ContentType: 'image/jpeg' // Thumbnails are typically JPEG; adjust if needed
      };

      // Upload thumbnail to S3
      s3.upload(s3UploadParams, (s3Err, s3Data) => {
        cleanupTmp(); // Always clean up the temp directory, even if upload fails

        if (s3Err) {
          console.error("Failed to upload thumbnail to S3:", s3Err);
          return res.status(500).json({ success: false, message: "Thumbnail upload failed" });
        }

        // Add thumbnail details to your response data
        uploadedMedia.push({
          fileName: thumbnailFilename,
          mimeType: 'image/jpeg',
          location: s3Data.Location,
          isThumbnail: true
        });

        return res.status(200).json({ 
          success: true, 
          message: "Files and thumbnail uploaded successfully", 
          data: uploadedMedia 
        });
      });
    })
    .on('error', (err) => {
      cleanupTmp();
      console.error("Error generating thumbnail:", err);
      return res.status(500).json({ success: false, message: "Thumbnail generation failed" });
    })
    .thumbnail({ 
      filename: `thumbnail_${req.files[k].key.split('.')[0]}`,
      count: 1,
      // Optional: Add size parameter to control thumbnail resolution, e.g., size: '320x240'
    }, tmpDir); // Output thumbnail to the temporary directory
});

Key notes: #

• Temporary directories: Using the tmp package ensures you don't leave leftover thumbnail files on your server. The unsafeCleanup: true flag deletes the directory even if it has files inside.
• S3 upload: We use the official AWS SDK to upload the local thumbnail file to your S3 bucket. Adjust the Key parameter to match your desired S3 folder structure.
• Performance consideration: If you're handling large videos, generating thumbnails synchronously in your API request can slow down responses. For production, consider using an asynchronous task queue (like BullMQ) to offload thumbnail processing to a background worker.

内容的提问来源于stack exchange，提问作者RHF