Swift实现iOS端实时将16:9视频裁剪为9:16的高效方案咨询

最优方案：利用AVPlayerLayer的硬件加速裁剪（最低CPU占用） #

直接使用AVPlayerLayer的videoGravity属性是最快且最省资源的方式，所有缩放、裁剪操作由系统GPU硬件处理，几乎不占用CPU。

• 核心实现步骤：
  1. 用AVPlayer加载S3的视频URL：

     let videoURL = URL(string: "your-s3-video-url")!
     let player = AVPlayer(url: videoURL)
     

  2. 创建AVPlayerLayer并设置播放区域为9:16比例（比如全屏）：

     let playerLayer = AVPlayerLayer(player: player)
     playerLayer.frame = view.bounds // 假设view是9:16的播放容器
     

  3. 设置videoGravity为.resizeAspectFill，自动保持视频比例并裁剪超出部分：

     playerLayer.videoGravity = .resizeAspectFill
     

  4. 将layer添加到视图层级：

     view.layer.addSublayer(playerLayer)
     

自定义裁剪位置的进阶方案（依然硬件加速） #

如果需要指定裁剪区域（比如不居中裁剪），可以通过AVMutableVideoComposition配合变换实现，同样基于硬件加速，CPU占用可控。

示例代码：

import AVFoundation

// 加载视频资源
let asset = AVAsset(url: videoURL)
guard let videoTrack = asset.tracks(withMediaType: .video).first else { return }

// 创建合成轨道
let composition = AVMutableComposition()
let compositionTrack = composition.addMutableTrack(withMediaType: .video, preferredTrackID: kCMPersistentTrackID_Invalid)
try? compositionTrack?.insertTimeRange(CMTimeRangeMake(start: .zero, duration: asset.duration), of: videoTrack, at: .zero)

// 设置9:16的渲染尺寸
let targetSize = CGSize(width: 1080, height: 1920)
let videoComposition = AVMutableVideoComposition()
videoComposition.renderSize = targetSize
videoComposition.frameDuration = videoTrack.minFrameDuration
videoComposition.renderScale = UIScreen.main.scale

// 计算缩放和偏移变换（比如向左偏移裁剪）
let originalSize = videoTrack.naturalSize
let scaleFactor = targetSize.height / originalSize.height // 缩放至填满9:16的高度
let scaledSize = CGSize(width: originalSize.width * scaleFactor, height: targetSize.height)
let offsetX = (scaledSize.width - targetSize.width) * 0.25 // 左移25%宽度，实现左侧裁剪
let transform = CGAffineTransform(scaleX: scaleFactor, y: scaleFactor)
    .translatedBy(x: -offsetX, y: 0)
    .concatenating(videoTrack.preferredTransform)

// 创建轨道指令
let layerInstruction = AVMutableVideoCompositionLayerInstruction(assetTrack: compositionTrack!)
layerInstruction.setTransform(transform, at: .zero)
let instruction = AVMutableVideoCompositionInstruction()
instruction.timeRange = CMTimeRangeMake(start: .zero, duration: asset.duration)
instruction.layerInstructions = [layerInstruction]
videoComposition.instructions = [instruction]

// 创建带自定义合成的PlayerItem
let playerItem = AVPlayerItem(asset: asset)
playerItem.videoComposition = videoComposition
let player = AVPlayer(playerItem: player)

降低CPU占用的关键注意事项 #

1. 优先用videoGravity方案：避免不必要的视频合成操作，最大程度利用系统硬件加速
2. 确保视频格式兼容：使用H.264/H.265编码的视频，iOS原生支持硬件解码，避免软件解码导致的高CPU占用
3. 避免自定义帧处理：不要用OpenGL/Metal手动渲染每一帧，这种方式会大幅增加CPU和GPU负载

内容的提问来源于stack exchange，提问作者Devin Dixon