iOS 17.0 相机实时画面叠加检测框捕获失败求助

核心问题原因 #

你遇到的问题本质是VideoPreviewLayer属于AVFoundation的硬件加速图层，其内容由相机硬件直接输出，并非常规CPU渲染的图层，所以常规的layer.render或子layer遍历无法捕获到它的画面；而AVCapturePhotoCaptureDelegate仅能获取相机原始帧，不包含屏幕叠加的检测框。

可行解决方案 #

方案1：使用UIView.drawHierarchy捕获完整屏幕内容 #

这个方法会触发整个视图及其所有子图层（包括VideoPreviewLayer）的屏幕渲染快照，能同时捕获相机画面和检测框，实现简单：

func captureCombinedSnapshot() -> UIImage? {
    UIGraphicsBeginImageContextWithOptions(view.bounds.size, view.isOpaque, UIScreen.main.scale)
    // afterScreenUpdates设为true确保最新的检测框被捕获
    view.drawHierarchy(in: view.bounds, afterScreenUpdates: true)
    let capturedImage = UIGraphicsGetImageFromCurrentImageContext()
    UIGraphicsEndImageContext()
    return capturedImage
}

方案2：手动合成相机帧与检测框（高性能场景） #

如果需要频繁捕获（比如实时连续截图），直接处理相机原始帧再叠加检测框的性能更优，避免屏幕快照的额外开销：

1. 从相机获取实时帧并转换为UIImage

func imageFromSampleBuffer(_ sampleBuffer: CMSampleBuffer) -> UIImage? {
    guard let imageBuffer = CMSampleBufferGetImageBuffer(sampleBuffer) else { return nil }
    CVPixelBufferLockBaseAddress(imageBuffer, .readOnly)
    defer { CVPixelBufferUnlockBaseAddress(imageBuffer, .readOnly) }
    
    let baseAddress = CVPixelBufferGetBaseAddress(imageBuffer)
    let width = CVPixelBufferGetWidth(imageBuffer)
    let height = CVPixelBufferGetHeight(imageBuffer)
    let bytesPerRow = CVPixelBufferGetBytesPerRow(imageBuffer)
    let colorSpace = CGColorSpaceCreateDeviceRGB()
    let bitmapInfo = CGBitmapInfo(rawValue: CGImageAlphaInfo.noneSkipFirst.rawValue)
    
    guard let context = CGContext(data: baseAddress, width: width, height: height, bitsPerComponent: 8, bytesPerRow: bytesPerRow, space: colorSpace, bitmapInfo: bitmapInfo.rawValue) else { return nil }
    guard let cgImage = context.makeImage() else { return nil }
    return UIImage(cgImage: cgImage)
}

2. 叠加检测框到相机帧上

func combineCameraFrameWithBoxes(cameraImage: UIImage, detectionBoxes: [CGRect]) -> UIImage? {
    UIGraphicsBeginImageContextWithOptions(cameraImage.size, false, cameraImage.scale)
    cameraImage.draw(in: CGRect(origin: .zero, size: cameraImage.size))
    
    // 绘制检测框（可根据需求调整颜色、线宽）
    let context = UIGraphicsGetCurrentContext()
    context?.setStrokeColor(UIColor.red.cgColor)
    context?.setLineWidth(2)
    for box in detectionBoxes {
        context?.stroke(box)
    }
    
    let combinedImage = UIGraphicsGetImageFromCurrentImageContext()
    UIGraphicsEndImageContext()
    return combinedImage
}

使用时，在AVCaptureVideoDataOutput的代理方法中拿到实时CMSampleBuffer，转成UIImage后调用合成方法即可。

内容的提问来源于stack exchange，提问作者Pradeep Banavara