如何在Swift中获取visionOS头显位姿实现物体平移交互？

核心实现思路 #

visionOS不再兼容iOS的ARView，需改用RealityView结合ImmersiveSpace实现AR相关能力。核心步骤：

• 借助RealityKit完成平面检测与物体锚定
• 通过ARSession获取头显实时位姿，同步更新物体位置
• 绑定SwiftUI捏合手势触发物体重建逻辑

完整代码示例 #

import SwiftUI
import RealityKit
import ARKit

struct ImmersiveView: View {
    @State private var circleEntity: Entity?
    @State private var triggerObjectReset = false
    
    var body: some View {
        RealityView { content, attachments in
            // 配置AR会话，启用水平平面检测
            guard let arSession = content.arSession else { return }
            let config = ARWorldTrackingConfiguration()
            config.planeDetection = .horizontal
            arSession.run(config)
            
            // 初始化圆形实体
            let circle = createCircleEntity()
            content.add(circle)
            circleEntity = circle
        } update: { content, attachments in
            guard let circle = circleEntity, 
                  let arSession = content.arSession,
                  let currentFrame = arSession.currentFrame else { return }
            
            // 获取头显实时位姿，将圆形固定在头显前方50cm处
            let headTransform = currentFrame.camera.transform
            var targetPos = headTransform.translation
            targetPos.z -= 0.5
            circle.position = targetPos
            
            // 捏合手势触发后重置物体
            if triggerObjectReset {
                circle.removeFromParent()
                let newCircle = createCircleEntity()
                content.add(newCircle)
                circleEntity = newCircle
                triggerObjectReset = false
            }
        }
        .gesture(
            PinchGesture()
                .onEnded { _ in
                    triggerObjectReset = true
                }
        )
    }
    
    // 创建带材质的圆形实体
    private func createCircleEntity() -> Entity {
        let mesh = MeshResource.generateCircle(radius: 0.1)
        let material = SimpleMaterial(color: .systemBlue, isMetallic: false)
        let entity = ModelEntity(mesh: mesh, materials: [material])
        
        // 让圆形始终朝向用户
        entity.components.add(LookAtComponent(target: Entity(named: "camera")))
        
        return entity
    }
}

@main
struct HeadTrackingDemoApp: App {
    var body: some Scene {
        ImmersiveSpace(id: "MainSpace") {
            ImmersiveView()
        }
    }
}

关键细节说明 #

• 头部位姿获取：通过ARSession.currentFrame?.camera.transform提取头显的实时平移/旋转数据，直接映射为物体的目标位置
• 平面锚定优化：若需严格贴合检测到的平面，可在update回调中监听AR会话返回的平面锚点，将圆形的y轴坐标设置为平面的高度值
• 手势逻辑：SwiftUI原生PinchGesture直接绑定到RealityView，手势结束时触发物体销毁与重建
• 交互体验：添加LookAtComponent让圆形始终面向用户，避免头部位姿变化导致物体视角偏移

内容的提问来源于stack exchange，提问作者Ahmad Fares