Reality Composer Pro多帧BlendShape动画导入失败求助

问题背景 #

• 目标：在Apple Vision Pro应用中渲染有限元分析（FEA）输出的固体力学3D仿真结果
• 起始条件：拥有带节点形变的表面VTK文件，每个时间步对应独立网格（含节点坐标），已转为USD MeshSequence，但无法简化为基础变换动画
• 工具：Xcode + Reality Composer Pro（RCP）
• 技术限制：RCP支持BlendMesh与骨骼动画，MeshSequence兼容无问题

当前进展 #

1. VTK转USD MeshSequence操作成功，在Preview和Blender中可正常播放动画：
   
2. 已将MeshSequence转为多关键帧BlendMesh，在Blender和Preview中动画正常，但导入RCP后，BlendMesh动画时长显示为0：
   

核心问题 #

如何正确设置从多网格/多关键形状创建的BlendMesh动画，使其能被RCP正确识别并播放？

附当前USDA文件结构 #

#usda 1.0
(
    defaultPrim = "BlendMeshRoot"
    doc = "Blender v4.5.3 LTS"
    endTimeCode = 48
    framesPerSecond = 24
    metersPerUnit = 1
    startTimeCode = 0
    timeCodesPerSecond = 24
    upAxis = "Z"
)
 
def Xform "BlendMeshRoot" (
    customData = {
        dictionary Blender = {
            bool generated = 1
        }
    }
)
{
    def SkelRoot "Mesh"
    {
        custom string userProperties:blender:object_name = "Mesh"
        float3 xformOp:rotateXYZ = (89.99999, -0, 0)
        float3 xformOp:scale = (0.009999999, 0.01, 0.01)
        double3 xformOp:translate = (0, 0, 0)
        uniform token[] xformOpOrder = ["xformOp:translate", "xformOp:rotateXYZ", "xformOp:scale"]
 
        def Mesh "Mesh" (
            active = true
            prepend apiSchemas = ["MaterialBindingAPI", "SkelBindingAPI"]
        )        
        {
            uniform bool doubleSided = 1
            float3[] extent = [(25.091871, -34.121277, -13.298501), (299.94482, 245.10088, 202.35126)]
            int[] faceVertexCounts = [3, 3, ...
            int[] faceVertexIndices = [0, 10293, ...
            rel material:binding = </BlendMeshRoot/_materials/MeshSequence_Default>
            normal3f[] normals = [(-0.3632836, -0.9102419, -0.19870725), ....
            point3f[] points = [(244.41148, 155.42062, 70.454926),.....
            float3[] primvars:node_displacement = [(93.54703, 110.9341, 48.37992)....
            float3[] primvars:Normals = [(-0.0050530406, -0.9910114, -0.13368203),...
            int[] primvars:skel:jointIndices = [0, 0, 0, 0, 0 ...
            float[] primvars:skel:jointWeights = [1, 1, 1, 1, 1...
            uniform token[] skel:blendShapes = ["frame_0000", "frame_0001", "frame_0002", "frame_0003", "frame_0004", "frame_0005"]
            rel skel:blendShapeTargets = [
                </BlendMeshRoot/Mesh/Mesh/frame_0000>,
               .......
                </BlendMeshRoot/Mesh/Mesh/frame_0005>,
            ]
            prepend rel skel:skeleton = </BlendMeshRoot/Mesh/Skel>
            uniform token subdivisionScheme = "none"
            custom string userProperties:blender:data_name = "Mesh"
            custom float userProperties:originalTime
            float userProperties:originalTime.timeSamples = {
                0: 0,
            }
 
            def BlendShape "frame_0000"
            {
                uniform vector3f[] offsets = [(0, 0, 0), (0, 0, 0),.....
                uniform int[] pointIndices = [0, 1, 2, .....
            }
           .....
           .....
#### BlendShape frame to 0005
           .....
        def Skeleton "Skel" (
            prepend apiSchemas = ["SkelBindingAPI"]
        )
        {
            uniform matrix4d[] bindTransforms = [( (1, 0, 0, 0), (0, 1, 0, 0), (0, 0, 1, 0), (0, 0, 0, 1) )]
            uniform token[] joints = ["joint1"]
            uniform matrix4d[] restTransforms = [( (1, 0, 0, 0), (0, 1, 0, 0), (0, 0, 1, 0), (0, 0, 0, 1) )]
            prepend rel skel:animationSource = </BlendMeshRoot/Mesh/Skel/Anim>
 
            def SkelAnimation "Anim"
            {
                uniform token[] blendShapes = ["frame_0000", "frame_0001", "frame_0002", "frame_0003", "frame_0004", "frame_0005"]
                float[] blendShapeWeights.timeSamples = {
                    0: [1, 0, 0, 0, 0, 0],
                    1: [0.9697085, 0.03029152, 0, 0, 0, 0],
                    2: [0.88787615, 0.11212383, 0, 0, 0, 0],
                     .....
                    46: [0, 0, 0, 0, 0.11212379, 0.8878762],
                    47: [0, 0, 0, 0, 0.030291557, 0.96970844],
                    48: [0, 0, 0, 0, 0, 1],
                }
            }
        }
    }
 
    def Scope "_materials"
    {
        def Material "MeshSequence_Default"
        {
            token outputs:surface.connect = </BlendMeshRoot/_materials/MeshSequence_Default/Principled_BSDF.outputs:surface>
            custom string userProperties:blender:data_name = "MeshSequence_Default"
 
            def Shader "Principled_BSDF"
            {
                uniform token info:id = "UsdPreviewSurface"
                float inputs:clearcoat = 0
                float inputs:clearcoatRoughness = 0.03
                color3f inputs:diffuseColor = (0.8, 0.4, 0.3)
                float inputs:ior = 1.5
                float inputs:metallic = 0
                float inputs:opacity = 1
                float inputs:roughness = 0.5
                float inputs:specular = 0.2
                token outputs:surface
            }
        }
    }
 
    def Scope "AnimationClips"
    {
        custom rel animations = </BlendMeshRoot/Mesh/Skel/Anim>
    }
 
    def RealityKitComponent "AnimationLibrary"
    {
        custom rel animations = </BlendMeshRoot/Mesh/Skel/Anim>
        custom token info:id = "RealityKit.AnimationLibrary"
        custom double realitykit:approximateDuration = 2
        custom double[] realitykit:clipDurations = [2]
        custom string[] realitykit:clipNames = ["Anim"]
        custom rel realitykit:clipTargets = </BlendMeshRoot/Mesh/Skel/Anim>
        custom double realitykit:frameRate = 24
        custom bool realitykit:isAnimationLibrary = 1
    }
}

解决方案 #

1. 修正RealityKit动画库的时间配置 #

• 移除Blender生成的userProperties:originalTime字段，该字段仅含0时刻采样，可能干扰RCP的时间范围识别
• 确认SkelAnimation的时间采样覆盖完整范围（0到48帧，对应2秒），且最后一帧时间戳明确为48

2. 简化BlendShape结构 #

• 确保每个BlendShape的pointIndices与主Mesh的points数组长度完全匹配、顺序一致
• 移除primvars:node_displacement等非RCP识别的自定义属性，避免解析冲突

3. 调整Skeleton绑定 #

• 确保Skeleton的bindTransforms和restTransforms与主Mesh的变换完全对齐
• 若仅用BlendShape动画，可移除primvars:skel:jointIndices和primvars:skel:jointWeights中冗余的全1值，简化骨骼绑定为最小结构

4. 手动在RCP中重新关联动画 #

导入USD后：

1. 选中Mesh对象，打开Animations面板
2. 点击Add Animation，选择导入的Anim剪辑
3. 手动设置动画时长为2秒、帧率24fps，触发RCP重新解析时间范围

5. 备选方案：直接使用MeshSequence #

若BlendMesh路径仍有问题，可跳过转换步骤：

• 将VTK转为USD MeshSequence后直接导入RCP
• 在Xcode中通过Entity.load(named:)加载，用AnimationController控制播放

内容的提问来源于stack exchange，提问作者Alfonso Santiago