求助：LibVLCSharp AudioCallback+iOS AVAudioEngine声音延迟/杂音问题

问题1：音频延迟1-2秒的修复 #

核心原因 #

• PlayAudio使用async void，LibVLC音频回调为同步执行逻辑，异步调用会导致缓冲区调度被推迟，积累延迟
• 未禁用LibVLC默认音频输出模块，音频数据被重复处理
• AVAudioEngine未提前初始化启动，首次调度时引擎启动产生额外开销

修复步骤 #

1. 禁用LibVLC默认音频输出
   初始化LibVLC时添加参数，阻止其自带的音频输出流程：

   var libVLC = new LibVLC("--no-audio", "--audio-time-stretch=0");
   

   注：--no-audio让LibVLC不处理音频输出，--audio-time-stretch=0关闭时间拉伸，避免干扰PTS计算

2. 将异步调度改为同步执行
   避免在回调中使用await，改用同步调度并确保在音频引擎队列执行，防止线程冲突：

   private void PlayAudio(IntPtr data, IntPtr samples, uint count, long pts)
   {
       var pcmBuffer = ConvertBufferMehotd(samples);
       audioEngine.PerformOnMainThread(() =>
       {
           playerNode.ScheduleBuffer(pcmBuffer);
       });
   }
   

3. 提前初始化并启动AVAudioEngine
   在页面加载或播放器初始化阶段完成引擎启动，不要等到第一个缓冲区到来才初始化：

   audioEngine = new AVAudioEngine();
   playerNode = new AVAudioPlayerNode();
   audioEngine.AttachNode(playerNode);
   var mainMixer = audioEngine.MainMixerNode;
   audioEngine.Connect(playerNode, mainMixer, AVAudioFormat.CreateStandardFormat(44100, 2));
   NSError error;
   audioEngine.StartAndReturnError(out error);
   playerNode.Play();
   

问题2：PTS同步后出现杂音的修复 #

核心原因 #

• PTS转AVAudioTime时精度错误，导致缓冲区调度时间点偏差，出现间隙或重叠
• 缓冲区转换时采样率、通道数、位深与AVAudioEngine不匹配
• 异步调度导致缓冲区时序混乱，出现丢包或重复播放

修复步骤 #

1. 正确转换PTS为AVAudioTime
   LibVLC的PTS单位为微秒，需转换为AVAudioEngine设备时钟对应的时间：

   private AVAudioTime ConvertPtsToAudioTime(long pts)
   {
       double ptsInSeconds = pts / 1000000.0;
       var deviceClock = audioEngine.InputNode.InputFormatForBus(0).Clock;
       return AVAudioTime.CreateTimeWithSampleTime(
           (long)(ptsInSeconds * deviceClock.SampleRate),
           deviceClock
       );
   }
   

2. 确保缓冲区格式与引擎完全匹配
   转换缓冲区时严格对齐采样率、通道数等参数：

   private AVAudioPCMBuffer ConvertBufferMehotd(IntPtr samples, uint count)
   {
       // 按LibVLC实际输出格式调整，示例为16位单声道44100Hz
       var format = AVAudioFormat.CreateStandardFormat(44100, 1);
       var buffer = new AVAudioPCMBuffer(format, count);
       System.Runtime.InteropServices.Marshal.Copy(samples, buffer.Int16ChannelData[0], 0, (int)count);
       return buffer;
   }
   

3. 同步调度并校验时序
   在音频引擎队列执行调度，同时检查调度时间是否晚于当前播放位置，避免时序混乱：

   private void PlayAudio(IntPtr data, IntPtr samples, uint count, long pts)
   {
       var pcmBuffer = ConvertBufferMehotd(samples, count);
       var scheduleTime = ConvertPtsToAudioTime(pts);
       
       audioEngine.PerformOnMainThread(() =>
       {
           var currentTime = playerNode.LastRenderTime;
           if (currentTime != null && scheduleTime.SampleTime < currentTime.SampleTime)
           {
               scheduleTime = currentTime;
           }
           playerNode.ScheduleBuffer(pcmBuffer, scheduleTime, AVAudioPlayerNodeBufferOptions.None);
       });
   }
   

4. 正确实现Flush和Drain回调
   重置播放器节点，确保缓冲区清空：

   private void FlushAudio(IntPtr data)
   {
       audioEngine.PerformOnMainThread(() =>
       {
           playerNode.Stop();
           playerNode.Play();
       });
   }
   
   private void DrainAudio(IntPtr data)
   {
       audioEngine.PerformOnMainThread(() =>
       {
           playerNode.Stop();
       });
   }
   

内容的提问来源于stack exchange，提问作者Eric