使用FFmpeg转换MP3分片为WAV时音频开头出现空白间隙求助

我从URL流式获取MP3音频，以1024字节缓冲区大小保存分片。收集完所有分片后，使用FFmpeg将22050Hz单声道的MP3分片转换为WAV分片，但每个WAV分片开头都存在空白间隙。用pydub处理也遇到同样问题。

处理分片的Python代码 #

subprocess.run(["ffmpeg", "-i",
    f"{Path.cwd()}/input/{path}",
    f"{Path.cwd()}/temp_output/{path.replace('.mp3', '')}.wav"
])

FFmpeg终端输出 #

processing: test-016.mp3
ffmpeg version 6.0 Copyright (c) 2000-2023 the FFmpeg developers
  built with Apple clang version 15.0.0 (clang-1500.0.40.1)
  configuration: --prefix=/usr/local/Cellar/ffmpeg/6.0_1 --enable-shared --enable-pthreads --enable-version3 --cc=clang --host-cflags= --host-ldflags='-Wl,-ld_classic' --enable-ffplay --enable-gnutls --enable-gpl --enable-libaom --enable-libaribb24 --enable-libbluray --enable-libdav1d --enable-libjxl --enable-libmp3lame --enable-libopus --enable-librav1e --enable-librist --enable-librubberband --enable-libsnappy --enable-libsrt --enable-libsvtav1 --enable-libtesseract --enable-libtheora --enable-libvidstab --enable-libvmaf --enable-libvorbis --enable-libvpx --enable-libwebp --enable-libx264 --enable-libx265 --enable-libxml2 --enable-libxvid --enable-lzma --enable-libfontconfig --enable-libfreetype --enable-frei0r --enable-libass --enable-libopencore-amrnb --enable-libopencore-amrwb --enable-libopenjpeg --enable-libspeex --enable-libsoxr --enable-libzmq --enable-libzimg --disable-libjack --disable-indev=jack --enable-videotoolbox --enable-audiotoolbox
  libavutil      58.  2.100 / 58.  2.100
  libavcodec     60.  3.100 / 60.  3.100
  libavformat    60.  3.100 / 60.  3.100
  libavdevice    60.  1.100 / 60.  1.100
  libavfilter     9.  3.100 /  9.  3.100
  libswscale      7.  1.100 /  7.  1.100
  libswresample   4. 10.100 /  4. 10.100
  libpostproc    57.  1.100 / 57.  1.100
[mp3 @ 0x7fd48e104480] Format mp3 detected only with low score of 25, misdetection possible!
[mp3 @ 0x7fd48e104480] Skipping 463 bytes of junk at 0.
[mp3 @ 0x7fd48e104480] Estimating duration from bitrate, this may be inaccurate
Input #0, mp3, from '/Users/mayur/Projects/input/test-016.mp3':
  Duration: 00:00:00.39, start: 0.000000, bitrate: 169 kb/s
  Stream #0:0: Audio: mp3, 22050 Hz, mono, fltp, 160 kb/s
Stream mapping:
  Stream #0:0 -> #0:0 (mp3 (mp3float) -> pcm_s16le (native))
Press [q] to stop, [?] for help
Output #0, wav, to '/Users/mayur/Projects/temp_output/test-016.wav':
  Metadata:
    ISFT            : Lavf60.3.100
  Stream #0:0: Audio: pcm_s16le ([1][0][0][0] / 0x0001), 22050 Hz, mono, s16, 352 kb/s
    Metadata:
      encoder         : Lavc60.3.100 pcm_s16le
size=      17kB time=00:00:00.36 bitrate= 379.7kbits/s speed= 253x    
video:0kB audio:17kB subtitle:0kB other streams:0kB global headers:0kB muxing overhead: 0.451389%

问题原因 #

从FFmpeg输出里的Skipping 463 bytes of junk at 0能看出，分片的MP3开头存在无效数据，FFmpeg跳过这些数据后会在WAV开头补空白；另外MP3是帧编码格式，1024字节的固定缓冲区切割破坏了MP3帧结构，解码时需要重新同步帧，进而产生空白间隙。

解决方法 #

1. 强制MP3格式解析
   转换时指定-f mp3参数，让FFmpeg强制按MP3格式处理文件，自动跳过无效数据并同步帧：

   subprocess.run(["ffmpeg", "-f", "mp3", "-i",
       f"{Path.cwd()}/input/{path}",
       f"{Path.cwd()}/temp_output/{path.replace('.mp3', '')}.wav"
   ])
   

2. 按MP3帧边界切割分片
   放弃固定1024字节切割，改为按MP3帧大小对齐切割。以你使用的22050Hz、160kbps单声道MP3为例，每帧大小约为(160000 * 1152) / (22050 * 8) ≈ 1044字节，流式获取时缓存到整帧大小再切割，避免破坏帧结构。

3. pydub指定格式解析
   使用pydub时明确指定格式为mp3，强制工具按MP3规则解析文件：

   from pydub import AudioSegment
   sound = AudioSegment.from_file(f"{Path.cwd()}/input/{path}", format="mp3")
   sound.export(f"{Path.cwd()}/temp_output/{path.replace('.mp3', '')}.wav", format="wav")
   

内容的提问来源于stack exchange，提问作者Mayur