Docker构建Python3.9环境时h5py安装失败求助

问题描述 #

Docker构建镜像时遇到h5py编译错误：

ERROR: Could not build wheels for h5py, which is required to install pyproject.toml-based projects

改用python:3.9.6基础镜像后，出现新错误：

ERROR: Could not build wheels for h5py which use PEP 517 and cannot be installed directly

本地M1 MacBook Air（Python3.9.6）上h5py已成功安装，Streamlit应用运行正常。曾尝试通过Homebrew安装hdf5并导出环境变量HDF5_DIR="$(brew --prefix hdf5)"，问题未解决。

现有Dockerfile #

FROM python:3.9-slim
COPY . /app
WORKDIR /app
RUN pip install h5py
EXPOSE 80 # Ignore this
ENTRYPOINT ["streamlit", "run"] # Ignore this
CMD ["main.py"] # Ignore this

requirements.txt依赖 #

absl-py==2.1.0
altair==5.3.0
astunparse==1.6.3
attrs==23.2.0
blinker==1.7.0
cachetools==5.3.3
certifi==2024.2.2
charset-normalizer==3.3.2
click==8.1.7
contourpy==1.2.1
cycler==0.12.1
flatbuffers==24.3.25
fonttools==4.51.0
gast==0.5.4
gitdb==4.0.11
GitPython==3.1.43
google-pasta==0.2.0
grpcio==1.62.2
h5py>=3.10.0
idna==3.7
importlib_metadata==7.1.0
importlib_resources==6.4.0
Jinja2==3.1.3
jsonschema==4.21.1
jsonschema-specifications==2023.12.1
keras==3.2.1
kiwisolver==1.4.5
libclang==18.1.1
Markdown==3.6
markdown-it-py==3.0.0
MarkupSafe==2.1.5
matplotlib==3.8.4
mdurl==0.1.2
ml-dtypes==0.3.2
namex==0.0.8
numpy==1.26.4
opt-einsum==3.3.0
optree==0.11.0
packaging==24.0
pandas==2.2.2
pillow==10.3.0
protobuf==4.25.3
pyarrow==15.0.2
pydeck==0.8.1b0
Pygments==2.17.2
pyparsing==3.1.2
python-dateutil==2.9.0.post0
pytz==2024.1
referencing==0.34.0
requests==2.31.0
rich==13.7.1
rpds-py==0.18.0
six==1.16.0
smmap==5.0.1
streamlit==1.33.0
tenacity==8.2.3
tensorboard==2.16.2
tensorboard-data-server==0.7.2
tensorflow==2.16.1
tensorflow-io-gcs-filesystem==0.36.0
termcolor==2.4.0
toml==0.10.2
toolz==0.12.1
tornado==6.4
typing_extensions==4.11.0
tzdata==2024.1
urllib3==2.2.1
Werkzeug==3.0.2
wrapt==1.16.0
zipp==3.18.1

解决方案 #

问题根源是python:3.9-slim和python:3.9.6镜像都缺少h5py编译所需的系统依赖（C编译器、HDF5库等），导致无法生成wheel包。

修改后的Dockerfile如下：

FROM python:3.9-slim

# 安装h5py编译所需的系统依赖
RUN apt-get update && apt-get install -y --no-install-recommends \
    gcc \
    g++ \
    make \
    libhdf5-dev \
    && rm -rf /var/lib/apt/lists/*

# 升级pip工具链，确保支持PEP 517构建标准
RUN pip install --upgrade pip setuptools wheel

COPY . /app
WORKDIR /app

# 批量安装所有依赖
RUN pip install --no-cache-dir -r requirements.txt

EXPOSE 80
ENTRYPOINT ["streamlit", "run"]
CMD ["main.py"]

关键说明 #

1. 系统依赖安装：libhdf5-dev是h5py依赖的底层系统库，gcc、g++、make用于编译h5py的C扩展模块。
2. 工具链升级：更新pip、setuptools、wheel版本，解决PEP 517构建兼容性问题，避免"cannot be installed directly"错误。
3. 镜像优化：使用--no-install-recommends和清理apt缓存，减少镜像体积；--no-cache-dir避免pip缓存冗余文件。

内容的提问来源于stack exchange，提问作者Nirshad Nijam