Azure Synapse Analytics无法上传ortools.whl至Spark池求助
问题
尝试将ortools包上传至Azure Synapse Spark池时失败,提示“无法将文件上传至工作区”。操作路径为Synapse工作区→管理→工作区包→上传或Spark池→包→工作区包,已附带对应.whl文件。
错误日志
pip: - pip ortools==9.7.2996 channels: - nodefaults
24/09/30 02:16:14 INFO Updating environment 2024-09-30 02:16:14,783 INFO UserConsole [redirect output]: 24/09/30 02:16:14 INFO Running /usr/lib/miniforge3/bin/conda config --set always_softlink false 2024-09-30 02:16:15,253 INFO UserConsole [redirect output]: 24/09/30 02:16:15 INFO 2024-09-30 02:16:15,253 INFO UserConsole [redirect output]: 24/09/30 02:16:15 INFO Ran /usr/lib/miniforge3/bin/conda config --set always_softlink false successfully 24/09/30 02:16:15 INFO Running /usr/lib/miniforge3/bin/conda config --set always_copy true 2024-09-30 02:16:15,739 INFO UserConsole [redirect output]: 24/09/30 02:16:15 INFO 2024-09-30 02:16:15,739 INFO UserConsole [redirect output]: 24/09/30 02:16:15 INFO Ran /usr/lib/miniforge3/bin/conda config --set always_copy true successfully 24/09/30 02:16:15 INFO Running /usr/lib/miniforge3/bin/conda env update -p /home/trusted-service-user/cluster-env/clonedenv --file /usr/lib/library-manager/bin/lmjob/BDARAphSparkpl/package_cleaned_environment.yml 2024-09-30 02:17:11,447 INFO UserConsole [redirect output]: Pip subprocess error: ERROR: Invalid requirement: 'pip ortools==9.7.2996' (from line 1 of /usr/lib/library-manager/bin/lmjob/BDARAphSparkpl/condaenv.3js5lcnr.requirements.txt) 2024-09-30 02:17:11,448 INFO UserConsole [redirect output]: CondaEnvException: Pip failed
解决方法
- 修正依赖配置格式
核心错误是conda环境配置文件中pip依赖项写法错误,多添加了冗余的pip前缀。正确的配置应为:pip: - ortools==9.7.2996 channels: - nodefaults - 重新上传部署
按照修正后的配置重新生成环境文件,确保.whl包对应的依赖声明格式正确,再通过Synapse的工作区包上传流程重新尝试部署。
内容的提问来源于stack exchange,提问作者Madhu Tallapaneni
相关产品推荐
相关产品推荐

