无网络环境下Ubuntu 18.04系统安装R语言arrow包C++依赖的方法咨询
无网络环境下Ubuntu 18.04安装Arrow R包C++依赖操作步骤
- 首先在可联网的MacBook上补全缺失的依赖包:下载
protobuf-all-3.14.0.tar.gz,和之前download_dependencies.sh已下载完成的所有依赖包一起放到arrow-thirdparty文件夹中 - 将完整的
arrow-thirdparty文件夹上传到Ubuntu服务器的指定路径,例如/dbfs/FileStore/tables/arrow-thirdparty - 在Ubuntu服务器终端执行以下命令配置依赖路径环境变量,路径替换为你实际的上传路径:
# 原有脚本输出的环境变量 export ARROW_ABSL_URL=/dbfs/FileStore/tables/arrow-thirdparty/absl-0f3bb466b868b523cf1dc9b2aaaed65c77b28862.tar.gz export ARROW_AWSSDK_URL=/dbfs/FileStore/tables/arrow-thirdparty/aws-sdk-cpp-1.8.133.tar.gz export ARROW_AWS_CHECKSUMS_URL=/dbfs/FileStore/tables/arrow-thirdparty/aws-checksums-v0.1.10 export ARROW_AWS_C_COMMON_URL=/dbfs/FileStore/tables/arrow-thirdparty/aws-c-common-v0.5.10.tar.gz export ARROW_AWS_C_EVENT_STREAM_URL=/dbfs/FileStore/tables/arrow-thirdparty/aws-c-event-stream-v0.1.5 export ARROW_BOOST_URL=/dbfs/FileStore/tables/arrow-thirdparty/boost-1.75.0.tar.gz export ARROW_BROTLI_URL=/dbfs/FileStore/tables/arrow-thirdparty/brotli-v1.0.9.tar.gz export ARROW_BZIP2_URL=/dbfs/FileStore/tables/arrow-thirdparty/bzip2-1.0.8.tar.gz export ARROW_CARES_URL=/dbfs/FileStore/tables/arrow-thirdparty/cares-1.17.1.tar.gz export ARROW_GBENCHMARK_URL=/dbfs/FileStore/tables/arrow-thirdparty/gbenchmark-v1.5.2.tar.gz export ARROW_GFLAGS_URL=/dbfs/FileStore/tables/arrow-thirdparty/gflags-v2.2.2.tar.gz export ARROW_GLOG_URL=/dbfs/FileStore/tables/arrow-thirdparty/glog-v0.4.0.tar.gz export ARROW_GRPC_URL=/dbfs/FileStore/tables/arrow-thirdparty/grpc-v1.35.0.tar.gz export ARROW_GTEST_URL=/dbfs/FileStore/tables/arrow-thirdparty/gtest-1.10.0.tar.gz export ARROW_JEMALLOC_URL=/dbfs/FileStore/tables/arrow-thirdparty/jemalloc-5.2.1.tar.bz2 export ARROW_LZ4_URL=/dbfs/FileStore/tables/arrow-thirdparty/lz4-v1.9.3.tar.gz export ARROW_MIMALLOC_URL=/dbfs/FileStore/tables/arrow-thirdparty/mimalloc-v1.7.2.tar.gz export ARROW_ORC_URL=/dbfs/FileStore/tables/arrow-thirdparty/orc-1.6.6.tar.gz # 补全protobuf的环境变量 export ARROW_PROTOBUF_URL=/dbfs/FileStore/tables/arrow-thirdparty/protobuf-all-3.14.0.tar.gz
- 进入上传的arrow源码解压后的cpp目录,执行编译安装命令:
cmake . -DARROW_DEPENDENCY_SOURCE=BUNDLE \ -DARROW_BUILD_STATIC=ON \ -DARROW_R_DEV=ON \ # 如果不需要S3、gRPC功能可以关闭,减少依赖要求 -DARROW_S3=OFF \ -DARROW_GRPC=OFF make -j$(nproc) sudo make install
- 注意:如果编译时报cmake版本过低的错误,可提前在联网设备下载对应Ubuntu 18.04版本的cmake deb安装包,上传后用
sudo dpkg -i安装即可。 - 执行
sudo ldconfig刷新系统动态库缓存,之后再运行R CMD INSTALL /dbfs/FileStore/tables/arrow_4.0.1.tar.gz即可完成Arrow R包安装。
内容的提问来源于stack exchange,提问作者Amir
相关产品推荐
相关产品推荐

