You need to enable JavaScript to run this app.
导航
离线整库同步常见问题
最近更新时间:2025.07.17 11:35:25首次发布时间:2025.07.17 11:35:25
复制全文
我的收藏
有用
有用
无用
无用

Maximum parallelism exceeded

  • 问题现象:
    离线整库同步任务一直等待资源,日志出现等待资源超时失败现在,日志错误关键字:Maximum parallelism exceeded,详细错误日志如下:

    2024-02-19T15:31:38.076 INFO  job 6282214 current state INIT, message: Maximum parallelism 6 exceeded. Please wait for available resources or expand your resource group.
    2024-02-19T15:32:08.108 INFO  job 6282214 current state INIT, message: Maximum parallelism 6 exceeded. Please wait for available resources or expand your resource group.
    2024-02-19T15:32:38.131 INFO  job 6282214 current state INIT, message: Maximum parallelism 6 exceeded. Please wait for available resources or expand your resource group.
    2024-02-19T15:33:08.154 INFO  job 6282214 current state INIT, message: Maximum parallelism 6 exceeded. Please wait for available resources or expand your resource group.
    2024-02-19T15:33:38.173 INFO  job 6282214 current state INIT, message: Maximum parallelism 6 exceeded. Please wait for available resources or expand your resource group.
    2024-02-19T15:34:08.197 INFO  job 6282214 current state INIT, message: Maximum parallelism 6 exceeded. Please wait for available resources or expand your resource group.
    2024-02-19T15:34:38.213 INFO  job 6282214 current state INIT, message: Maximum parallelism 6 exceeded. Please wait for available resources or expand your resource group.
    
  • 解决方案:
    数据集成资源组的默认策略是最大任务并行数量只能支持”集成资源组CU数目/2“的任务数,单任务默认最小资源为 2CU,您可调整独享集成资源组的购买数量,扩容后进行任务执行。操作详见独享集成资源组管理
    如有特殊场景需求,您可通过提工单的方式,联系火山工程师进行处理。

PostgreSQL2Hive 离线整库同步 ,Hive 表是 text 格式, 上游数据如有换行符,导入数据错位

  • 问题现象:
    当上游数据中有换行符时,导入数据错位。
    Image
  • 解决方案:
    Hive 表存储格式为 Text 时,解析换行数据写入时,导致错位异常。您可将数据写入到 Hive 表存储格式为 ORC 或 Parquet 格式的表中,来解决该问题。