Apache Beam Python的WriteToBigtable导致Dataflow任务无限运行

使用GCP Dataflow处理数据并写入BigTable时，部分任务会卡在WriteToBigtable环节无限运行，待写入行数越多，该问题发生的概率越高。

排查任务日志后，发现未完成任务存在以下错误：

Unable to perform SDK-split for work-id: 5193980908353266575 due to error: INTERNAL: Empty split returned. [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax/workflow/worker/fnapi_operators.cc" line: 2738 } } }']
=== Source Location Trace: ===
dist_proc/dax/internal/status_utils.cc:236
 And could not Checkpoint reader due to error: OUT_OF_RANGE: Cannot checkpoint when range tracker is finished. [type.googleapis.com/util.MessageSetPayload='[dist_proc.dax.internal.TrailProto] { trail_point { source_file_loc { filepath: "dist_proc/dax/workflow/worker/operator.cc" line: 340 } } }']
=== Source Location Trace: ===
dist_proc/dax/io/dax_reader_driver.cc:253
dist_proc/dax/workflow/worker/operator.cc:340

此前通过设置use_cross_language=True调用Java SDK是可行的临时解决方案，但该方案近期已在GCP Dataflow中被禁用。目前注意到Dataflow刚支持2.51.0版本，计划尝试升级至该版本以确认问题是否解决。

内容的提问来源于stack exchange，提问作者PanJ