Apache DolphinScheduler创建SQL任务触发EofException异常如何解决

云上老周

2026-10-2

INFO 2021-09-27 22:52:34.393 org.apache.dolphinscheduler.api.controller.LoginController:84 - login user name: admin 
INFO 2021-09-27 22:52:34.457 org.apache.dolphinscheduler.api.security.PasswordAuthenticator:59 - sessionId : ad15ef0a-b1c0-448d-858e-b25c948390ec
INFO 2021-09-27 22:52:35.738 org.apache.dolphinscheduler.api.controller.UsersController:299 - login user admin,get user info
INFO 2021-09-27 22:52:35.942 org.apache.dolphinscheduler.api.controller.TenantController:112 - login user admin, list paging, pageNo: 1, searchVal: , pageSize: 10
INFO 2021-09-27 22:52:37.231 org.apache.dolphinscheduler.api.controller.QueueController:68 - login user admin, query queue list
INFO 2021-09-27 22:52:48.835 org.apache.dolphinscheduler.api.controller.TenantController:216 - login user admin, verfiy tenant code: JM
INFO 2021-09-27 22:52:48.851 org.apache.dolphinscheduler.api.controller.TenantController:83 - login user admin, create tenant, tenantCode: JM, tenantName: 作业管理员, queueId: 1, desc: 
INFO 2021-09-27 22:52:49.666 org.apache.dolphinscheduler.api.controller.TenantController:112 - login user admin, list paging, pageNo: 1, searchVal: , pageSize: 10
INFO 2021-09-27 22:52:55.561 org.apache.dolphinscheduler.api.controller.UsersController:116 - login user admin, list user paging, pageNo: 1, searchVal: , pageSize: 10
INFO 2021-09-27 22:52:57.162 org.apache.dolphinscheduler.api.controller.TenantController:135 - login user admin, query tenant list
INFO 2021-09-27 22:52:57.163 org.apache.dolphinscheduler.api.controller.QueueController:68 - login user admin, query queue list
INFO 2021-09-27 22:52:58.269 org.apache.dolphinscheduler.api.controller.UsersController:162 - login user admin, updateProcessInstance user, userName: admin, email: xxx@qq.com, tenantId: 1, userPassword: ******, phone: , user queue: default
INFO 2021-09-27 22:52:58.405 org.apache.dolphinscheduler.api.controller.UsersController:116 - login user admin, list user paging, pageNo: 1, searchVal: , pageSize: 10
INFO 2021-09-27 22:53:25.638 org.apache.dolphinscheduler.api.controller.DataSourceController:281 - login user admin, connect datasource: apiconf, note: , type: MYSQL, connectType: null, other: 
INFO 2021-09-27 22:53:27.130 org.apache.dolphinscheduler.api.controller.DataSourceController:361 - login user admin, verfiy datasource name: apiconf
INFO 2021-09-27 22:53:27.146 org.apache.dolphinscheduler.api.controller.DataSourceController:101 - login user admin create datasource name: apiconf, note: , type: MYSQL, host: 192.168.6.16, port: 3306, database : apiconf, principal: , userName : tcc, connectType: null, other: 
INFO 2021-09-27 22:53:29.371 org.apache.dolphinscheduler.api.controller.ProjectController:157 - login user admin, query project list paging
INFO 2021-09-27 22:53:35.304 org.apache.dolphinscheduler.api.controller.ProjectController:79 - login user admin, create project name: 测试, desc: 
INFO 2021-09-27 22:53:35.423 org.apache.dolphinscheduler.api.controller.ProjectController:157 - login user admin, query project list paging
INFO 2021-09-27 22:53:36.900 org.apache.dolphinscheduler.api.controller.DataAnalysisController:104 - count process instance state, user:admin, start date: 2021-09-27 00:00:00, end date:2021-09-27 14:32:51, project id:1
INFO 2021-09-27 22:53:36.900 org.apache.dolphinscheduler.api.controller.DataAnalysisController:76 - count task state, user:admin, start date: 2021-09-27 00:00:00, end date:2021-09-27 14:32:51, project id 1
INFO 2021-09-27 22:53:36.901 org.apache.dolphinscheduler.api.controller.DataAnalysisController:126 - count process definition , user:admin, project id:1
INFO 2021-09-27 22:53:37.927 org.apache.dolphinscheduler.api.controller.ProcessDefinitionController:290 - query process definition list paging, login user:admin, project name:测试
INFO 2021-09-27 22:53:38.911 org.apache.dolphinscheduler.api.controller.ResourcesController:293 - query resource list, login user:admin, resource type:, program type:{}
INFO 2021-09-27 22:53:38.913 org.apache.dolphinscheduler.api.controller.ProjectController:264 - login user admin, query all project list
INFO 2021-09-27 22:53:38.916 org.apache.dolphinscheduler.api.controller.ProcessDefinitionController:257 - query process definition list, login user:admin, project name:测试
INFO 2021-09-27 22:53:38.922 org.apache.dolphinscheduler.api.controller.WorkerGroupController:135 - query all worker group: login user admin
INFO 2021-09-27 22:53:38.959 org.apache.dolphinscheduler.api.controller.ResourcesController:293 - query resource list, login user:admin, resource type:PYTHON, program type:{}
INFO 2021-09-27 22:53:38.980 org.apache.dolphinscheduler.api.controller.ResourcesController:177 - query resource list, login user:admin, resource type:FILE
INFO 2021-09-27 22:53:38.983 org.apache.dolphinscheduler.api.controller.TenantController:135 - login user admin, query tenant list
INFO 2021-09-27 22:54:01.499 org.apache.dolphinscheduler.api.controller.ProcessDefinitionController:139 - verify process definition name unique, user:admin, project name:测试, process definition name:s
ERROR 2021-09-27 22:54:01.553 org.apache.dolphinscheduler.api.exceptions.ApiExceptionHandler:41 - null
org.eclipse.jetty.io.EofException: null
    at org.eclipse.jetty.io.ChannelEndPoint.flush(ChannelEndPoint.java:279)
    at org.eclipse.jetty.io.WriteFlusher.flush(WriteFlusher.java:422)
    at org.eclipse.jetty.io.WriteFlusher.write(WriteFlusher.java:277)

排查方向

Jetty服务缓冲区配置异常
报错栈明确抛出org.eclipse.jetty.io.EofException，本质是Jetty写入响应时客户端提前断开连接或服务端响应缓冲区不足。SQL任务创建时需要拉取数据源元数据、字段列表，返回内容体积远大于shell、spark任务创建接口的返回内容，若当前节点API服务配置中server.jetty.max-http-form-post-size、server.jetty.max-response-header-size等参数设置过小，会导致大响应写入失败触发EOF错误。可直接对比正常节点的api-server/conf/application.yaml中Jetty相关配置，调整为一致后重启API服务验证。
网络层传输限制
当前服务器所在网络的WAF、反向代理层存在请求/响应大小限制，比如Nginx的client_max_body_size、proxy_buffer_size配置值过小，SQL任务创建接口返回的大体积响应经过代理时被截断，导致Jetty写入连接时触发EOF。shell、spark任务创建接口返回内容体积小未触发阈值，因此无异常。检查当前节点前端到API服务之间的所有代理、防火墙规则，对比正常节点的网络配置调整即可。
数据源连通性异常
SQL任务创建时会实时调用接口拉取对应数据源的库表元数据，若当前服务器到已配置的MYSQL数据源（192.168.6.16:3306）之间的网络存在丢包、端口访问限制，或是数据源端最大连接数耗尽，会导致元数据拉取请求超时，API端响应中断触发EOF。可在当前DS API节点上用mysql -h192.168.6.16 -P3306 -utcc -p命令手动测试连通性，对比正常节点到数据源的网络状态排查。
API服务依赖包缺失
当前节点的DS API服务安装包不完整，缺失SQL任务对应数据源的JDBC驱动包，导致元数据拉取时触发未捕获异常中断响应，抛出EOF错误。对比正常节点的api-server/libs目录下的mysql-connector相关jar包是否存在，补全缺失依赖后重启API服务验证。

内容的提问来源于stack exchange，提问作者Lvvvvvvvvv