为何process.communicate导致程序被Killed？超时设置异常排查

问题场景 #

用Python的subprocess.Popen调用依赖标准输入的C++程序，当不传入任何stdin内容时：

• 设置timeout=5：程序正常触发subprocess.TimeoutExpired，进而抛出自定义的RunTimeoutError
• 设置timeout=30：程序直接被标记为Killed，不会进入Python的超时异常处理分支

环境：Python 3.8.10、Ubuntu 20.04.6 LTS

相关代码 #

Python调用逻辑：

from typing import List, Tuple
import os
import subprocess

class RunTimeoutError(Exception):
    pass

def run(
    self, args: List[str] = [], stdin: str = "", timeout: int = 30
) -> Tuple[int, str, str]:

    process = subprocess.Popen(
        [os.path.join(self.temp_file_folder, "build", self.target_file_name)]
        + args,
        stdin=subprocess.PIPE,
        stdout=subprocess.PIPE,
        stderr=subprocess.PIPE,
        text=True,
    )

    try:
        stdout, stderr = process.communicate(input=stdin, timeout=timeout)
    except subprocess.TimeoutExpired as e:
        process.kill()
        raise RunTimeoutError(f"Expired in {timeout}s")

    return (process.returncode, stdout, stderr)

C++程序核心逻辑：

#include <iostream>
#include <cmath>
#include <limits>
#include <iomanip>

int main()
{
    int N;
    double sum = 0;
    double product = 1;

    std::cout << "Please enter an integer  N between 1 and 50: ";
    std::cin >> N;

    while (std::cin.fail() || N < 1 || N > 50)
    {
        std::cin.clear();
        std::cin.ignore(std::numeric_limits<std::streamsize>::max(), '\n');
        std::cout << "Input error, please enter an integer N between 1 and 50: ";
        std::cin >> N;
    }

    std::cout << N << ":" << std::endl;
    for (int i = N - 1; i >= 0; i--)
    {
        int value = pow(2, i);
        sum += value;
        product *= value;
        std::cout << value << (i > 0 ? ", " : "\n");
    }

    double geometric_mean = pow(product, 1.0 / N);
    std::cout << std::fixed << std::setprecision(2);
    std::cout << "sum: " << sum << std::endl;
    std::cout << "avg: " << geometric_mean << std::endl;

    return 0;
}

原因拆解 #

1. C++程序陷入死循环 #

当Python通过communicate(input="")给子进程传入空字符串时，相当于给C++程序的stdin发送了EOF（文件结束符）。此时：

• std::cin >> N读取失败，std::cin.fail()返回true，进入循环
• std::cin.clear()清除错误状态后，std::cin.ignore(...)尝试读取到\n，但此时stdin已经是EOF，该操作会立即返回
• 再次执行std::cin >> N，依然读取失败（EOF状态持续），导致程序进入无限循环，持续占用CPU资源

2. 系统级进程终止机制触发 #

5秒超时场景下，Python的subprocess.communicate会在超时后主动杀死进程，此时系统还没来得及干预；但30秒时，长时间的高CPU占用触发了Ubuntu系统的进程终止机制（比如部分VPS/容器的CPU时间限制、或者系统针对无响应高CPU进程的清理逻辑），进程被SIGKILL信号杀死（返回码通常为-9）。此时Python的communicate会直接返回，不会触发TimeoutExpired异常，你看到的Killed就是系统输出的进程终止提示。

解决方案 #

修复C++程序的死循环 #

在输入处理逻辑中加入EOF判断，遇到EOF时直接退出程序，避免无限循环：

#include <iostream>
#include <cmath>
#include <limits>
#include <iomanip>

int main()
{
    int N;
    double sum = 0;
    double product = 1;

    std::cout << "Please enter an integer  N between 1 and 50: ";
    std::cin >> N;

    while (std::cin.fail() || N < 1 || N > 50)
    {
        // 新增：检查是否到达EOF，是则退出
        if (std::cin.eof()) {
            std::cerr << "Input terminated unexpectedly." << std::endl;
            return 1;
        }
        std::cin.clear();
        std::cin.ignore(std::numeric_limits<std::streamsize>::max(), '\n');
        std::cout << "Input error, please enter an integer N between 1 and 50: ";
        std::cin >> N;
    }

    // 后续代码保持不变...
}

增强Python端的异常处理 #

可以检查进程返回码，判断是否被系统杀死，补充对应的异常抛出逻辑：

def run(
    self, args: List[str] = [], stdin: str = "", timeout: int = 30
) -> Tuple[int, str, str]:

    process = subprocess.Popen(
        [os.path.join(self.temp_file_folder, "build", self.target_file_name)]
        + args,
        stdin=subprocess.PIPE,
        stdout=subprocess.PIPE,
        stderr=subprocess.PIPE,
        text=True,
    )

    try:
        stdout, stderr = process.communicate(input=stdin, timeout=timeout)
    except subprocess.TimeoutExpired as e:
        process.kill()
        raise RunTimeoutError(f"Expired in {timeout}s")
    
    # 新增：检查进程是否被SIGKILL杀死
    if process.returncode == -9:
        raise RuntimeError("Process was killed by system (SIGKILL)")

    return (process.returncode, stdout, stderr)

内容的提问来源于stack exchange，提问作者user23783268