如何获取带有包含try外部调用栈的__traceback__属性的异常

在Python 3.10中，当在try语句内部抛出异常并捕获后，异常对象的__traceback__属性仅包含try语句所在函数内的栈帧，无法覆盖到调用该函数的上层调用链路。例如以下示例中，somefunction内捕获的异常回溯只显示自身函数内的抛出行，而未捕获的异常则会展示从顶层到抛出点的完整调用栈。

问题示例代码 #

# short_tb.py
import traceback


def caller():
    somefunction()


def somefunction():
    try:
        raise ValueError("This is a value error")
    except ValueError as e:
        # 实际代码中会将e传递给其他函数，从e中提取__traceback__用于日志记录
        print("".join(traceback.format_tb(e.__traceback__)))


print("This will produce a traceback with only one frame, the one in somefunction()")
caller()


def caller2():
    somefunction2()


def somefunction2():
    raise ValueError("This is a value error")


print("This will produce a traceback with all relevant frames (the default behavior of the python interpreter)")
caller2()

示例输出 #

This will produce a traceback with only one frame, the one in somefunction()
  File ".../short_tb.py", line 10, in somefunction
    raise ValueError("This is a value error")

This will produce a traceback with all relevant frames (the default behavior of the python interpreter)
Traceback (most recent call last):
  File ".../short_tb.py", line 30, in <module>
    caller2()
  File ".../short_tb.py", line 22, in caller2
    somefunction2()
  File ".../short_tb.py", line 26, in somefunction2
    raise ValueError("This is a value error")
ValueError: This is a value error

解决方案 #

方案1：合并调用栈与异常回溯（无需修改__traceback__） #

如果仅需在日志中输出完整调用栈，无需修改异常对象的__traceback__，可以手动合并当前调用栈和异常自身的回溯信息：

import traceback
import sys


def caller():
    somefunction()


def somefunction():
    try:
        raise ValueError("This is a value error")
    except ValueError as e:
        # 获取当前调用栈，裁剪掉异常处理相关的冗余帧
        caller_stack = traceback.extract_stack()[:-2]
        # 获取异常自身的回溯栈帧
        exception_stack = traceback.extract_tb(e.__traceback__)
        # 合并得到完整调用栈
        full_stack = caller_stack + exception_stack
        
        # 打印完整回溯（模拟默认异常输出格式）
        print("Traceback (most recent call last):")
        print("".join(traceback.format_list(full_stack)))
        print(f"{type(e).__name__}: {e}")


print("Now this produces a full traceback:")
caller()

该方法通过traceback.extract_stack()获取当前函数的上层调用栈，再与异常自身的回溯栈合并，最终输出完整的调用链路，适用于大多数日志记录场景。

方案2：修改异常的__traceback__属性（获取完整traceback对象） #

如果必须让异常对象的__traceback__直接包含完整调用栈，可以通过CPython的私有API（结合ctypes）构建完整的traceback对象。注意该方法仅适用于CPython解释器：

import traceback
import sys
import ctypes


def caller():
    somefunction()


def somefunction():
    try:
        raise ValueError("This is a value error")
    except ValueError as e:
        # 获取异常原始的traceback
        original_tb = e.__traceback__
        # 获取当前调用栈的帧（从调用somefunction的上层开始）
        current_frame = sys._getframe(1)
        
        # 调用CPython的C API创建traceback链，合并上层调用帧与原始异常traceback
        libpython = ctypes.CDLL(None)
        PyTraceBack_New = libpython.PyTraceBack_New
        PyTraceBack_New.argtypes = [ctypes.py_object, ctypes.py_object]
        PyTraceBack_New.restype = ctypes.py_object
        
        full_tb = original_tb
        # 遍历上层调用帧，逐个添加到traceback链中
        while current_frame:
            full_tb = PyTraceBack_New(current_frame, full_tb)
            # 停止在模块级调用帧（避免无限循环）
            if current_frame.f_back is None:
                break
            current_frame = current_frame.f_back
        
        # 替换异常的__traceback__属性
        e.__traceback__ = full_tb
        
        # 验证输出
        print("".join(traceback.format_tb(e.__traceback__)))


print("Now the exception's __traceback__ has full frames:")
caller()

该方法通过sys._getframe()获取上层调用帧，再利用ctypes调用CPython的PyTraceBack_NewAPI构建完整的traceback链，最终赋值给异常的__traceback__属性，让其包含从顶层到抛出点的所有调用栈帧，满足需要传递异常并保留完整回溯的场景。

内容的提问来源于stack exchange，提问作者Klaas van Schelven