AWS EC2中Django+NGINX Excel上传超时及异步视图错误排查

问题根源分析 #

1. Nginx超时问题：Excel数据处理耗时过长，超出Nginx等待响应的时间；即使调大超时参数，仍可能因EC2资源限制提前触发超时。
2. 异步视图错误：
   • 给async视图添加@sync_to_async装饰器，导致Django试图await返回的HttpResponseRedirect对象，触发"object HttpResponseRedirect can't be used in 'await' expression"错误。
   • 移除@sync_to_async后，同步装饰器（如@login_required）无法处理异步视图返回的协程对象，因此出现"didn't return an HttpResponse object. It returned an unawaited coroutine instead"错误。
3. 后台任务风险：直接将request对象传入后台任务不安全，请求结束后request会被Django销毁，可能引发未知异常。

解决方案 #

方案1：同步视图+后台任务队列（生产环境推荐） #

放弃异步视图，改用同步视图接收上传，将Excel处理逻辑放到后台任务执行，视图立即返回响应，从根源避免Nginx超时。

步骤1：配置任务队列（以Celery为例）

先安装依赖：

pip install celery redis

在Django项目的settings.py中添加Celery配置：

CELERY_BROKER_URL = 'redis://localhost:6379/0'
CELERY_RESULT_BACKEND = 'redis://localhost:6379/0'

步骤2：编写Celery后台任务

在项目下创建tasks.py文件：

from celery import shared_task
from django.contrib.auth.models import User
from .models import ProfileMember

@shared_task
def process_excel_upload_task(user_id, file_path):
    # 通过user_id获取用户，避免传递request对象
    user = User.objects.get(id=user_id)
    member = ProfileMember.objects.get(user=user)
    
    # 替换为你的Excel处理逻辑
    with open(file_path, 'rb') as f:
        # 示例：读取并处理Excel内容
        pass
    
    return "complete"

步骤3：重构同步视图

from django.shortcuts import redirect, render
from django.contrib.auth.decorators import login_required, user_passes_test
from .decorators import user_preapproved
from .forms import ExcelUploadForm, ReportUploadForm
from .tasks import process_excel_upload_task

@login_required
@user_preapproved(home_url='landing-dashboard', redirect_field_name='', message='You are not authorised to perform this action.')
@user_passes_test(group_check, redirect_field_name=None)
def ExcelUploadEditView(request):
    user = request.user
    member = ProfileMember.objects.get(user=user)
    
    if request.method == 'POST':
        form = ExcelUploadForm(request.POST, request.FILES)
        if form.is_valid():
            # 保存上传文件
            uploaded_file = form.save()
            # 获取文件绝对路径（需与表单字段名对应）
            file_path = uploaded_file.excel.path
            
            # 启动后台任务，不阻塞当前请求
            process_excel_upload_task.delay(user.id, file_path)
            
            # 立即返回响应，告知用户处理中
            return redirect('excel-after', message="Your file is being processed")
        else:
            print(form.errors)
    else:
        form = ReportUploadForm()
    
    context = {
        'form_documentupload': form,
        'user': user,
        'member': member,
    }
    return render(request, "excel_upload.html", context)

方案2：修复异步视图（适合轻量场景） #

若坚持使用异步视图，需调整装饰器与异步逻辑，确保同步操作与异步视图兼容：

from django.shortcuts import redirect, render
from django.contrib.auth.decorators import login_required, user_passes_test
from .decorators import user_preapproved
from .forms import ExcelUploadForm, ReportUploadForm
from asgiref.sync import sync_to_async
import asyncio

# 同步处理函数，无需添加@sync_to_async
def process_excel_upload(user_id, file_path):
    user = User.objects.get(id=user_id)
    member = ProfileMember.objects.get(user=user)
    # 替换为你的Excel处理逻辑
    return "complete"

# 同步装饰器需包裹在@sync_to_async内，适配异步视图
@sync_to_async
@login_required
@user_preapproved(home_url='landing-dashboard', redirect_field_name='', message='You are not authorised to perform this action.')
@user_passes_test(group_check, redirect_field_name=None)
async def ExcelUploadEditView(request):
    user = request.user
    # 同步ORM操作需用sync_to_async包裹
    member = await sync_to_async(ProfileMember.objects.get)(user=user)
    
    if request.method == 'POST':
        form = ExcelUploadForm(request.POST, request.FILES)
        # 表单验证为同步操作，转为异步执行
        is_valid = await sync_to_async(form.is_valid)()
        
        if is_valid:
            uploaded_file = await sync_to_async(form.save)()
            file_path = uploaded_file.excel.path
            
            # 启动后台异步任务，不阻塞视图响应
            loop = asyncio.get_event_loop()
            loop.create_task(sync_to_async(process_excel_upload)(user.id, file_path))
            
            return redirect('excel-after', message="Your file is being processed")
        else:
            print(form.errors)
    else:
        form = ReportUploadForm()
    
    context = {
        'form_documentupload': form,
        'user': user,
        'member': member,
    }
    # 同步render函数转为异步执行
    return await sync_to_async(render)(request, "excel_upload.html", context)

关键注意事项 #

• 禁止将request对象传入后台任务，应传递用户ID、文件路径等独立参数，避免请求销毁后引发异常。
• 生产环境优先使用Celery等成熟任务队列，比直接使用asyncio更稳定，支持任务重试、状态追踪等功能。
• 检查EC2实例的CPU、内存资源，避免因资源不足导致处理过程提前终止。

内容的提问来源于stack exchange，提问作者fmakawa