You need to enable JavaScript to run this app. MassTransit 7.1.4集成Kafka与内存总线,应用Ctrl+C退出触发AccessViolationException
优惠活动
大模型
产品
解决方案
定价
更多

MassTransit 7.1.4集成Kafka与内存总线,应用Ctrl+C退出触发AccessViolationException

问题基本信息
  • 运行环境:基于.NET Core 3.1的ASP.NET Core Web应用,采用7.1.4版本的MassTransit框架
  • 组件配置:同时启用内存消息总线、Kafka Rider消费者能力
  • 复现特征:通过Ctrl+C快捷键触发应用正常关闭流程时,会抛出致命的System.AccessViolationException导致进程直接崩溃;通过调试器点击停止调试按钮强制终止进程时,该异常不会出现
  • 初步验证结论:注释掉Kafka主题端点注册逻辑,或是将消息总线替换为RabbitMQ作为传输层,异常就不会复现;当前架构已基于成熟Kafka基础设施搭建,无计划引入其他消息中间件,需要定位根因并匹配适配方案。
相关配置代码

MassTransit核心注册配置

private void ConfigureMassTransit(IServiceCollection services)
{
    services.AddMassTransit(massTransit =>
    {
        massTransit.UsingInMemory((ctx, cfg)
            => cfg.ConfigureEndpoints(ctx, SnakeCaseEndpointNameFormatter.Instance));

        massTransit.ConfigureRider(
            _kafkaHost, _dbConnectionString);
    });

    services.AddMassTransitHostedService();
}

Kafka Rider主题配置

rider.UsingKafka((ctx, kafka) =>
{
    kafka.Host(kafkaHost);

    kafka.TopicEndpoint<Null, IMessageName>(topicName, GroupIds.PushedDeals, cfg =>
    {
        cfg.CheckpointInterval = TimeSpan.FromMilliseconds(100);
        cfg.AutoOffsetReset = AutoOffsetReset.Earliest;
        cfg.ConfigureSaga<SagaState>(ctx);
    });                
});
异常堆栈详情
Fatal error. System.AccessViolationException: Attempted to read or write protected memory. This is often an indication that other memory is corrupt.
   at Confluent.Kafka.Impl.NativeMethods.NativeMethods.rd_kafka_consumer_poll(IntPtr, IntPtr)
   at Confluent.Kafka.Impl.NativeMethods.NativeMethods.rd_kafka_consumer_poll(IntPtr, IntPtr)
   at Confluent.Kafka.Consumer`2[[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].Consume(Int32)
   at Confluent.Kafka.Consumer`2[[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].Consume(System.Threading.CancellationToken)
   at MassTransit.KafkaIntegration.Contexts.KafkaConsumerContext`2+<>c__DisplayClass15_0[[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].<Consume>b__0()
   at MassTransit.Util.ChannelExecutor+SynchronousFuture`1[[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].Run()
   at MassTransit.Util.ChannelExecutor+<RunFromChannel>d__12.MoveNext()
   at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[MassTransit.Util.ChannelExecutor+<RunFromChannel>d__12, MassTransit, Version=7.1.4.0, Culture=neutral, PublicKeyToken=b8e0e9f2f1e657fa]].ExecutionContextCallback(System.Object)
   at System.Threading.ExecutionContext.RunInternal(System.Threading.ExecutionContext, System.Threading.ContextCallback, System.Object)
   at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[MassTransit.Util.ChannelExecutor+<RunFromChannel>d__12, MassTransit, Version=7.1.4.0, Culture=neutral, PublicKeyToken=b8e0e9f2f1e657fa]].MoveNext(System.Threading.Thread)
   at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1+AsyncStateMachineBox`1[[System.Threading.Tasks.VoidTaskResult, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[MassTransit.Util.ChannelExecutor+<RunFromChannel>d__12, MassTransit, Version=7.1.4.0, Culture=neutral, PublicKeyToken=b8e0e9f2f1e657fa]].MoveNext()
   at System.Threading.ThreadPoolGlobals+<>c.<.cctor>b__5_0(System.Object)
   at System.Threading.Channels.AsyncOperation`1[[System.Boolean, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].SetCompletionAndInvokeContinuation()
   at System.Threading.Channels.AsyncOperation`1[[System.Boolean, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].SignalCompletion()
   at System.Threading.Channels.SingleConsumerUnboundedChannel`1+UnboundedChannelWriter[[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].TryWrite(System.__Canon)
   at System.Threading.Channels.SingleConsumerUnboundedChannel`1+UnboundedChannelWriter[[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].WriteAsync(System.__Canon, System.Threading.CancellationToken)
   at MassTransit.Util.ChannelExecutor+<Run>d__11`1[[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].MoveNext()
   at System.Runtime.CompilerServices.AsyncMethodBuilderCore.Start[[MassTransit.Util.ChannelExecutor+<Run>d__11`1[[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]], MassTransit, Version=7.1.4.0, Culture=neutral, PublicKeyToken=b8e0e9f2f1e657fa]](<Run>d__11`1<System.__Canon> ByRef)
   at System.Runtime.CompilerServices.AsyncTaskMethodBuilder`1[[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].Start[[MassTransit.Util.ChannelExecutor+<Run>d__11`1[[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]], MassTransit, Version=7.1.4.0, Culture=neutral, PublicKeyToken=b8e0e9f2f1e657fa]](<Run>d__11<System.__Canon> ByRef)
   at MassTransit.Util.ChannelExecutor.Run[[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]](System.Func`1<System.__Canon>, System.Threading.CancellationToken)
   at MassTransit.KafkaIntegration.Contexts.KafkaConsumerContext`2[[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].Consume(System.Threading.CancellationToken)
   at MassTransit.KafkaIntegration.Contexts.SharedConsumerContext`2[[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e],[System.__Canon, System.Private.CoreLib, Version=4.0.0.0, Culture=neutral, PublicKeyToken=7cec85d7bea7798e]].Consume(System.Threading.CancellationToken)
根因定位
  • 异常触发点位于Confluent.Kafka非托管原生方法rd_kafka_consumer_poll调用阶段,属于典型的非托管内存访问竞态问题
  • 核心时序问题:MassTransit 7.1.4版本的Rider组件在响应Ctrl+C触发的应用关闭流程时,存在逻辑时序错位——会先释放Confluent.Kafka Consumer实例对应的非托管内存块,但此时运行中的消费轮询循环还持有指向该内存块的原生指针,后续轮询操作直接访问已被释放的无效地址,就会触发内存访问违规崩溃
  • 调试器停止无异常的原因:调试器触发终止时会直接强制结束进程,不会走.NET Core的IHost生命周期停止流程,不存在先后释放资源的时序差,因此不会触发竞态
  • 替换RabbitMQ、移除Kafka配置无异常的原因:RabbitMQ客户端为纯托管实现,不存在非托管资源释放的时序问题;移除Kafka配置后自然没有对应的非托管内存访问逻辑。
适配解决方案
  • 方案1:升级MassTransit版本至7.2.0及以上,该版本官方已修复Kafka Rider关闭流程的非托管资源释放时序问题,调整了关闭逻辑顺序:先发送信号终止消费轮询循环,等待所有轮询操作完全退出后,再释放Consumer实例的非托管内存
  • 方案2:如果暂时无法升级版本,可手动调整应用关闭超时配置,给消费循环留足退出时间,缩小竞态触发概率:
    services.Configure<HostOptions>(opt =>
    {
        // 将关闭超时设置为15秒,确保消费循环完全退出后再执行后续资源释放操作
        opt.ShutdownTimeout = TimeSpan.FromSeconds(15);
    });
    
  • 方案3:移除AddMassTransitHostedService的自动托管注册,自定义服务控制Rider的启动、停止顺序,确保非托管资源的释放操作晚于消费循环的终止逻辑,从根源上避免竞态。

内容的提问来源于stack exchange,提问作者Rafał Ryszkowski

相关产品推荐
方舟 Agent Plan

超全模态模型 × Harness 升级,最新支持 Deepseek-V4.1-Flash、GLM-5.3 系列、Doubao-Seedream-5.0-pro、Kimi-K3 (部分), 限时 9.9 元起

最近更新时间:2026.11.05 19:15:04