使用mamba-ssm模块触发causal_conv1d_fwd参数不兼容TypeError
运行mamba-ssm测试代码时出现TypeError: causal_conv1d_fwd()参数不兼容问题
运行mamba-ssm测试代码验证模块可用性时,触发如下错误:
TypeError: causal_conv1d_fwd(): incompatible function arguments. The following argument types are supported: 1. (arg0: torch.Tensor, arg1: torch.Tensor, arg2: Optional[torch.Tensor], arg3: bool) -> torch.Tensor Invoked with: tensor([[[ 0.4762, -0.0323, -0.8240, ...
测试代码如下:
import torch from mamba_ssm import Mamba batch, length, dim = 2, 64, 16 x = torch.randn(batch, length, dim).to("cuda") model = Mamba( # This module uses roughly 3 * expand * d_model^2 parameters d_model=dim, # Model dimension d_model d_state=16, # SSM state expansion factor d_conv=4, # Local convolution width expand=2, # Block expansion factor ).to("cuda") y = model(x) assert y.shape == x.shape
已尝试参考GitHub相关issue的解决方案但未解决,当前CUDA环境可正常运行,nvidia-smi输出:
Thu Mar 21 12:20:23 2024 +-----------------------------------------------------------------------------+ | NVIDIA-SMI 520.61.05 Driver Version: 520.61.05 CUDA Version: 11.8 | |-------------------------------+----------------------+----------------------+ | GPU Name Persistence-M| Bus-Id Disp.A | Volatile Uncorr. ECC | | Fan Temp Perf Pwr:Usage/Cap| Memory-Usage | GPU-Util Compute M. | | | | MIG M. | |===============================+======================+======================| | 0 NVIDIA GeForce ... Off | 00000000:01:00.0 Off | N/A | | N/A 52C P0 N/A / N/A | 11MiB / 4096MiB | 0% Default | | | | N/A | +-------------------------------+----------------------+----------------------+ +-----------------------------------------------------------------------------+ | Processes: | | GPU GI CI PID Type Process name GPU Memory | | ID ID Usage | |=============================================================================| | 0 N/A N/A 1605 G /usr/lib/xorg/Xorg 4MiB | | 0 N/A N/A 2186 G /usr/lib/xorg/Xorg 4MiB | +-----------------------------------------------------------------------------+
nvcc -V输出:
nvcc: NVIDIA (R) Cuda compiler driver Copyright (c) 2005-2022 NVIDIA Corporation Built on Wed_Sep_21_10:33:58_PDT_2022 Cuda compilation tools, release 11.8, V11.8.89 Build cuda_11.8.r11.8/compiler.31833905_0
恳请提供相关解决方案,谢谢!
内容的提问来源于stack exchange,提问作者Domenico Costantino Ceglie
相关产品推荐
相关产品推荐

