使用Dask读取DataFrame时触发Pandas AttributeError错误求助

运行代码 #

import pandas as pd
import dask.dataframe as dd

# Load a large data file into a Pandas data frame
#pandas_df = pd.read_csv('large_data.csv')
df = pd.read_excel('FinalLeads1502.csv')
# Load the same data file into a Dask data frame
dask_df = dd.from_pandas(df)

报错信息 #

Error:
---------------------------------------------------------------------------
AttributeError                            Traceback (most recent call last)
<ipython-input-7-077f1422e5e2> in <module>
      1 import pandas as pd
----> 2 import dask.dataframe as dd
      3 
      4 # Load a large data file into a Pandas data frame
      5 #pandas_df = pd.read_csv('large_data.csv')

C:\ProgramData\Anaconda3\lib\site-packages\dask\dataframe\__init__.py in <module>
      1 try:
      2     from ..base import compute
----> 3     from . import backends, rolling
      4     from .core import (
      5         DataFrame,

C:\ProgramData\Anaconda3\lib\site-packages\dask\dataframe\backends.py in <module>
----> 1 from .core import get_parallel_type, make_meta, meta_nonempty
      2 from .methods import concat_dispatch
      3 from .utils import group_split_dispatch, hash_object_dispatch

C:\ProgramData\Anaconda3\lib\site-packages\dask\dataframe\core.py in <module>
     53     typename,
     54 )
---&gt; 55 from . import methods
     56 from .accessor import DatetimeAccessor, StringAccessor
     57 from .categorical import CategoricalAccessor, categorize

C:\ProgramData\Anaconda3\lib\site-packages\dask\dataframe\methods.py in <module>
      7 
      8 from ..utils import Dispatch
----> 9 from .utils import (
     10     group_split_dispatch,
     11     hash_object_dispatch,

C:\ProgramData\Anaconda3\lib\site-packages\dask\dataframe\utils.py in <module>
    367 
    368 
--&gt; 369 _numeric_index_types = (pd.Int64Index, pd.Float64Index, pd.UInt64Index)
    370 
    371 meta_nonempty = Dispatch("meta_nonempty")

AttributeError: module 'pandas' has no attribute 'Int64Index'

解决方案 #

这个错误的核心原因是当前安装的Pandas版本过低，pd.Int64Index（大写I的可空整数索引类型）是Pandas 1.0.0及以上版本才引入的特性，而当前使用的Dask版本依赖该属性。

解决步骤：

• 检查当前Pandas版本：

  pip show pandas
  

  或在Python环境中运行：

  import pandas as pd
  print(pd.__version__)
  

• 升级Pandas到兼容版本：
  使用pip升级：

  pip install --upgrade pandas
  

  使用conda升级（如果用Anaconda环境）：

  conda update pandas
  

• 验证修复：重新运行代码，确认Dask可正常导入，且能成功将Pandas DataFrame转为Dask DataFrame。

另外，建议确认Dask与Pandas的版本兼容性，通常最新版Dask需要搭配较新的Pandas版本使用。

内容的提问来源于stack exchange，提问作者Shreyas Namjoshi