Pandas中bool和boolean数据类型的设计原理及空值差异原因是什么？

测试代码 #

import pandas as pd
import numpy as np

df1 = pd.DataFrame({'col1': [True, False, False]}, dtype='bool')
print(df1)
print(df1.info())
print()

df2 = pd.DataFrame({'col1': [True, False, None]}, dtype='bool')
print("df2")
print(df2)
print(df2.info())
print()

df3 = pd.DataFrame({'col1': [True, False, np.nan]}, dtype='bool')
print("df3")
print(df3)
print(df3.info())
print()

df4 = pd.DataFrame({'col1': [True, False, None, np.nan]}, dtype='bool')
print("df4")
print(df4)
print(df4.info())
print()

df5 = pd.DataFrame({'col1': [True, False, False]}, dtype='boolean')
print("df5")
print(df5)
print(df5.info())
print()

df6 = pd.DataFrame({'col1': [True, False, None]}, dtype='boolean')
print("df6")
print(df6)
print(df6.info())
print()

df7 = pd.DataFrame({'col1': [True, False, np.nan]}, dtype='boolean')
print("df7")
print(df7)
print(df7.info())
print()

df8 = pd.DataFrame({'col1': [True, False, None, np.nan]}, dtype='boolean')
print("df8")
print(df8)
print(df8.info())

代码输出 #

df1
        col1
    0   True
    1  False
    2  False
    <class 'pandas.core.frame.DataFrame'>
    RangeIndex: 3 entries, 0 to 2
    Data columns (total 1 columns):
     #   Column  Non-Null Count  Dtype
    ---  ------  --------------  -----
     0   col1    3 non-null      bool 
    dtypes: bool(1)
    memory usage: 135.0 bytes
    None
    
    df2
        col1
    0   True
    1  False
    2  False
    <class 'pandas.core.frame.DataFrame'>
    RangeIndex: 3 entries, 0 to 2
    Data columns (total 1 columns):
     #   Column  Non-Null Count  Dtype
    ---  ------  --------------  -----
     0   col1    3 non-null      bool 
    dtypes: bool(1)
    memory usage: 135.0 bytes
    None
    
    df3
        col1
    0   True
    1  False
    2   True
    <class 'pandas.core.frame.DataFrame'>
    RangeIndex: 3 entries, 0 to 2
    Data columns (total 1 columns):
     #   Column  Non-Null Count  Dtype
    ---  ------  --------------  -----
     0   col1    3 non-null      bool 
    dtypes: bool(1)
    memory usage: 135.0 bytes
    None
    
    df4
        col1
    0   True
    1  False
    2  False
    3   True
    <class 'pandas.core.frame.DataFrame'>
    RangeIndex: 4 entries, 0 to 3
    Data columns (total 1 columns):
     #   Column  Non-Null Count  Dtype
    ---  ------  --------------  -----
     0   col1    4 non-null      bool 
    dtypes: bool(1)
    memory usage: 136.0 bytes
    None
    
    df5
        col1
    0   True
    1  False
    2  False
    <class 'pandas.core.frame.DataFrame'>
    RangeIndex: 3 entries, 0 to 2
    Data columns (total 1 columns):
     #   Column  Non-Null Count  Dtype  
    ---  ------  --------------  -----  
     0   col1    3 non-null      boolean
    dtypes: boolean(1)
    memory usage: 138.0 bytes
    None
    
    df6
        col1
    0   True
    1  False
    2   <NA>
    <class 'pandas.core.frame.DataFrame'>
    RangeIndex: 3 entries, 0 to 2
    Data columns (total 1 columns):
     #   Column  Non-Null Count  Dtype  
    ---  ------  --------------  -----  
     0   col1    2 non-null      boolean
    dtypes: boolean(1)
    memory usage: 138.0 bytes
    None
    
    df7
        col1
    0   True
    1  False
    2   <NA>
    <class 'pandas.core.frame.DataFrame'>
    RangeIndex: 3 entries, 0 to 2
    Data columns (total 1 columns):
     #   Column  Non-Null Count  Dtype  
    ---  ------  --------------  -----  
     0   col1    2 non-null      boolean
    dtypes: boolean(1)
    memory usage: 138.0 bytes
    None
    
    df8
        col1
    0   True
    1  False
    2   <NA>
    3   <NA>
    <class 'pandas.core.frame.DataFrame'>
    RangeIndex: 4 entries, 0 to 3
    Data columns (total 1 columns):
     #   Column  Non-Null Count  Dtype  
    ---  ------  --------------  -----  
     0   col1    2 non-null      boolean
    dtypes: boolean(1)
    memory usage: 140.0 bytes
    None

设计原理与差异解析 #

1. bool类型：基于numpy原生布尔类型的封装 #

bool是Pandas早期支持的类型，本质是对numpybool_类型的直接封装，完全遵循numpy的类型转换规则：

• numpy的布尔类型无缺失值概念，只能用True/False表示，因此None会被强制转换为False；
• np.nan属于浮点型空值，numpy中除0、空数组等特殊值外，所有非零值转布尔类型都会得到True；
• 这类转换会抹平缺失值的存在，所有None/np.nan都会被视为有效布尔值，不会标记为缺失。

2. boolean类型：Pandas专属可空布尔类型 #

boolean是Pandas 1.0版本后推出的类型，专门解决原生bool无法表示缺失布尔值的痛点：

• 它引入了<NA>作为布尔类型的缺失标记，兼容PythonNone和numpynp.nan，二者都会被自动映射为<NA>；
• 内部采用独立存储结构，同时记录布尔值状态和缺失状态，能准确区分True/False/<NA>三种情况。

3. 适用场景 #

• 当数据确定无缺失布尔值，追求最小内存占用时，选择bool类型；
• 当数据存在缺失布尔值，需要准确标记和处理缺失状态时，必须使用boolean类型，避免强制转换导致的数据失真。

内容的提问来源于stack exchange，提问作者gracenz