如何基于列匹配与环境关键词清理混乱的Pandas DataFrame表格
数据合并解决方案求助
收集了大量数据,但数据收集表格结构混乱,同一人员的打字、阅读、仰卧起坐测试及对应环境的数据分散在不同行中。需按照前3列(Personnel ID、Education、Origin)及环境条件(提取房间条件)合并数据为整洁表格,每行对应同一人员同一环境下的所有测试数据。本人不熟悉Python和Pandas DataFrame,尝试用Bash处理但因空单元格导致列读取困难,特此寻求解决方案。
原始CSV数据如下:
Personnel ID,Education,Origin,Typing speed (words/min),Typing environment,Reading speed (pages/min),Reading environment,Sit up speed (sit up/min),Sit up environment 110,College,Town A,105,Type English (quiet room),,,, 110,College,Town A,,,3,Read English (quiet room),, 110,College,Town A,,,,,20,Sit up (quiet room) 110,College,Town A,90,Type English (soft music room),,,, 110,College,Town A,,,2.5,Read English (soft music room),, 110,College,Town A,,,,,23,Sit up (soft music room) 110,College,Town A,87,Type English (loud music room),,,, 110,College,Town A,,,2,Read English (loud music room),, 110,College,Town A,,,,,25,Sit up (loud music room) 111,College,Town B,110,Type English (quiet room),,,, 111,College,Town B,,,3.5,Read English (quiet room),, 111,College,Town B,,,,,20,Sit up (quiet room) 111,College,Town B,104,Type English (soft music room),,,, 111,College,Town B,,,3,Read English (soft music room),, 111,College,Town B,,,,,23,Sit up (soft music room) 111,College,Town B,92,Type English (loud music room),,,, 111,College,Town B,,,2,Read English (loud music room),, 112,Highschool,Town A,95,Type English (quiet room),,,, 112,Highschool,Town A,,,2.5,Read English (quiet room),, 112,Highschool,Town A,,,,,, 112,Highschool,Town A,88,Type English (loud music room),,,, 112,Highschool,Town A,,,2.2,Read English (loud music room),, 113,Highschool,Town B,97,Type English (quiet room),,,, 113,Highschool,Town B,,,3,Read English (quiet room),, 113,Highschool,Town B,,,,,23,Sit up (soft music room) 113,Highschool,Town B,81,Type English (loud music room),,,, 113,Highschool,Town B,,,2,Read English (loud music room),, 113,Highschool,Town B,90,Type French (quiet room),,,, 113,Highschool,Town B,,,2.5,Read French (quiet room),, 113,Highschool,Town B,80,Type French (soft music room),,,, 113,Highschool,Town B,,,1.5,Read French (loud music room),, 113,Highschool,Town B,,,,,25,Sit up (loud music room)
同时提供了预期的整洁表格样式参考图。
内容的提问来源于stack exchange,提问作者user20850595
相关产品推荐
相关产品推荐

