基于CSV/Param文件构建表依赖关系图表技术求助

第一步：解析参数文件 #

首先用pandas读取分号分隔的文件，处理空值：

import pandas as pd

# 读取文件，指定表头和分隔符
df = pd.read_csv('your_file.param', sep=';', header=0, 
                 names=['Tablename', 'Fieldname', 'From', 'To', 'Group'],
                 na_filter=True)

核心逻辑：明确依赖关系 #

根据你的数据结构，依赖关系通常有两种定义方式，需根据业务场景选择：

1. 字段级依赖：From字段为源表，Tablename为目标表（即目标表的字段来自源表）
2. 分组依赖：同一Group下的表存在关联关系

方案1：NetworkX + Matplotlib（静态图，快速生成） #

适合快速生成可嵌入文档的静态依赖图：

import networkx as nx
import matplotlib.pyplot as plt

# 初始化有向图
G = nx.DiGraph()

# 添加所有唯一表作为节点
all_tables = pd.concat([df['Tablename'], df['From'].dropna()]).unique()
G.add_nodes_from(all_tables)

# 添加依赖边（以字段级依赖为例）
for _, row in df.dropna(subset=['From']).iterrows():
    # 边携带字段名作为标签
    G.add_edge(row['From'], row['Tablename'], label=row['Fieldname'])

# 绘制图表
pos = nx.spring_layout(G)  # 布局算法可替换为circular_layout等
nx.draw(G, pos, with_labels=True, node_size=3000, 
        node_color='lightblue', font_size=10, font_weight='bold')
edge_labels = nx.get_edge_attributes(G, 'label')
nx.draw_networkx_edge_labels(G, pos, edge_labels=edge_labels)

plt.title('Table Dependency Diagram')
plt.show()

方案2：Graphviz（美观静态图，支持多种输出格式） #

需要先安装系统级Graphviz工具（如apt install graphviz或brew安装），再安装Python库pip install graphviz：

from graphviz import Digraph

dot = Digraph(comment='Table Dependencies', format='png')

# 添加节点
for table in pd.concat([df['Tablename'], df['From'].dropna()]).unique():
    dot.node(table, table)

# 添加依赖边
for _, row in df.dropna(subset=['From']).iterrows():
    dot.edge(row['From'], row['Tablename'], label=row['Fieldname'])

# 保存并自动打开图片
dot.render('table_dependencies', view=True)

方案3：Plotly（交互式图表，支持缩放/hover） #

适合需要交互操作的场景：

import plotly.graph_objects as go
import networkx as nx

# 构建图结构
G = nx.DiGraph()
all_tables = pd.concat([df['Tablename'], df['From'].dropna()]).unique()
G.add_nodes_from(all_tables)
for _, row in df.dropna(subset=['From']).iterrows():
    G.add_edge(row['From'], row['Tablename'], label=row['Fieldname'])

# 生成节点和边的坐标
pos = nx.spring_layout(G)

# 处理边数据
edge_x, edge_y = [], []
for edge in G.edges(data=True):
    x0, y0 = pos[edge[0]]
    x1, y1 = pos[edge[1]]
    edge_x.extend([x0, x1, None])
    edge_y.extend([y0, y1, None])

edge_trace = go.Scatter(
    x=edge_x, y=edge_y,
    line=dict(width=0.5, color='#888'),
    hoverinfo='none', mode='lines'
)

# 处理节点数据
node_x, node_y, node_text = [], [], []
for node in G.nodes():
    x, y = pos[node]
    node_x.append(x)
    node_y.append(y)
    node_text.append(node)

node_trace = go.Scatter(
    x=node_x, y=node_y,
    mode='markers+text', text=node_text, textposition='top center',
    marker=dict(showscale=True, colorscale='YlGnBu', size=15),
    hoverinfo='text'
)

# 生成交互式图表
fig = go.Figure(
    data=[edge_trace, node_trace],
    layout=go.Layout(
        title='Interactive Table Dependency Diagram',
        hovermode='closest',
        xaxis=dict(showgrid=False, zeroline=False, showticklabels=False),
        yaxis=dict(showgrid=False, zeroline=False, showticklabels=False)
    )
)
fig.show()

修复PYvis失败问题 #

如果坚持用PYvis，检查以下几点：

1. 过滤空值，避免添加空节点
2. 确保依赖关系逻辑正确（示例数据中From为空，需先处理有效关联行）

from pyvis.network import Network

net = Network(directed=True, height='800px', width='100%')

# 添加有效节点
valid_tables = pd.concat([df['Tablename'], df['From'].dropna()]).unique()
for table in valid_tables:
    net.add_node(table, label=table)

# 添加有效边
for _, row in df.dropna(subset=['From']).iterrows():
    net.add_edge(row['From'], row['Tablename'], label=row['Fieldname'])

# 保存为HTML并打开
net.write_html('table_dependencies.html')

内容的提问来源于stack exchange，提问作者Bikash Ram