为什么TensorFlow搭建文本生成GAN时出现无梯度提供ValueError报错?
课程作业搭建GAN遇到的梯度计算报错问题
- 开发场景:为大学课程作业搭建生成对抗网络,代码框架参考TensorFlow官方入门级DCGAN教程实现
- 触发报错的核心代码行:
generator_optimizer.apply_gradients(zip(gradients_of_generator, generador.trainable_variables)) - 初步判断:问题大概率和自定义生成器的网络层结构有关,这部分是当前实现和参考教程几乎唯一的差异
自定义生成器实现代码
def create_generator(max_len, vocab_size): model = tf.keras.Sequential() model.add(tf.keras.layers.Embedding(vocab_size, output_dim=64, input_length=max_len)) model.add(tf.keras.layers.LSTM(units=1024, activation='tanh')) model.add(tf.keras.layers.Dense(units=1024, activation='sigmoid')) model.add(tf.keras.layers.Dense(units=MAX_LEN, activation=None)) return model generator = create_generator(MAX_LEN, VOCABULARY_SIZE)
核心训练循环代码
for epoch in range(EPOCHS): noise = (tf.random.uniform([BATCH_SIZE, LATENT_DIM], minval=0, maxval = VOCABULARY_SIZE)) with tf.GradientTape() as disc_tape, tf.GradientTape() as gen_tape: # Generator loss fake_revs = generator(noise) pred_class_fake_revs = discriminator(fake_revs) gen_loss, gen_acc = generator_loss_and_accuracy(pred_class_fake_revs) # Disc loss real_revs = reviews_tok_padded[np.random.randint(0, len(reviews_tok_padded),BATCH_SIZE)] pred_class_real_revs = discriminator(real_revs) disc_loss, disc_acc = discriminator_loss_and_accuracy(pred_class_real_revs, pred_class_fake_revs) gradients_of_generator = gen_tape.gradient(gen_loss, generator.trainable_variables) disc_grad = disc_tape.gradient(disc_loss, discriminator.trainable_variables) generator_optimizer.apply_gradients(zip(gradients_of_generator, generator.trainable_variables)) disc_optimizer.apply_gradients(zip(disc_grad, discriminator.trainable_variables))
完整报错信息
系统输出报错内容:
ValueError: No gradients provided for any variable: ['embedding_22/embeddings:0', 'lstm_22/lstm_cell_30/kernel:0', 'lstm_22/lstm_cell_30/recurrent_kernel:0', 'lstm_22/lstm_cell_30/bias:0', 'dense_44/kernel:0', 'dense_44/bias:0', 'dense_45/kernel:0', 'dense_45/bias:0'].
已完成的排查工作
- 确认问题本质:GradientTape未计算得到生成器参数对应的有效梯度,所有
generator.trainable_variables对应的gradients_of_generator取值均为None - 暂未定位到梯度全为
None的具体触发原因
内容的提问来源于stack exchange,提问作者RR_28023
相关产品推荐
相关产品推荐

