You need to enable JavaScript to run this app.
优惠活动
大模型
产品
解决方案
定价
更多

使用tidymodels评分新数据时遇报错:step_log缺失price列

解决tidymodels手动预测时step_log报错问题

我正在学习tidymodels,以下代码可以正常运行:

library(tidyverse)
library(tidymodels)

# 抽取2000条样本用于模型测试
set.seed(1234)
diamonds <- diamonds %>%    
  sample_n(2000)
  
diamonds_split <- initial_split(diamonds, prop = 0.80, strata="price")
diamonds_train <- training(diamonds_split)
diamonds_test <- testing(diamonds_split)

folds <- rsample::vfold_cv(diamonds_train, v = 10, strata="price")
metric <- metric_set(rmse,rsq,mae)

# KNN模型定义
knn_spec <-
  nearest_neighbor(
    mode = "regression", 
    neighbors = tune("k"),
    engine = "kknn"
  ) 

knn_rec <-
  recipe(price ~ ., data = diamonds_train) %>%
  step_log(all_outcomes()) %>% 
  step_normalize(all_numeric_predictors()) %>% 
  step_dummy(all_nominal_predictors())

knn_wflow <- 
  workflow() %>% 
  add_model(knn_spec) %>%
  add_recipe(knn_rec)

knn_grid = expand.grid(k=c(1,5,10,30))

knn_res <- 
  tune_grid(
    knn_wflow,
    resamples = folds,
    metrics = metric,
    grid = knn_grid
  )

collect_metrics(knn_res)
autoplot(knn_res)
show_best(knn_res,metric="rmse")

# 最优KNN模型
best_knn_spec <-
  nearest_neighbor(
    mode = "regression", 
    neighbors = 10,
    engine = "kknn"
  ) 

best_knn_wflow <- 
  workflow() %>% 
  add_model(best_knn_spec) %>%
  add_recipe(knn_rec)

best_knn_fit <- last_fit(best_knn_wflow, diamonds_split)
collect_metrics(best_knn_fit)

但手动拟合最优模型并应用到测试集时出现报错:

Error in `step_log()`: ! The following required column is missing from `new_data` in step 'log_mUSAb': price. Run `rlang::last_trace()` to see where the error occurred.

执行的代码:

# 手动预测
f1 = fit(best_knn_wflow,diamonds_train)
p1 = predict(f1,new_data=diamonds_test)

报错原因

报错核心在于recipe中的step_log(all_outcomes())在预测阶段仍尝试寻找结果列price。all_outcomes()会标记结果变量(此处为price)需要做log转换,训练阶段该步骤正常执行,但在预测阶段,workflow默认会将new_data中的结果列视为待预测目标,不会将其传入recipe的转换流程,导致step_log找不到price列而报错。

同时需要注意:你的模型实际学习的是**log(price)**与特征的关系,直接预测得到的是log转换后的价格,后续需要反转换才能得到真实价格。


解决方案

修改recipe,明确指定对price做log转换,并设置skip = TRUE让该步骤仅在训练阶段执行;预测后使用exp()将结果反转换为真实价格。

修改后的代码:

# 修改后的recipe:指定price并设置skip=TRUE
knn_rec <-
  recipe(price ~ ., data = diamonds_train) %>%
  step_log(price, skip = TRUE) %>% # 仅训练时执行log转换
  step_normalize(all_numeric_predictors()) %>% 
  step_dummy(all_nominal_predictors())

# 重新定义workflow(其余代码不变)
best_knn_wflow <- 
  workflow() %>% 
  add_model(best_knn_spec) %>%
  add_recipe(knn_rec)

# 手动拟合与预测
f1 <- fit(best_knn_wflow, diamonds_train)
p1 <- predict(f1, new_data = diamonds_test) %>%
  mutate(predicted_price = exp(.pred)) # 反转换得到真实价格

# 查看预测结果与真实值对比
bind_cols(diamonds_test %>% select(price), p1)

如果不需要保留测试集的真实price列,直接传入剔除price的测试集也能正常运行:

p1 <- predict(f1, new_data = diamonds_test %>% select(-price)) %>%
  mutate(predicted_price = exp(.pred))

内容的提问来源于stack exchange,提问作者user23438

相关产品推荐
方舟 Agent Plan

超全模态模型 × Harness 升级,最新支持 Deepseek-V4.1-Flash、GLM-5.3 系列、Doubao-Seedream-5.0-pro、Kimi-K3 (部分), 限时 9.9 元起

最近更新时间:2026.07.20 00:07:20