使用tidymodels评分新数据时遇报错:step_log缺失price列
解决tidymodels手动预测时step_log报错问题
我正在学习tidymodels,以下代码可以正常运行:
library(tidyverse) library(tidymodels) # 抽取2000条样本用于模型测试 set.seed(1234) diamonds <- diamonds %>% sample_n(2000) diamonds_split <- initial_split(diamonds, prop = 0.80, strata="price") diamonds_train <- training(diamonds_split) diamonds_test <- testing(diamonds_split) folds <- rsample::vfold_cv(diamonds_train, v = 10, strata="price") metric <- metric_set(rmse,rsq,mae) # KNN模型定义 knn_spec <- nearest_neighbor( mode = "regression", neighbors = tune("k"), engine = "kknn" ) knn_rec <- recipe(price ~ ., data = diamonds_train) %>% step_log(all_outcomes()) %>% step_normalize(all_numeric_predictors()) %>% step_dummy(all_nominal_predictors()) knn_wflow <- workflow() %>% add_model(knn_spec) %>% add_recipe(knn_rec) knn_grid = expand.grid(k=c(1,5,10,30)) knn_res <- tune_grid( knn_wflow, resamples = folds, metrics = metric, grid = knn_grid ) collect_metrics(knn_res) autoplot(knn_res) show_best(knn_res,metric="rmse") # 最优KNN模型 best_knn_spec <- nearest_neighbor( mode = "regression", neighbors = 10, engine = "kknn" ) best_knn_wflow <- workflow() %>% add_model(best_knn_spec) %>% add_recipe(knn_rec) best_knn_fit <- last_fit(best_knn_wflow, diamonds_split) collect_metrics(best_knn_fit)
但手动拟合最优模型并应用到测试集时出现报错:
Error in `step_log()`: ! The following required column is missing from `new_data` in step 'log_mUSAb': price. Run `rlang::last_trace()` to see where the error occurred.
执行的代码:
# 手动预测 f1 = fit(best_knn_wflow,diamonds_train) p1 = predict(f1,new_data=diamonds_test)
报错原因
报错核心在于recipe中的step_log(all_outcomes())在预测阶段仍尝试寻找结果列price。all_outcomes()会标记结果变量(此处为price)需要做log转换,训练阶段该步骤正常执行,但在预测阶段,workflow默认会将new_data中的结果列视为待预测目标,不会将其传入recipe的转换流程,导致step_log找不到price列而报错。
同时需要注意:你的模型实际学习的是**log(price)**与特征的关系,直接预测得到的是log转换后的价格,后续需要反转换才能得到真实价格。
解决方案
修改recipe,明确指定对price做log转换,并设置skip = TRUE让该步骤仅在训练阶段执行;预测后使用exp()将结果反转换为真实价格。
修改后的代码:
# 修改后的recipe:指定price并设置skip=TRUE knn_rec <- recipe(price ~ ., data = diamonds_train) %>% step_log(price, skip = TRUE) %>% # 仅训练时执行log转换 step_normalize(all_numeric_predictors()) %>% step_dummy(all_nominal_predictors()) # 重新定义workflow(其余代码不变) best_knn_wflow <- workflow() %>% add_model(best_knn_spec) %>% add_recipe(knn_rec) # 手动拟合与预测 f1 <- fit(best_knn_wflow, diamonds_train) p1 <- predict(f1, new_data = diamonds_test) %>% mutate(predicted_price = exp(.pred)) # 反转换得到真实价格 # 查看预测结果与真实值对比 bind_cols(diamonds_test %>% select(price), p1)
如果不需要保留测试集的真实price列,直接传入剔除price的测试集也能正常运行:
p1 <- predict(f1, new_data = diamonds_test %>% select(-price)) %>% mutate(predicted_price = exp(.pred))
内容的提问来源于stack exchange,提问作者user23438
相关产品推荐
相关产品推荐

