基于Kubernetes的Unity GitLab Pipeline Pod初始化超时问题

运行Pipeline时出现以下错误：

Waiting for pod gitlabrunners/runner-.... to be running, status is Pending
    ContainersNotReady: "containers with unready status: [build helper]"
    ContainersNotReady: "containers with unready status: [build helper]"
ERROR: Job failed (system failure): prepare environment: waiting for pod running: timed out waiting for pod to start. Check https://docs.gitlab.com/runner/shells/index.html#shell-profile-loading for more information

诡异的是，用Helm删除并重新部署GitLab Runner实例后，第一次运行能成功，但之后又会重复出现上述错误。

我的实现基于GameCI提供的GitLab CI入门指南和官方示例项目。

排查推测 #

1. 镜像拉取耗时过长 #

Unity构建镜像体积确实很大，但按道理系统应该等待镜像拉取完成，不应该超时——毕竟在组织内部的Runner上没遇到过这种情况。

相关Pod事件日志如下：

Events:
  Type    Reason     Age    From               Message
  ----    ------     ----   ----               -------
  Normal  Scheduled  7m15s  default-scheduler  Successfully assigned gitlabrunners/runner-2z6aanszi-project-3625-concurrent-0-igflq9df to pgiacc
  Normal  Pulled     7m15s  kubelet            Container image "registry.gitlab.com/gitlab-org/gitlab-runner/gitlab-runner-helper:x86_64-v17.5.1" already present on machine
  Normal  Created    7m15s  kubelet            Created container init-permissions
  Normal  Started    7m15s  kubelet            Started container init-permissions
  Normal  Pulling    7m14s  kubelet            Pulling image "gitlab....:ubuntu-6000.0.19f1-windows-mono-3.1.0"

2. 磁盘空间不足 #

当前VPS有22GB可用空间（占总容量34%），但还是怀疑镜像和构建过程占用空间过大导致问题。

GitLab Runner Pod的磁盘空间情况：

kubectl -n gitlabrunners exec gitlab-runner-76cb9b6b7c-h9r4s -- df -ah
Filesystem                Size      Used Available Use% Mounted on
overlay                  49.0G     26.5G     20.5G  56% /
proc                         0         0         0   0% /proc
tmpfs                    64.0M         0     64.0M   0% /dev
devpts                       0         0         0   0% /dev/pts
mqueue                       0         0         0   0% /dev/mqueue
sysfs                        0         0         0   0% /sys
cgroup                       0         0         0   0% /sys/fs/cgroup
tmpfs                     8.1G      4.0K      8.1G   0% /secrets
/dev/sda1                49.0G     26.5G     20.5G  56% /configmaps
/dev/sda1                49.0G     26.5G     20.5G  56% /etc/hosts
/dev/sda1                49.0G     26.5G     20.5G  56% /dev/termination-log
/dev/sda1                49.0G     26.5G     20.5G  56% /etc/hostname
/dev/sda1                49.0G     26.5G     20.5G  56% /etc/resolv.conf
shm                      64.0M         0     64.0M   0% /dev/shm
/dev/sda1                49.0G     26.5G     20.5G  56% /etc/gitlab-runner
/dev/sda1                49.0G     26.5G     20.5G  56% /home/gitlab-runner
tmpfs                     8.1G      8.0K      8.1G   0% /home/gitlab-runner/.gitlab-runner
tmpfs                     8.1G     12.0K      8.1G   0% /run/secrets/kubernetes.io/serviceaccount
proc                         0         0         0   0% /proc/bus
proc                         0         0         0   0% /proc/fs
proc                         0         0         0   0% /proc/irq
proc                         0         0         0   0% /proc/sys
proc                         0         0         0   0% /proc/sysrq-trigger
tmpfs                     4.1G         0      4.1G   0% /proc/acpi
tmpfs                    64.0M         0     64.0M   0% /proc/kcore
tmpfs                    64.0M         0     64.0M   0% /proc/keys
tmpfs                    64.0M         0     64.0M   0% /proc/timer_list
tmpfs                     4.1G         0      4.1G   0% /sys/firmware

内容的提问来源于stack exchange，提问作者Ciberdead