SSH连接时NetworkManager权限缺失但GUI/控制台正常的问题求助

我遇到一个奇怪的权限问题，想请教大家：

当我在虚拟机的GUI界面里，用vm用户执行下面的命令切换网络连接配置时完全正常：

vm@ubuntu1804:~$ nmcli con up DYNAMIC

但如果我通过SSH远程登录这台虚拟机，同样用vm用户执行一模一样的命令，就会报错：

vm@ubuntu1804:~$ nmcli con up DYNAMIC
Error: Connection activation failed: Not authorized to control networking.

我猜测是权限差异导致的，于是分别在GUI本地登录和SSH远程登录两种场景下，用nmcli general permissions命令查看了NetworkManager的权限设置：

GUI本地登录时的权限输出： #

PERMISSION                                                        VALUE
org.freedesktop.NetworkManager.enable-disable-network             yes
org.freedesktop.NetworkManager.enable-disable-wifi                yes
org.freedesktop.NetworkManager.enable-disable-wwan                yes
org.freedesktop.NetworkManager.enable-disable-wimax               yes
org.freedesktop.NetworkManager.sleep-wake                         no
org.freedesktop.NetworkManager.network-control                    yes
org.freedesktop.NetworkManager.wifi.share.protected               yes
org.freedesktop.NetworkManager.wifi.share.open                    yes
org.freedesktop.NetworkManager.settings.modify.system             yes
org.freedesktop.NetworkManager.settings.modify.own                yes
org.freedesktop.NetworkManager.settings.modify.hostname           auth
org.freedesktop.NetworkManager.settings.modify.global-dns         auth
org.freedesktop.NetworkManager.reload                             auth
org.freedesktop.NetworkManager.checkpoint-rollback                auth
org.freedesktop.NetworkManager.enable-disable-statistics          yes
org.freedesktop.NetworkManager.enable-disable-connectivity-check  yes

SSH远程登录时的权限输出： #

PERMISSION                                                        VALUE
org.freedesktop.NetworkManager.enable-disable-network             no
org.freedesktop.NetworkManager.enable-disable-wifi                no
org.freedesktop.NetworkManager.enable-disable-wwan                no
org.freedesktop.NetworkManager.enable-disable-wimax               no
org.freedesktop.NetworkManager.sleep-wake                         no
org.freedesktop.NetworkManager.network-control                    auth
org.freedesktop.NetworkManager.wifi.share.protected               no
org.freedesktop.NetworkManager.wifi.share.open                    no
org.freedesktop.NetworkManager.settings.modify.system             no
org.freedesktop.NetworkManager.settings.modify.own                auth
org.freedesktop.NetworkManager.settings.modify.hostname           auth
org.freedesktop.NetworkManager.settings.modify.global-dns         auth
org.freedesktop.NetworkManager.reload                             auth
org.freedesktop.NetworkManager.checkpoint-rollback                auth
org.freedesktop.NetworkManager.enable-disable-statistics          no
org.freedesktop.NetworkManager.enable-disable-connectivity-check  no

很明显两种场景下权限差异很大，我尝试过参考某个关于“Not authorized to control networking”问题的解决方案，但没有效果。

特别说明：我不想用sudo来解决这个问题，希望能找到让普通用户vm在SSH登录时也拥有和GUI登录时相同NetworkManager权限的方法。

备注：内容来源于stack exchange，提问作者john smith