在Microsoft Fabric Notebook中连接MongoDB Atlas与PySpark遇问题求助

我尝试在Microsoft Fabric Notebook中通过PySpark连接MongoDB Atlas，使用的PySpark代码如下：

from pyspark.sql import SparkSession
mongo_uri = "mongodb+srv://<username>:<password>@cluster1.hju3l.mongodb.net/?retryWrites=true&w=majority&appName=Cluster1"
my_spark = SparkSession \
    .builder \
    .appName("myApp") \
    .config("spark.mongodb.read.connection.uri", mongo_uri) \
    .config("spark.mongodb.write.connection.uri", mongo_uri) \
    .config("spark.jars.packages", "org.mongodb.spark:mongo-spark-connector_2.12:10.2.0") \
    .getOrCreate()
df = spark.read.format("mongodb").option("database", "lead").option("collection", "users").load()
df.printSchema()

运行上述代码时出现如下错误：

Py4JJavaError: An error occurred while calling o6558.load.
: org.apache.spark.SparkClassNotFoundException: [DATA_SOURCE_NOT_FOUND] Failed to find the data source: mongodb. Please find packages at `https://spark.apache.org/third-party-projects.html`.

已确认问题源于mongo-spark-connector Jar包未被找到，但我已完成以下操作：

• 在Microsoft Fabric的自定义库中上传了该Jar包
• 在公共库中安装了mongoengine
• 在Notebook的Spark环境中上传了相同的mongo-spark-connector_2.12-10.2.0.jar包

内容的提问来源于stack exchange，提问作者dipti