最新消息:雨落星辰是一个专注网站SEO优化、网站SEO诊断、搜索引擎研究、网络营销推广、网站策划运营及站长类的自媒体原创博客

hadoop - [SPARK][JAVA] - java.lang.NoClassDefFoundError: commaprwebsecuritySslConfig - Stack Overflow

programmeradmin3浏览0评论

I have a java/spark project, and I want to have unitTest.

        <spark.version>3.5.2.0</spark.version>
        <hive.version>3.1.3.650</hive.version>
        <hbase.version>1.4.14.700</hbase.version>
        <hadoop.version>3.3.5.500</hadoop.version>

I have created a environnement variable

  • MAPR_HOME="C:\Users\USER\opt\mapr"
  • with an empty mapr-clusters.conf file in C:\Users<USER>\opt\mapr\conf\mapr-clusters.conf

When I execute my test I have the 3 errors :

java.lang.ClassNotFoundException: com.mapr.fs.ShimLoader
    at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
    at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
    at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
    at .apache.hadoop.conf.CoreDefaultProperties.<clinit>(CoreDefaultProperties.java:61)
    at .apache.hadoop.conf.Configuration.<clinit>(Configuration.java:804)
    at .apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:251)
    at .apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:666)
    at .apache.spark.util.Utils$.$anonfun$getCurrentUserName$1(Utils.scala:2416)
    at scala.Option.getOrElse(Option.scala:189)
    at .apache.spark.util.Utils$.getCurrentUserName(Utils.scala:2416)
    at .apache.spark.SparkContext.<init>(SparkContext.scala:331)
    at .apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2908)
    at .apache.spark.sql.SparkSession$Builder.$anonfun$getOrCreate$2(SparkSession.scala:1099)
    at scala.Option.getOrElse(Option.scala:189)

AND

java.lang.ClassNotFoundException: com.mapr.baseutils.JVMProperties
    at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
    at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
    at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
    at .apache.hadoop.conf.CoreDefaultProperties.<clinit>(CoreDefaultProperties.java:78)
    at .apache.hadoop.conf.Configuration.<clinit>(Configuration.java:804)
    at .apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:251)
    at .apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:666)
    at .apache.spark.util.Utils$.$anonfun$getCurrentUserName$1(Utils.scala:2416)

AND

java.lang.NoClassDefFoundError: com/mapr/web/security/SslConfig
发布评论

评论列表(0)

  1. 暂无评论