I have a java/spark project, and I want to have unitTest.
<spark.version>3.5.2.0</spark.version>
<hive.version>3.1.3.650</hive.version>
<hbase.version>1.4.14.700</hbase.version>
<hadoop.version>3.3.5.500</hadoop.version>
I have created a environnement variable
- MAPR_HOME="C:\Users\USER\opt\mapr"
- with an empty mapr-clusters.conf file in C:\Users<USER>\opt\mapr\conf\mapr-clusters.conf
When I execute my test I have the 3 errors :
java.lang.ClassNotFoundException: com.mapr.fs.ShimLoader
at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
at .apache.hadoop.conf.CoreDefaultProperties.<clinit>(CoreDefaultProperties.java:61)
at .apache.hadoop.conf.Configuration.<clinit>(Configuration.java:804)
at .apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:251)
at .apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:666)
at .apache.spark.util.Utils$.$anonfun$getCurrentUserName$1(Utils.scala:2416)
at scala.Option.getOrElse(Option.scala:189)
at .apache.spark.util.Utils$.getCurrentUserName(Utils.scala:2416)
at .apache.spark.SparkContext.<init>(SparkContext.scala:331)
at .apache.spark.SparkContext$.getOrCreate(SparkContext.scala:2908)
at .apache.spark.sql.SparkSession$Builder.$anonfun$getOrCreate$2(SparkSession.scala:1099)
at scala.Option.getOrElse(Option.scala:189)
AND
java.lang.ClassNotFoundException: com.mapr.baseutils.JVMProperties
at java.base/jdk.internal.loader.BuiltinClassLoader.loadClass(BuiltinClassLoader.java:641)
at java.base/jdk.internal.loader.ClassLoaders$AppClassLoader.loadClass(ClassLoaders.java:188)
at java.base/java.lang.ClassLoader.loadClass(ClassLoader.java:525)
at .apache.hadoop.conf.CoreDefaultProperties.<clinit>(CoreDefaultProperties.java:78)
at .apache.hadoop.conf.Configuration.<clinit>(Configuration.java:804)
at .apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:251)
at .apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:666)
at .apache.spark.util.Utils$.$anonfun$getCurrentUserName$1(Utils.scala:2416)
AND
java.lang.NoClassDefFoundError: com/mapr/web/security/SslConfig