最新消息:雨落星辰是一个专注网站SEO优化、网站SEO诊断、搜索引擎研究、网络营销推广、网站策划运营及站长类的自媒体原创博客

java - NullPointerException Issue with Executing generate-synthetic-data.hpl Pipeline in Apache Flink - Stack Overflow

programmeradmin3浏览0评论

I am encountering an issue while executing the generate-synthetic-data.hpl sample pipeline using Apache Flink. Here’s what I’ve configured:

Set the Engine Type to Beam Flink pipeline engine Configured the Flink master Mentioned the hop-fat-jar.jar However, when running the pipeline, I am facing the exception mentioned below. I am using Apache Hop version 2.9.0 on Windows and Apache Flink version 1.17.0, which is running on Linux. From the Flink UI, I can see that the job is going into a failed state.

025-03-10 15:43:05,138 INFO  .apache.flink.runtime.dispatcher.StandaloneDispatcher     [] - Received JobGraph submission 'generate-synthetic-data' (2586a944434f14845a00b714d7d3ad80).
2025-03-10 15:43:05,139 INFO  .apache.flink.runtime.dispatcher.StandaloneDispatcher     [] - Submitting job 'generate-synthetic-data' (2586a944434f14845a00b714d7d3ad80).
2025-03-10 15:43:05,147 INFO  .apache.flink.runtime.rpc.akka.AkkaRpcService             [] - Starting RPC endpoint for .apache.flink.runtime.jobmaster.JobMaster at akka://flink/user/rpc/jobmanager_14 .
2025-03-10 15:43:05,148 INFO  .apache.flink.runtime.jobmaster.JobMaster                 [] - Initializing job 'generate-synthetic-data' (2586a944434f14845a00b714d7d3ad80).
2025-03-10 15:43:05,330 INFO  .apache.flink.runtime.dispatcher.StandaloneDispatcher     [] - Job 2586a944434f14845a00b714d7d3ad80 reached terminal state FAILED.
.apache.flink.runtime.client.JobInitializationException: Could not start the JobMaster.
    at .apache.flink.runtime.jobmaster.DefaultJobMasterServiceProcess.lambda$new$0(DefaultJobMasterServiceProcess.java:97)
    at java.util.concurrent.CompletableFuture.uniWhenComplete(CompletableFuture.java:760)
    at java.util.concurrent.CompletableFuture$UniWhenComplete.tryFire(CompletableFuture.java:736)
    at java.util.concurrent.CompletableFuture.postComplete(CompletableFuture.java:474)
    at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1595)
    at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1142)
    at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:617)
    at java.lang.Thread.run(Thread.java:745)
Caused by: java.util.concurrent.CompletionException: java.lang.NullPointerException
    at java.util.concurrent.CompletableFuture.encodeThrowable(CompletableFuture.java:273)
    at java.util.concurrent.CompletableFuturepleteThrowable(CompletableFuture.java:280)
    at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1592)
    ... 3 more
Caused by: java.lang.NullPointerException
    at .apache.flink.apimon.ExecutionConfig.getNumberOfExecutionRetries(ExecutionConfig.java:486)
    at .apache.flink.apimon.ExecutionConfig.getRestartStrategy(ExecutionConfig.java:459)
    at .apache.flink.runtime.scheduler.DefaultSchedulerFactory.createInstance(DefaultSchedulerFactory.java:99)
    at .apache.flink.runtime.jobmaster.DefaultSlotPoolServiceSchedulerFactory.createScheduler(DefaultSlotPoolServiceSchedulerFactory.java:119)
    at .apache.flink.runtime.jobmaster.JobMaster.createScheduler(JobMaster.java:371)
    at .apache.flink.runtime.jobmaster.JobMaster.<init>(JobMaster.java:348)
    at .apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.internalCreateJobMasterService(DefaultJobMasterServiceFactory.java:123)
    at .apache.flink.runtime.jobmaster.factories.DefaultJobMasterServiceFactory.lambda$createJobMasterService$0(DefaultJobMasterServiceFactory.java:95)
    at .apache.flink.util.function.FunctionUtils.lambda$uncheckedSupplier$4(FunctionUtils.java:112)
    at java.util.concurrent.CompletableFuture$AsyncSupply.run(CompletableFuture.java:1590)
    ... 3 more
2025-03-10 15:43:05,337 INFO  .apache.flink.runtime.dispatcher.StandaloneDispatcher     [] - Job 2586a944434f14845a00b714d7d3ad80 has been registered for cleanup in the JobResultStore after reaching a terminal state.

Has anyone encountered a similar issue or could provide some insights on how to resolve this?

发布评论

评论列表(0)

  1. 暂无评论