I am using flink 1.20 with kafka-client 3.4.0. I am using KafkaSink with Exactly Once and checkpoints. I set the transactionIdPrefix and noticed there is a problem in the beginning of using my pipeline.

my transaction.id is auto created by the flink and the same for the client.id. as the flink use the checkpoint id , and the creation of the kafka producer is done before the the first checkpoint successfully triggered ( as "not all required tasks currently running.."), the first transaction.id is kafka-sink-0-1, the second kafka-sink-0-2. I expect the next one to be kafka-sink-0-3 but its kafka-sink-0-1 causing managment.InstanceAlreadyExistsException. the following tarnsaction.id are ok kafka-sink-0-3 ,kafka-sink-0-4....

I know the value kafka-sink-0-X is set by the value of the last checkpoint+1. is there a way to solve this issue?