[SUPPORT] HoodieFlinkWriteClient.getOrCreateWriteHandle throws an exception NoSuchElementException. More details are required

[LinMingQiang]

Tips before filing an issue

• Have you gone through our FAQs?

• Join the mailing list to engage in conversations and get faster support at dev-subscribe@hudi.apache.org.

• If you have triaged this as a bug, then file an issue directly.

Describe the problem you faced
When we instantiate the hoodiemergehandle, sometimes a certain fielID under a partition does not exist,but the 'loc.getinstanttime()' is 'U' causes an exception NoSuchElementException to be thrown,but the exception information does not tell which fileID file does not exist, which makes it difficult to locate.

A clear and concise description of the problem.

To Reproduce

Steps to reproduce the behavior:

Expected behavior

A clear and concise description of what you expected to happen.

Environment Description

• Hudi version :

• Spark version :

• Hive version :

• Hadoop version :

• Storage (HDFS/S3/GCS..) :

• Running on Docker? (yes/no) :

Additional context

Add any other context about the problem here.

Stacktrace

Add the stacktrace of the error.

[nsivabalan]

@wangxianghu @danny0405 @leesf : can you loop in someone to assist here.

[danny0405]

Did you use the bucket index instead ? There are some fixes for it:

#5590
#5763

[LinMingQiang]

Yes, but someone encountered an nosuchelementexception: no value present in option error again, so I hope to bring more detailed information when reporting this exception, such as the fileID under which partition.Facilitate troubleshooting; There's only one small change here,You can check my PR : #5788

[danny0405]

The error throws because an INSERT records was recognized as an UPDATE and appended to a UPDATE bucket, we may need to figure out why an INSERT has been seen as an UPDATE yet.

[LinMingQiang]

When enable write.insert.cluster, an error NoSuchElementexception: no value present in option will be reported after the data is written for a period of time。This problem is not easy to locate because of the lack of information, and this problem will not occur during local debugging

[hbgstc123]

@danny0405 @LinMingQiang
do you know the cause of this problem or have fixes now? We meet this problem too today. Use hudi 0.12.1 version

[LinMingQiang]

@danny0405 @LinMingQiang do you know the cause of this problem or have fixes now? We meet this problem too today. Use hudi 0.12.1 version

This problem has been solved in 0.12.1. You can open a new issue.