Skip to content

Commit a3d4a0d

Browse files
committed
doc
1 parent e33788e commit a3d4a0d

1 file changed

Lines changed: 4 additions & 0 deletions

File tree

docs/rdd-programming-guide.md

Lines changed: 4 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -1465,6 +1465,10 @@ jsc.sc().register(myVectorAcc, "MyVectorAcc1");
14651465

14661466
Note that, when programmers define their own type of AccumulatorV2, the resulting type can be different than that of the elements added.
14671467

1468+
*Warning*: When a Spark task finishes, Spark will try to merge the accumulated updates in this task to an accumulator.
1469+
If it fails, Spark will ignore the failure and still mark the task successful and continue to run other tasks. Hence,
1470+
a buggy accumulator will not impact a Spark job but it will not get updated even if a Spark job is successful.
1471+
14681472
</div>
14691473

14701474
<div data-lang="python" markdown="1">

0 commit comments

Comments
 (0)