Skip to content

Commit e7bce9e

Browse files
viiryaJoshRosen
authored andcommitted
[SPARK-17056][CORE] Fix a wrong assert regarding unroll memory in MemoryStore
## What changes were proposed in this pull request? There is an assert in MemoryStore's putIteratorAsValues method which is used to check if unroll memory is not released too much. This assert looks wrong. ## How was this patch tested? Jenkins tests. Author: Liang-Chi Hsieh <simonh@tw.ibm.com> Closes apache#14642 from viirya/fix-unroll-memory.
1 parent 2f84a68 commit e7bce9e

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

core/src/main/scala/org/apache/spark/storage/memory/MemoryStore.scala

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -273,7 +273,7 @@ private[spark] class MemoryStore(
273273
blockId, Utils.bytesToString(size), Utils.bytesToString(maxMemory - blocksMemoryUsed)))
274274
Right(size)
275275
} else {
276-
assert(currentUnrollMemoryForThisTask >= currentUnrollMemoryForThisTask,
276+
assert(currentUnrollMemoryForThisTask >= unrollMemoryUsedByThisBlock,
277277
"released too much unroll memory")
278278
Left(new PartiallyUnrolledIterator(
279279
this,

0 commit comments

Comments
 (0)