[8.0] PS-9683 : Enable CHECK TABLE EXTENDED to detect InnoDB LOB corruptions by satya-bodapati · Pull Request #5585 · percona/percona-server

satya-bodapati · 2025-04-14T10:49:43Z

https://perconadev.atlassian.net/browse/PS-9683

Problem:

In some of the customer environments, it is found that an external LOB's first page is shared between two records. This shouldn't be possible. But it can happen rarely. The root cause is not known yet. Using table in state, can lead to corruption and assertion failures.

Fix:

But we can detect such a scenario by scanning all records and the external LOB's first page. the EXTENDED keyword currently is ignored by InnoDB.

We use it to enable the LOB checks and mark index as corrupted if an external LOB's first page is shared between two records.

A thread local blob map is used to identify the duplicate user record that has the same external LOB page.

usage:

CHECK TABLE t1 EXTENDED

A sample error log when such corruption is detected:

2025-04-11T10:30:28.078607Z 9 [ERROR] [MY-011825] [InnoDB] Invalid record! External LOB first page cannot be shared between two records 2025-04-11T10:30:28.078625Z 9 [ERROR] [MY-011825] [InnoDB] The external LOB first page is [page id: space=6, page number=347] 2025-04-11T10:30:28.078631Z 9 [ERROR] [MY-011825] [InnoDB] The first occurence of the external LOB first page is in record : page_no: 3 with heap_no: 6 2025-04-11T10:30:28.078638Z 9 [ERROR] [MY-011825] [InnoDB] The second occurence of the external LOB first page is in record: page_no: 4 with heap no: 7 2025-04-11T10:30:28.078646Z 9 [ERROR] [MY-012738] [InnoDB] Apparent corruption in space 6 page 4 index PRIMARY 2025-04-11T10:30:28.078663Z 9 [ERROR] [MY-013050] [InnoDB] In page 4 of index PRIMARY of table test.t1 2025-04-11T10:30:28.088156Z 9 [Warning] [MY-012382] [InnoDB] Cannot open table test/t1Please refer to http://dev.mysql.com/doc/refman/8.0/en/innodb-troubleshooting.html for how to resolve the issue.

Copilot

Copilot reviewed 4 out of 6 changed files in this pull request and generated no comments.

Files not reviewed (2)

mysql-test/suite/innodb/r/percona_extended_check_table_debug.result: Language not supported
mysql-test/suite/innodb/t/percona_extended_check_table_debug.test: Language not supported

Comments suppressed due to low confidence (3)

storage/innobase/page/page0page.cc:1780

[nitpick] Consider refactoring 'lob::btr_rec_get_field_ref' to accept a const parameter to avoid using const_cast, which can potentially lead to unsafe modifications.

byte *field_ref = const_cast<byte *>(lob::btr_rec_get_field_ref(index, rec, offsets, i));

storage/innobase/page/page0page.cc:1815

[nitpick] The use of the magic number 5 in the simulate_lob_corruption block could be replaced with a named constant for improved clarity and maintainability.

if (thread_local_blob_map->size() >= 5) {

storage/innobase/fsp/fsp0fsp.cc:3569

Verify that handling a null seg_header by simply skipping the inode retrieval is intended; if seg_header can be null, consider adding explicit handling or logging for this case to avoid potential downstream issues.

if (seg_header != nullptr) {

github-actions

⚠️ Clang-Tidy found issue(s) with the introduced code (1/1)

github-actions · 2025-04-14T10:57:28Z

storage/innobase/page/page0page.cc

+  ulint n_fields = rec_offs_n_fields(offsets);
+
+  for (ulint i = 0; i < n_fields; i++) {
+    if (rec_offs_nth_extern(index, offsets, i)) {


⚠️ readability-implicit-bool-conversion ⚠️
implicit conversion ulint (aka unsigned long) -> bool

Suggested change

if (rec_offs_nth_extern(index, offsets, i)) {

if (rec_offs_nth_extern(index, offsets, i) != 0u) {

github-actions · 2025-04-14T10:57:28Z

storage/innobase/page/page0page.cc

+    if (rec_offs_nth_extern(index, offsets, i)) {
+      // We do const_cast to remove constness because lob::ref_t doesn't have a
+      // variant that takes const record pointer
+      byte *field_ref = const_cast<byte *>(


⚠️ cppcoreguidelines-pro-type-const-cast ⚠️
do not use const_cast

github-actions · 2025-04-14T10:57:29Z

storage/innobase/page/page0page.cc

      goto func_exit;
    }

+    if (!page_rec_blob_validate(const_cast<byte *>(rec), index, offsets)) {


⚠️ cppcoreguidelines-pro-type-const-cast ⚠️
do not use const_cast

github-actions · 2025-04-14T10:57:29Z

storage/innobase/page/page0page.cc

    }

+    if (!page_rec_blob_validate(const_cast<byte *>(rec), index, offsets)) {
+      goto func_exit;


⚠️ cppcoreguidelines-avoid-goto ⚠️
avoid using goto for flow control

github-actions · 2025-04-14T10:57:29Z

storage/innobase/fsp/fsp0fsp.cc

-  ut_ad(!((page_offset(seg_inode) - FSEG_ARR_OFFSET) % FSEG_INODE_SIZE));
+    ut_a(seg_inode);
+    ut_ad(mach_read_from_4(seg_inode + FSEG_MAGIC_N) == FSEG_MAGIC_N_VALUE);
+    ut_ad(!((page_offset(seg_inode) - FSEG_ARR_OFFSET) % FSEG_INODE_SIZE));


⚠️ bugprone-implicit-widening-of-multiplication-result ⚠️
performing an implicit widening conversion to type unsigned long of a multiplication performed in type unsigned int

github-actions · 2025-04-14T10:57:29Z

storage/innobase/handler/ha_innodb.cc

    }

+    /* true if user uses CHECK TABLE t1 EXTENDED */
+    const bool is_extended = check_opt->flags & T_EXTEND;


⚠️ readability-implicit-bool-conversion ⚠️
implicit conversion unsigned long -> bool

Suggested change

const bool is_extended = check_opt->flags & T_EXTEND;

const bool is_extended = (check_opt->flags & T_EXTEND) != 0u;

github-actions · 2025-04-14T10:57:29Z

storage/innobase/handler/ha_innodb.cc

+        } else {
+          continue;
+        }


⚠️ llvm-else-after-return ⚠️
do not use else after break

Suggested change

} else {

continue;

}

} continue;

Copilot

Copilot reviewed 4 out of 6 changed files in this pull request and generated no comments.

Files not reviewed (2)

mysql-test/suite/innodb/r/percona_extended_check_table_debug.result: Language not supported
mysql-test/suite/innodb/t/percona_extended_check_table_debug.test: Language not supported

Comments suppressed due to low confidence (2)

storage/innobase/page/page0page.cc:1836

Correct the spelling of 'occurence' to 'occurrence'.

ib::error() << "The first occurence of the external LOB first page is in record : page_no: " << val.first << " with heap_no: " << val.second;

storage/innobase/page/page0page.cc:1839

Correct the spelling of 'occurence' to 'occurrence'.

ib::error() << "The second occurence of the external LOB first page is " << "in record: page_no: " << page_get_page_no(page) << " with heap no: " << page_rec_get_heap_no(rec);

dlenev

Hello Satya!

Here are some comments about your patch.

Note that I do not insist on replacing thread_local with passing pointer to map as parameter but I think that it will make code more robust.

storage/innobase/handler/ha_innodb.cc

storage/innobase/page/page0page.cc

https://perconadev.atlassian.net/browse/PS-9683 Problem: -------- In some of the customer environments, it is found that an external LOB's first page is shared between two records. This shouldn't be possible. But it can happen rarely. The root cause is not known yet. Using table in state, can lead to corruption and assertion failures. Fix: --- But we can detect such a scenario by scanning all records and the external LOB's first page. the EXTENDED keyword currently is ignored by InnoDB. We use it to enable the LOB checks and mark index as corrupted if an external LOB's first page is shared between two records. A thread local blob map is used to identify the duplicate user record that has the same external LOB page. usage: ------ CHECK TABLE t1 EXTENDED A sample error log when such corruption is detected: 2025-04-11T10:30:28.078607Z 9 [ERROR] [MY-011825] [InnoDB] Invalid record! External LOB first page cannot be shared between two records 2025-04-11T10:30:28.078625Z 9 [ERROR] [MY-011825] [InnoDB] The external LOB first page is [page id: space=6, page number=347] 2025-04-11T10:30:28.078631Z 9 [ERROR] [MY-011825] [InnoDB] The first occurence of the external LOB first page is in record : page_no: 3 with heap_no: 6 2025-04-11T10:30:28.078638Z 9 [ERROR] [MY-011825] [InnoDB] The second occurence of the external LOB first page is in record: page_no: 4 with heap no: 7 2025-04-11T10:30:28.078646Z 9 [ERROR] [MY-012738] [InnoDB] Apparent corruption in space 6 page 4 index `PRIMARY` 2025-04-11T10:30:28.078663Z 9 [ERROR] [MY-013050] [InnoDB] In page 4 of index `PRIMARY` of table `test`.`t1` 2025-04-11T10:30:28.088156Z 9 [Warning] [MY-012382] [InnoDB] Cannot open table test/t1Please refer to http://dev.mysql.com/doc/refman/8.0/en/innodb-troubleshooting.html for how to resolve the issue.

satya-bodapati requested a review from Copilot April 14, 2025 10:49

Copilot AI reviewed Apr 14, 2025

View reviewed changes

github-actions bot reviewed Apr 14, 2025

View reviewed changes

satya-bodapati force-pushed the PS-9683-8.0 branch from acdf8e7 to dde8a8b Compare April 14, 2025 13:43

satya-bodapati requested a review from Copilot April 14, 2025 13:44

Copilot AI reviewed Apr 14, 2025

View reviewed changes

satya-bodapati requested a review from dlenev April 15, 2025 09:30

satya-bodapati changed the title ~~PS-9683 : Enable CHECK TABLE EXTENDED to detect InnoDB LOB corruptions~~ [8.0] PS-9683 : Enable CHECK TABLE EXTENDED to detect InnoDB LOB corruptions Apr 15, 2025

satya-bodapati self-assigned this Apr 15, 2025

dlenev requested changes Jun 13, 2025

View reviewed changes

storage/innobase/handler/ha_innodb.cc Show resolved Hide resolved

storage/innobase/handler/ha_innodb.cc Show resolved Hide resolved

storage/innobase/page/page0page.cc Outdated Show resolved Hide resolved

satya-bodapati added 2 commits January 29, 2026 18:49

Address Review comments

05bc73b

satya-bodapati force-pushed the PS-9683-8.0 branch from 69a2fcf to 05bc73b Compare January 29, 2026 13:22

Fix co-pilot/AI review comments

de3ef99

satya-bodapati requested a review from dlenev January 29, 2026 13:43

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[8.0] PS-9683 : Enable CHECK TABLE EXTENDED to detect InnoDB LOB corruptions#5585

[8.0] PS-9683 : Enable CHECK TABLE EXTENDED to detect InnoDB LOB corruptions#5585
satya-bodapati wants to merge 3 commits intopercona:8.0from
satya-bodapati:PS-9683-8.0

satya-bodapati commented Apr 14, 2025

Uh oh!

Copilot AI left a comment

Uh oh!

github-actions bot left a comment

Uh oh!

github-actions bot Apr 14, 2025

Uh oh!

github-actions bot Apr 14, 2025

Uh oh!

github-actions bot Apr 14, 2025

Uh oh!

github-actions bot Apr 14, 2025

Uh oh!

github-actions bot Apr 14, 2025

Uh oh!

github-actions bot Apr 14, 2025

Uh oh!

github-actions bot Apr 14, 2025

Uh oh!

Copilot AI left a comment

Uh oh!

dlenev left a comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

	if (rec_offs_nth_extern(index, offsets, i)) {
	if (rec_offs_nth_extern(index, offsets, i) != 0u) {

	const bool is_extended = check_opt->flags & T_EXTEND;
	const bool is_extended = (check_opt->flags & T_EXTEND) != 0u;

Conversation

satya-bodapati commented Apr 14, 2025

Problem:

Fix:

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot left a comment

Choose a reason for hiding this comment

Uh oh!

github-actions bot Apr 14, 2025

Choose a reason for hiding this comment

Uh oh!

github-actions bot Apr 14, 2025

Choose a reason for hiding this comment

Uh oh!

github-actions bot Apr 14, 2025

Choose a reason for hiding this comment

Uh oh!

github-actions bot Apr 14, 2025

Choose a reason for hiding this comment

Uh oh!

github-actions bot Apr 14, 2025

Choose a reason for hiding this comment

Uh oh!

github-actions bot Apr 14, 2025

Choose a reason for hiding this comment

Uh oh!

github-actions bot Apr 14, 2025

Choose a reason for hiding this comment

Uh oh!

Copilot AI left a comment

Choose a reason for hiding this comment

Uh oh!

dlenev left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants