PostgreSQL Tokenization: Fix unexpected characters after question mark being silently ignored#2129

Merged

iffyio merged 3 commits intoapache:mainfrom

jnlt3:postgres-tokenizer-question

Dec 18, 2025

Commits on Dec 18, 2025

postgres tokenizer: do not silently ignore the character after a question mark if it is not one of the expected characters
jnlt3
committed
Add test case for the tokenizer consuming the character following a question mark
jnlt3
committed
Move test case from sqlparser_postgres.rs to tokenizer.rs
jnlt3
committed