Some inline LaTeX expressions are not rendered by Katex lib (ooba 4.0)

[Kekuaka]

Describe the bug

@mamei16 Thank you very much for your latest fixes and improvements to LaTeX rendering capabilities.

I've tested ooba 4.0 and noticed that some inline LaTeX expressions are not detected and rendered. For example, this expression taken from recent LLM response on ooba 4.0.

some text ($P(\\nu_\\alpha \\to \\nu_\\beta) \\neq P(\\bar{\\nu}_\\alpha \\to \\bar{\\nu}_\\beta)$), some other text

I think that issue may be related to katex/auto-render.js which was added recently in #7402 and tries to detect inline LaTeX expressions.
As far as I was able to find out, in the same LLM response other inline expressions as well were enclosed in parentheses and contained 1 to 3 underscores (not 4 as this one) and were successfully detected and rendered. Unlike other expressions enclosed in parentheses, this one contains comma after right parenthesis.

If I manually remove 3rd and 4th underscores in chat history, this expression is detected and rendered as shown on the screen attached - with the proviso that the marked symbols have not been moved to the subscript. (Maybe 4 underscores is too much?)

Is there an existing issue for this?

• I have searched the existing issues

Reproduction

Copy above LaTeX snippet into your chat history and view this history in the browser.

Screenshot

If I manually remove 3rd and 4th underscores in chat history, this expression is detected and rendered as shown on the screen attached - with the proviso that the marked symbols have not been moved to the subscript.

Logs

No logs could actually show the problem details.

System Info

Ubuntu_22.04 + NVIDIA

[mamei16]

Hi @Kekuaka, thanks for the report!

This is due to the fact that currently, underscores and asterisks are only protected in KaTeX blocks, but not inline expressions. It is more difficult to do this in inline expressions, without accidentally matching dollar signs that are used in other contexts, e.g., when used in connection with currency.

I'm currently testing a modification that aims to fix the issue, but I'm not fully confident yet that it works sufficiently well. You can try it out with this branch: https://github.com/mamei16/text-generation-webui/tree/underscores_asterisks_katex_inline

[Kekuaka]

Hi @mamei16 , thanks for quick fix. The code from your branch works perfectly and renders the LaTeX from this issue.

I'm surprised that other similar inline expressions with underscores worked properly in ooba 4.0 without that fix.
I mean for example this one
some text ($\\theta_{12}, \\theta_{23}, \\theta_{13}$) some text
and few others.