Streaming Issues: Duplicate Values Displayed

[shamuiscoding]

I'm using this repo to build a RAG chatbot for my docs.
from the LangSmith monitor I see the generation is doing fine.
but when i stream to the frontend, it has a weird error of duplicating values.
i'm trying to fix it and would love some help.

I'm on the most recent deployment of the repo.
followed all instructions, so i have a weaviate vector db setup

[shamuiscoding]

I did end up filtering out the duplicated values.

if (Array.isArray(streamedResponse?.streamed_output)) {
          const uniqueList = streamedResponse.streamed_output.reduce((acc, item) => {
            if (!acc.includes(item)) {
              acc.push(item);
            }
            return acc;
          }, []);

          accumulatedMessage = uniqueList.join("");
        }

but I'm curious if this is the best way to handle this