Enable debug capability via GenAI Studio

[siawchen]

Provide ease-to-use debug capability with good user experience in GenAI Studio

[sakasak0]

Hi @siawchen - As you mentioned in #40, this issue plans to provide microservice-based prompt & response tracing. I believe it's an excellent feature, and I'm looking forward to trying it once it's released.

Additionally, I think it would be beneficial to have the following features from another perspective:

• A functionality in GenAIStudio's GUI to check the following information when the sandbox fails to start:
  • The node within the flow related to the Kubernetes resource where the error occurred
  • Details of the error
    • The method of displaying details to the user may require some considerations. For example, display all pod logs, or only show retryable errors like Operational Errors or Timeouts and suggest contacting an administrator for other system errors.

Adding these features could make troubleshooting more efficient. Visualizing error logs and easily identifying related nodes would help developers quickly pinpoint and resolve issues.
I would appreciate your consideration of these suggestions.

[siawchen]

Hi @yoshie-kosaka - Sure, the LLM trace code will be officially released in 2 weeks time by v1.3, please do check them out and share us your feedback.

Besides, thanks for the feedbacks provided on the debug features, we will take this into consideration to plan out the implementation, will keep you updated!