- [x] Add unittests for chat models - [x] Support structured output within the chat models - [ ] Support prompt cache in the current chat models