Is ther possible to distill Llama3 to Qwen2-1.5B and how to do

[cxchen100]

As a test case, I want to distill Llama3 to small llm:fo example Qwen2-1.5B
if it is possible
and if loss function should be changed?

thanks~

[zl-comment]

Did you succeed?

[Dream-Camellia]

May I ask if you have succeeded? Reproduction or testing?
@cxchen100 @zl-comment @YJiangcm

[zl-comment]

May I ask if you have succeeded? Reproduction or testing? @cxchen100 @zl-comment @YJiangcm

no I didn't succeed