Support muon with deepspeed

[zinccat]

⚠️ Please check that this feature request hasn't been suggested before.

• I searched previous Ideas in Discussions didn't find any similar feature requests.
• I searched previous Issues didn't find any similar feature requests.

🔖 Feature description

Current code checks and blocks using muon with deepspeed, now with a new pr for deepspeed, it should enable this possibility

✔️ Solution

deepspeedai/DeepSpeed#7509

❓ Alternatives

No response

📝 Additional Context

No response

Acknowledgements

• My issue title is concise, descriptive, and in title casing.
• I have searched the existing issues to make sure this feature has not been requested yet.
• I have provided enough information for the maintainers to understand and evaluate this request.

[NanoCode012]

We currently use a custom implementation for muon https://github.com/axolotl-ai-cloud/axolotl-contribs-mit/blob/main/src/axolotl/contribs/mit/muon.py

We're open to a PR for this if you would like to give it a try.