MiniMaxAI/SynLogic-Mix-3-32B fails with Error("missing field `bos_token_id`", line: 6, column: 1)

[sempervictus]

Describe the bug

thread 'main' panicked at mistralrs-core/src/pipeline/normal.rs:655:18:
bos_token_id/eos_token_id missing in generation_config.json: Error("missing field `bos_token_id`", line: 6, column: 1)
stack backtrace:
   0:     0x5607d6655162 - <std::sys::backtrace::BacktraceLock::print::DisplayBacktrace as core::fmt::Display>::fmt::h2bc1773b63b16421
   1:     0x5607d4ab9463 - core::fmt::write::h8002143aa1074e9d
   2:     0x5607d665435f - std::io::Write::write_fmt::h296d543625a1305a
   3:     0x5607d6654fc3 - std::sys::backtrace::BacktraceLock::print::hcefa4354720f2ea3
   4:     0x5607d66548ff - std::panicking::default_hook::h6f32fe1a34bb6d71
   5:     0x5607d6654027 - std::panicking::rust_panic_with_hook::h369ba414ea661602
   6:     0x5607d66963f8 - std::panicking::begin_panic_handler::{{closure}}::hd5f53fdb59d78538
   7:     0x5607d6696359 - std::sys::backtrace::__rust_end_short_backtrace::hcb15c093250d58b0
   8:     0x5607d6698d8c - __rustc[b21d626d23f8908d]::rust_begin_unwind
   9:     0x5607d4ab758f - core::panicking::panic_fmt::hfb443448b48f4123
  10:     0x5607d4abec95 - core::result::unwrap_failed::hcaaeb9cdb3026765
  11:     0x5607d54e1973 - <mistralrs_core::pipeline::normal::NormalLoader as mistralrs_core::pipeline::loaders::Loader>::load_model_from_path::{{closure}}::h8732243543a58c21
  12:     0x5607d54c467c - <mistralrs_core::pipeline::normal::NormalLoader as mistralrs_core::pipeline::loaders::Loader>::load_model_from_path::h4a5f6d6d1822983e
  13:     0x5607d54bcec5 - <mistralrs_core::pipeline::normal::NormalLoader as mistralrs_core::pipeline::loaders::Loader>::load_model_from_hf::hcf81e017e7fd78ca
  14:     0x5607d5fc89f0 - mistralrs_server::main::{{closure}}::hbb7954d738bb5ded.61526
  15:     0x5607d6153a7e - mistralrs_server::main::h072cd939aa136afc
  16:     0x5607d60bab33 - std::sys::backtrace::__rust_begin_short_backtrace::h3380f49c61273750
  17:     0x5607d61532e5 - main
  18:     0x7f3e48689d90 - <unknown>
  19:     0x7f3e48689e40 - __libc_start_main
  20:     0x5607d44b0725 - _start

Qwen2 base model so ... should work? Tried with -c /chat_templates/default.json but may need something else. CI's spinning up their MiniMaxAI/MiniMax-M1-80k presently to test

Latest commit or version

Which commit or version you ran with.

[EricLBuehler]

Hi @sempervictus! This should be fixed in #1493.

CI's spinning up their MiniMaxAI/MiniMax-M1-80k presently to test

We don't support that architecture yet unfortunately, working on it!