MOE: Mixtrals not supported / missing module?

[David-AU-github]

Tried to make a MIXTRAL moe with latest merge kit ; ran into this error(s) below.

Had to revert to Mergekit version : pre version of mergekit 0.1.0
Date: Dec 10 2024.
Was able to build MOE with this version.

CURRENT Mergekit Error (May 13 2025) when executing:

mergekit-moe --clone-tensors f:/mergefiles/MN-Dark-Universe-MOE-4X12B-Reasoning.txt e:/MN-Dark-Universe-MOE-4X12B-Reasoning

ERROR:

Traceback (most recent call last):
File "", line 198, in run_module_as_main
File "", line 88, in run_code
File "C:\Program Files\Python312\Scripts\mergekit-moe.exe_main.py", line 4, in
File "F:\mergekit9\mergekit\mergekit\scripts\moe.py", line 14, in
from mergekit.moe import ALL_OUTPUT_ARCHITECTURES, MoEOutputArchitecture
File "F:\mergekit9\mergekit\mergekit\moe_init.py", line 5, in
from mergekit.moe.mixtral import MixtralMoE
File "F:\mergekit9\mergekit\mergekit\moe\mixtral.py", line 12, in
from mergekit.architecture.mixtral import MISTRAL_INFO
ModuleNotFoundError: No module named 'mergekit.architecture.mixtral'

[cg123]

Thanks for the report! Looks like I broke this in #564. It should be fixed on main now.

[David-AU-github]

Thanks - you are the best!