Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

merging native pytorch model locally #376

Open
sorobedio opened this issue Jul 23, 2024 · 2 comments
Open

merging native pytorch model locally #376

sorobedio opened this issue Jul 23, 2024 · 2 comments

Comments

@sorobedio
Copy link

hello, is it possible to merge a local model I meant non huggingface model.
what should be the parameters in such cases.
what I wan is to perform some preprocessing merge the models evaluate the merge locally then save the checkpoints.

@hoooooli
Copy link

可以的,yml文件中的模型填写本地路径就可以,没有其他需要改变的

@zyp100200
Copy link

可以的,yml文件中的模型填写本地路径就可以,没有其他需要改变的

怎么写呢?
models:

  • model: "model1.pth"
    parameters:
    density: 0.5
    weight: 0.5
  • model: "model2.pth"
    parameters:
    density: 0.5
    weight: 0.5
    merge_method: ties
    base_model: "model1.pth"
    parameters:
    normalize: true
    int8_mask: true
    dtype: float16
    这是yaml文件,会出现 Input should be a valid list [type=list_type, input_value='float16', input_type=str]
    的错误

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

3 participants