Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

TypeError: Value.__init__() missing 1 required positional argument: 'dtype' #30

Open
robinjoe93 opened this issue Feb 14, 2025 · 5 comments

Comments

@robinjoe93
Copy link

robinjoe93 commented Feb 14, 2025

Image

dtype在哪里设置??

@anine09
Copy link
Contributor

anine09 commented Feb 15, 2025

Hi @robinjoe93 ,这不一定是设置的问题,请仔细检测你的配置文件和数据集文件是否正确

@tize-72
Copy link

tize-72 commented Feb 18, 2025

这个问题有遇到,我的情况是数据集下载的方式错了,用的ModelScope中的数据集。

@tize-72
Copy link

tize-72 commented Feb 18, 2025

推荐用原文中写的huggingface中的数据集

@robinjoe93
Copy link
Author

推荐用原文中写的huggingface中的数据集

我用hf方式的路径,在训练过程中个自动下载的时候没问题,但是本地load就会报错

@ShawnHoo7256
Copy link

同样遇到这个问题,这边解决方式是:

  • 下hf的数据,如果能在本地通过pyarrow打开数据文件

import pyarrow.parquet as pq pq.read_table("your_dataset.parquet")

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

4 participants