We read every piece of feedback, and take your input very seriously.
To see all available qualifiers, see our documentation.
Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.
By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.
Already on GitHub? Sign in to your account
dtype在哪里设置??
The text was updated successfully, but these errors were encountered:
Hi @robinjoe93 ,这不一定是设置的问题,请仔细检测你的配置文件和数据集文件是否正确
Sorry, something went wrong.
这个问题有遇到,我的情况是数据集下载的方式错了,用的ModelScope中的数据集。
推荐用原文中写的huggingface中的数据集
我用hf方式的路径,在训练过程中个自动下载的时候没问题,但是本地load就会报错
同样遇到这个问题,这边解决方式是:
import pyarrow.parquet as pq pq.read_table("your_dataset.parquet")
No branches or pull requests
dtype在哪里设置??
The text was updated successfully, but these errors were encountered: