You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
i'm working on sw-en translation. After running build-training-data.sh the train.src looks like this : <2eng> Je, utatupa hii?
While running preprocess.sh getting the below error i.e. not able to read '<' characters as per my understanding.
Traceback (most recent call last):
File "/gpfs-volume/Afro-NMT/scripts/spm-subword.py", line 95, in
main()
File "/gpfs-volume/Afro-NMT/scripts/spm-subword.py", line 79, in main
encode(args.spm_dir, args.in_file, args.src, args.op_file)
File "/gpfs-volume/Afro-NMT/scripts/spm-subword.py", line 36, in encode
print(' '.join(spm_spp.EncodeAsPieces(line.strip())), file=outfile)
UnicodeEncodeError: 'ascii' codec can't encode character '\u2581' in position 0: ordinal not in range(128)
Can you help how it can be resolved.
The text was updated successfully, but these errors were encountered:
Uh oh!
There was an error while loading. Please reload this page.
i'm working on sw-en translation. After running build-training-data.sh the train.src looks like this : <2eng> Je, utatupa hii?
While running preprocess.sh getting the below error i.e. not able to read '<' characters as per my understanding.
Traceback (most recent call last):
File "/gpfs-volume/Afro-NMT/scripts/spm-subword.py", line 95, in
main()
File "/gpfs-volume/Afro-NMT/scripts/spm-subword.py", line 79, in main
encode(args.spm_dir, args.in_file, args.src, args.op_file)
File "/gpfs-volume/Afro-NMT/scripts/spm-subword.py", line 36, in encode
print(' '.join(spm_spp.EncodeAsPieces(line.strip())), file=outfile)
UnicodeEncodeError: 'ascii' codec can't encode character '\u2581' in position 0: ordinal not in range(128)
Can you help how it can be resolved.
The text was updated successfully, but these errors were encountered: