Skip to content

v0.3.3

Compare
Choose a tag to compare
@github-actions github-actions released this 31 Dec 03:00
· 90 commits to master since this release
82a57b0

Model download: https://huggingface.co/unit-mesh/autodev-deepseek-6.7b-finetunes

# Merge and shuffle records from different files
merge_jsonl(
    output_file=merged_file,
    input_files=[oss_instruction, python_instruction, 'code_bugfix_cleaned_5K.json', 'codeGPT_CN_cleaned_20K.json',
                 'code_summarization_CN_cleaned_10K.json', 'code_generation_CN_cleaned_5K.json', 'summary.jsonl'],
    lines_per_file=[4000, 4000, 4000, 15000, 8000, 4000, 25000]
)