The LongWriter-6k dataset was launched by Tsinghua University and Zhipu AI in 2024. It contains 6,000 SFT data with an output length of 2k-32k words (including English and Chinese). It can support the training of LLM and expand its maximum output window size to 10,000+ words.LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs".

Citation

@article{bai2024longwriter, title={LongWriter: Unleashing 10,000+ Word Generation from Long Context LLMs}, author={Yushi Bai and Jiajie Zhang and Xin Lv and Linzhi Zheng and Siqi Zhu and Lei Hou and Yuxiao Dong and Jie Tang and Juanzi Li}, journal={arXiv preprint arXiv:2408.07055}, year={2024} }