Search results

Pretrain data source request

Status: Open.

#34 In TencentARC/LLaMA-Pro;

· shutttttdown opened on Jan 5, 2025

这个方法可以扩展到vit类的视觉encode上吗？

Status: Open.

#33 In TencentARC/LLaMA-Pro;

· lucasjinreal opened on Aug 29, 2024

请教大佬可以训练qewn2-7b吗

Status: Open.

#32 In TencentARC/LLaMA-Pro;

· jqtian123 opened on Aug 23, 2024

关于运行流程

Status: Open.

#30 In TencentARC/LLaMA-Pro;

· GOOD-N-LCM opened on Jun 26, 2024

关于零初始化和扩展层的位置

Status: Open.

#28 In TencentARC/LLaMA-Pro;

· ouyanxi1125 opened on Jun 7, 2024

finetune_cosmopedia.sh如何训练出来8B模型

Status: Open.

#27 In TencentARC/LLaMA-Pro;

· RuipingWang1986 opened on May 20, 2024

利用finetune_cosmopedia.sh脚本进行继续预训练中的数据集如何构建

Status: Open.

#26 In TencentARC/LLaMA-Pro;

· RuipingWang1986 opened on May 20, 2024

Thanks for wonderful projects ! Why I always got the results of apparent loss of original ability?

Status: Open.

#25 In TencentARC/LLaMA-Pro;

· hzgdeerHo opened on May 17, 2024

Training on arbitary data

Status: Open.

#23 In TencentARC/LLaMA-Pro;

· HelloWorldLTY opened on Apr 8, 2024

Pretrain code of Mistral-Pro-8B-v0.1

Status: Open.

#22 In TencentARC/LLaMA-Pro;

· shawnricecake opened on Apr 5, 2024

请教下训练的显存需求

Status: Open.

#20 In TencentARC/LLaMA-Pro;

· denghj3 opened on Mar 27, 2024

Comparison with PEFT

Status: Open.

#19 In TencentARC/LLaMA-Pro;

· LaVieEnRose365 opened on Mar 14, 2024