Skip to content

Pull requests: allenai/OLMo

New pull request New
Clear current search query, filters, and sorts
58 Open 539 Closed
58 Open 539 Closed
Author
Filter by author
Loading
Label
Filter by label
Loading
Use alt + click/return to exclude labels
or ⇧ + click/return for logical OR
Projects
Filter by project
Loading
Milestones
Filter by milestone
Loading
Reviews
Filter by reviews
No reviews Review required Approved review Changes requested
Assignee
Filter by who’s assigned
Assigned to nobody Loading
Sort
Sort by
Newest Oldest Most commented Least commented Recently updated Least recently updated Best match
Most reactions
👍 👎 😄 🎉 😕 ❤️ 🚀 👀

Pull requests list

Added new HF datasets => Perplexity format functions
#202 opened Jun 5, 2023 by tusharkhot
1
integrate mock vision backbone into model
#441 opened Feb 8, 2024 by epwalsh
3
Ladder 1xC
#677 opened Jul 27, 2024 by AkshitaB • Review required
Optionally load trainer state
#573 opened May 13, 2024 by Muennighoff • Review required
8
DeepSpeed
#384 opened Nov 27, 2023 by Muennighoff • Draft
2
Add OLMoE checkpoints and run config
#707 opened Aug 19, 2024 by 2015aroras • Review required
2
[Feature] add tensorbard support to the training framework
#811 opened Mar 21, 2025 by lyuwen • Changes requested
5
hf_olmo needs datasets dependency
#822 opened Apr 7, 2025 by IanMagnusson • Review required
Decoupled Momentum Optimization
#771 opened Dec 24, 2024 by peter-sk • Changes requested
@dirkgr
6
update mean reduction zloss to ignore labels == ignore_index
#760 opened Dec 4, 2024 by jasonkrone • Approved
@dirkgr
1
Docs model ladder
#708 opened Aug 19, 2024 by IanMagnusson • Draft
2
Set fs_local_rank as global_rank when FS_LOCAL_RANK is not available
#456 opened Feb 18, 2024 by hxdtest • Review required
1
Adds support for converting from safetensors
#740 opened Oct 23, 2024 by soldni • Approved
1
Add regression tests for training
#730 opened Oct 7, 2024 by 2015aroras • Review required
1
Adding script for processing many intermediate checkpoints at once for offline evals
#731 opened Oct 8, 2024 by IanMagnusson • Changes requested
@IanMagnusson @jenahwang
11
DNM: Loss issue checkpoint with refine1b setups
#682 opened Jul 31, 2024 by undfined • Review required
[wip] Kylel/readme
#681 opened Jul 31, 2024 by kyleclo • Draft
1
Add triton implementation of layer norm status/blocked Progress can't be made because we're waiting on something outside of our control
#260 opened Sep 6, 2023 by epwalsh • Draft
2
Mitchish kempner
#352 opened Oct 31, 2023 by ibeltagy • Changes requested
5
Inital GQ Attn Impl, issue w scaled_dot_product_attn
#241 opened Aug 14, 2023 by saurabh111233212 • Draft
1
Try new base image
#215 opened Jun 16, 2023 by epwalsh • Draft
1
Adding a torch barrier before loading of pre-train checkpoint
#234 opened Jul 19, 2023 by drschwenk • Changes requested
6
Reverse weight decay
#567 opened May 3, 2024 by AkshitaB • Changes requested
1 task done
21
Scripts for QKV experiments
#510 opened Mar 20, 2024 by AkshitaB • Review required
Add scripts for Dave
#516 opened Mar 21, 2024 by epwalsh • Draft
ProTip! Exclude everything labeled bug with -label:bug.