Skip to content
GitLab
Explore
Sign in
Primary navigation
Search or go to…
Project
P
PyTorch at JSC
Manage
Activity
Members
Labels
Plan
Issues
Issue boards
Milestones
Wiki
Code
Merge requests
Repository
Branches
Commits
Tags
Repository graph
Compare revisions
Snippets
Build
Pipelines
Jobs
Pipeline schedules
Artifacts
Deploy
Releases
Package registry
Container registry
Model registry
Operate
Environments
Terraform modules
Monitor
Incidents
Analyze
Value stream analytics
Contributor analytics
CI/CD analytics
Repository analytics
Model experiments
Help
Help
Support
GitLab documentation
Compare GitLab plans
GitLab community forum
Contribute to GitLab
Provide feedback
Keyboard shortcuts
?
Snippets
Groups
Projects
Show more breadcrumbs
Simulation and Data Lab Applied Machine Learning
PyTorch at JSC
Commits
Commits · bd050edf07f7ad509ec585bd7ca25ff14e2a0b5c
bd050edf07f7ad509ec585bd7ca25ff14e2a0b5c
Select Git revision
Selected
bd050edf07f7ad509ec585bd7ca25ff14e2a0b5c
Branches
1
main
default
protected
2 results
pytorch-at-jsc
pytorch-fsdp-example
main.py
Author
Search by author
Any Author
authors
Alban Linchet Martinez
linchetmartinez1
Alexandre Strube
strube1
Alina Bazarova
bazarova1
Anna Alicke
scholl1
Anoop K. Chandran
chandran1
Bjoern Hagemeier
hagemeier2
Denny Gert
gert1
Emile de Bruyn
debruyn1
Fritz Niesel
niesel1
Jan Ebert
ebert1
Javad Kasravi
kasravi1
Jiangtao Wang
wang55
Jose Ignacio Robledo
robledo1
Maria Petrova-El Sayed
petrova1
Mascha Samantha Schmidt
schmidt13
Oleg Filatov
filatov1
Rania Briq
briq2
Sabrina Narimene Benassou
benassou1
Stefan Kesselheim
kesselheim1
Victor Haguet
haguet1
20 authors
Browse files
Oct 16, 2024
Specify Gloo backend for CPU
· bd050edf
Jan Ebert
authored
9 months ago
bd050edf
Properly shut down distributed process group
· 1721a1aa
Jan Ebert
authored
9 months ago
1721a1aa
Oct 09, 2024
Also scale other optimizer parameters
· c941cc9c
Jan Ebert
authored
10 months ago
c941cc9c
Jul 09, 2024
Use square root LR scaling
· e72c8976
Jan Ebert
authored
Jul 9, 2024
e72c8976
Use a simple auto wrapping policy
· 1707daa1
Jan Ebert
authored
Jul 9, 2024
1707daa1
Jul 02, 2024
Extend `no_grad` context
· f1c468df
Jan Ebert
authored
Jul 2, 2024
f1c468df
Make learning rate scaling optional non-default
· cdbbbbf1
Jan Ebert
authored
Jul 2, 2024
cdbbbbf1
May 03, 2024
Add FSDP example
· 1a3c1694
Jan Ebert
authored
May 3, 2024
1a3c1694
Add PyTorch DDP example
· eac57cd5
Jan Ebert
authored
May 3, 2024
eac57cd5
Loading