AdilZouitine
f30da2dec1
Enhance training and logging functionality with accelerator support
...
- Added support for multi-GPU training by introducing an `accelerator` parameter in training functions.
- Updated `update_policy` to handle gradient updates based on the presence of an accelerator.
- Modified logging to prevent duplicate messages in non-main processes.
- Enhanced `set_seed` and `get_safe_torch_device` functions to accommodate accelerator usage.
- Updated `MetricsTracker` to account for the number of processes when calculating metrics.
- Introduced a new feature in `pyproject.toml` for the `accelerate` library dependency.
2025-10-02 18:11:27 +02:00
Steven Palma
f59eb54f5c
chore: remove unused code ( #2062 )
2025-09-29 10:49:36 +02:00
Steven Palma
853cc70194
chore(utils): remove unused utils legacy functions + rename init_rerun ( #2031 )
2025-09-24 17:10:27 +02:00
Michel Aractingi
f55c6e89f0
Dataset v3 ( #1412 )
...
Co-authored-by: Simon Alibert <75076266+aliberts@users.noreply.github.com >
Co-authored-by: Remi Cadene <re.cadene@gmail.com >
Co-authored-by: Tavish <tavish9.chen@gmail.com >
Co-authored-by: fracapuano <francesco.capuano@huggingface.co >
Co-authored-by: CarolinePascal <caroline8.pascal@gmail.com >
2025-09-15 09:53:30 +02:00
Steven Palma
378e1f0338
Update pre-commit-config.yaml + pyproject.toml + ceil rerun & transformer dependencies version ( #1520 )
...
* chore: update .gitignore
* chore: update pre-commit
* chore(deps): update pyproject
* fix(ci): multiple fixes
* chore: pre-commit apply
* chore: address review comments
* Update pyproject.toml
Co-authored-by: Ben Zhang <5977478+ben-z@users.noreply.github.com >
Signed-off-by: Steven Palma <imstevenpmwork@ieee.org >
* chore(deps): add todo
---------
Signed-off-by: Steven Palma <imstevenpmwork@ieee.org >
Co-authored-by: Ben Zhang <5977478+ben-z@users.noreply.github.com >
2025-07-17 14:30:20 +02:00
Eugene Mironov
3efb4410f1
Fix logging for mps in auto_select_torch_device ( #1513 )
2025-07-15 21:23:00 +02:00
Caroline Pascal
cf86b9300d
fix(logging): Fixing logging levels ( #1466 )
...
* fix(logging): Fixing logging levels, adding custom logging levels for console and file logging
* clean(typing): Adding typing in logging formatter, use proper getter for logging message
2025-07-08 18:59:13 +02:00
Simon Alibert
d4ee470b00
Package folder structure ( #1417 )
...
* Move files
* Replace imports & paths
* Update relative paths
* Update doc symlinks
* Update instructions paths
* Fix imports
* Update grpc files
* Update more instructions
* Downgrade grpc-tools
* Update manifest
* Update more paths
* Update config paths
* Update CI paths
* Update bandit exclusions
* Remove walkthrough section
2025-07-01 16:34:46 +02:00
