Skip to content

Commit 022403c

Browse files
committed
Update README
1 parent 2e38d53 commit 022403c

File tree

1 file changed

+7
-0
lines changed

1 file changed

+7
-0
lines changed

README.md

Lines changed: 7 additions & 0 deletions
Original file line numberDiff line numberDiff line change
@@ -24,6 +24,13 @@ And a big thanks to all GitHub sponsors who helped with some of my costs before
2424
* ❗Updates after Oct 10, 2022 are available in 0.8.x pre-releases (`pip install --pre timm`) or cloning main❗
2525
* Stable releases are 0.6.x and available by normal pip install or clone from [0.6.x](https://github.com/rwightman/pytorch-image-models/tree/0.6.x) branch.
2626

27+
### Feb 16, 2023
28+
* `safetensor` checkpoint support added
29+
* Add ideas from 'Scaling Vision Transformers to 22 B. Params' (https://arxiv.org/abs/2302.05442) -- qk norm, RmsNorm, parallel block
30+
* Add F.scaled_dot_product_attention support (PyTorch 2.0 only) to `vit_*`, `vit_relpos*`, `coatnet` / `maxxvit` (to start)
31+
* Lion optimizer (w/ multi-tensor option) added (https://arxiv.org/abs/2302.06675)
32+
* gradient checkpointing works with `features_only=True`
33+
2734
### Feb 7, 2023
2835
* New inference benchmark numbers added in [results](results/) folder.
2936
* Add convnext LAION CLIP trained weights and initial set of in1k fine-tunes

0 commit comments

Comments
 (0)