huggingface/pytorch-image-models v0.1-weights-swinv2

Swin Transformer V2 (CR) weights and experiments

on GitHub

This release holds weights for timm's variant of Swin V2 (from @ChristophReich1996 impl, https://github.com/ChristophReich1996/Swin-Transformer-V2)

NOTE: ns variants of the models have extra norms on the main branch at the end of each stage, this seems to help training. The current small model is not using this, but currently training one. Will have a non-ns tiny soon as well as a comparsion. in21k and 1k base models are also in the works...

small checkpoints trained on TPU-VM instances via the TPU-Research Cloud (https://sites.research.google/trc/about/)

• swin_v2_tiny_ns_224 - 81.80 top-1
• swin_v2_small_224 - 83.13 top-1
• swin_v2_small_ns_224 - 83.5 top-1