This is a minimal version for DeLA.

Please refer to [timm](https://github.com/rwightman/pytorch-image-models) for the official version.

Functions kept:

CosineLRScheduler

create_optimizer_v2 (with adamw)

DropPath
