machine learning

Transformer with adaptive inference where simpler images are classified faster. Tokens are automatically stopped at various depth once become irrelevant. Learned via differentiable loss inspired by ACT.

Global pruning of vision transformer networks. New parameter redistribution rule for ViT. 2x latency reduction with minor acucracy loss. More than 1.4% accuracy gain when pruned towards smaller model.