Transformer
文章标题：Attention Is All You Need 作者：Ashish Vaswani, Noam Shazeer, Niki Parmar, Jakob Uszkoreit, Llion Jones, Aidan N. Gomez, Lukasz Kaiser, Illia Polosukhin 发表时 …
Tag
Deep Learning
带有 Deep Learning 标签的 37 篇文章。
BERT
文章标题：BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding 作者：Jacob Devlin, Ming-Wei Chang, Kenton Lee, Kristina Toutanova 发表时 …
VIT
[toc] Vision Transformer () 文章标题：An Image is Worth 16x16 Words: Transformers for Image Recognition at Scale 作者：Alexey Dosovitskiy; Lucas Beyer, Alexander …
MAE
文章标题：Masked Autoencoders Are Scalable Vision Learners 作者：Kaiming He, Xinlei Chen, Saining Xie, Yanghao Li, Piotr Dollár, Ross Girshick 发表时间：2021 官方代码 BERT的CV …
VILT
文章标题：ViLT: Vision-and-Language Transformer Without Convolution or Region Supervision 作者：Wonjae Kim, Bokyung Son, Ildoo Kim 发表时间：(ICML 2021) offical code 第一个摆脱了目 …
CLIP
文章标题：Learning Transferable Visual Models From Natural Language Supervision 作者：Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini …
ALBEF
文章标题：Align before Fuse: Vision and Language Representation Learning with Momentum Distillation 作者：Junnan Li, Ramprasaath R. Selvaraju, Akhilesh Deepak Gotmare, …
SimCLR
-V1 文章标题：A Simple Framework for Contrastive Learning of Visual Representations 作者：Ting Chen, Simon Kornblith, Mohammad Norouzi, Geoffrey Hinton 发表时间：(ICML 2020) …
Moco
MoCo 文章标题：Momentum Contrast for Unsupervised Visual Representation Learning 作者：Kaiming He, Haoqi Fan, Yuxin Wu, Saining Xie, Ross Girshick 发表时间：(CVPR 2020) …
InstDisc
文章标题：Unsupervised Feature Learning via Non-Parametric Instance-level Discrimination 作者：Zhirong Wu, Yuanjun Xiong, Stella Yu, Dahua Lin 发表时间：(CVPR 2018) 这篇论文提出了个 …
BYOL
SwAV 文章标题：Unsupervised Learning of Visual Features by Contrasting Cluster Assignments 作者：Mathilde Caron, Ishan Misra, Julien Mairal, Priya Goyal, Piotr …
Spatial Attention
基于 RNN 的方法 RAM 文章标题： 作者： 发表时间：() 使用子网络来显式预测相关区域 STN 使用子网络来隐式预测软掩码以选择重要区域 GENet 自注意力相关 Non-local 文章标题：Non-local Neural Networks 作者：Xiaolong Wang, Ross Girshick, …